[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3493612.3520470acmconferencesArticle/Chapter ViewAbstractPublication Pagesw4aConference Proceedingsconference-collections
research-article

When headers are not there: design and user evaluation of an automatic topicalisation and labelling tool to aid the exploration of web documents by blind users

Published: 27 April 2022 Publication History

Abstract

Using headers to grasp a document's structure has been one of the main strategies employed by blind users on web documents when using screen readers. However, when headers are not available or not appropriately marked up, they can cause serious difficulties. This paper presents the design and evaluation of a tool for automatically generating headers for screen readers with topicalisation and labelling algorithms. The proposed tool uses Natural Language Processing techniques to divide a web document into topic segments and label each segment based on its content. We conducted an initial user study with eight blind and partially-sighted screen reader users. The evaluation involved tasks with questions answered by participants with information from texts with and without automatically generated headers. Results provided preliminary indicators of improvement in performance and reduction of cognitive load. The findings contribute to knowledge to improve tools to aid in text exploration. It also provides initial empirical evidence to be further explored to analyze the impact of automatically-generated headings in improving performance and reducing cognitive load for blind users.

References

[1]
Faisal Ahmed, Yevgen Borodin, Andrii Soviak, Muhammad Islam, I.V. Ramakrishnan, and Terri Hedgpeth. 2012. Accessible Skimming: Faster Screen Reading of Web Pages. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST '12). Association for Computing Machinery, New York, NY, USA, 367--378.
[2]
Faisal Ahmed, Andrii Soviak, Yevgen Borodin, and I.V. Ramakrishnan. 2013. Non-visual Skimming on Touch-screen Devices. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (Santa Monica, California, USA) (IUI '13). ACM, New York, NY, USA, 435--444.
[3]
Alexander A Alemi and Paul Ginsparg. 2015. Text segmentation based on semantic word embeddings. arXiv preprint arXiv:1503.05543 (2015). http://arxiv-export-lb.library.cornell.edu/abs/1503.05543?context=cs
[4]
Erick Antonio Alves, Paula Christina Figueira Cardoso, and André Pimenta Freire. 2018. Automatically Generated Summaries as In-Page Web Navigation Accelerators for Blind Users. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (Belém, Brazil) (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 10, 8 pages.
[5]
Doug Beeferman, Adam Berger, and John Lafferty. 1999. Statistical models for text segmentation. Machine learning 34, 1 (1999), 177--210.
[6]
Shraey Bhatia, Jey Han Lau, and Timothy Baldwin. 2016. Automatic Labelling of Topics with Neural Embeddings. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee, Osaka, Japan, 953--963. https://www.aclweb.org/anthology/C16-1091
[7]
Yevgen Borodin, Jeffrey P. Bigham, Glenn Dausch, and I. V. Ramakrishnan. 2010. More than Meets the Eye: A Survey of Screen-Reader Browsing Strategies. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) (Raleigh, North Carolina) (W4A '10). Association for Computing Machinery, New York, NY, USA, Article 13, 10 pages.
[8]
Freddy Y. Y. Choi. 2000. Advances in Domain Independent Linear Text Segmentation. In Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference (Seattle, Washington) (NAACL 2000). Association for Computational Linguistics, USA, 26--33.
[9]
Freddy Y. Y. Choi, Peter Wiemer-Hastings, and Johanna Moore. 2001. Latent Semantic Analysis for Text Segmentation. In Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing. https://www.aclweb.org/anthology/W01-0514
[10]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. (June 2019), 4171--4186.
[11]
Everis. 2020. 2a pesquisa brasileira do uso de leitores de tela (Second Brazilian survey on the use of screen readers). Available online at https://estudoinclusivo.com.br/pesquisa-ldt-2019-relatorio.pdf, last accessed on 24 February 2022.
[12]
Prathik Gadde and Davide Bolchini. 2014. From Screen Reading to Aural Glancing: Towards Instant Access to Key Page Sections. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (Rochester, New York, USA) (ASSETS '14). Association for Computing Machinery, New York, NY, USA, 67--74.
[13]
Stéphanie Giraud, Pierre Thérouanne, and Dirk D. Steiner. 2018. Web accessibility: Filtering redundant and irrelevant information improves website usability for blind users. International Journal of Human-Computer Studies 111 (2018), 23--35.
[14]
João Guerreiro and Daniel Gonçalves. 2014. Text-to-Speeches: Evaluating the Perception of Concurrent Speech by Blind People. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (Rochester, New York, USA) (ASSETS '14). Association for Computing Machinery, New York, NY, USA, 169--176.
[15]
Marti A. Hearst. 1997. TextTiling: Segmenting Text into Multi-paragraph Subtopic Passages. Computational Linguistics 23, 1 (March 1997), 33--64. http://dl.acm.org/citation.cfm?id=972684.972687
[16]
Susan G. Hill, Helene P. Iavecchia, Alvah C. Bittner, James C. Byers, Allen L. Zaklad, and Richard E. Christ. 1992. Comparison of Four Subjective Workload Rating Scales. Human Factors 34, 4 (Aug. 1992), 429--439.
[17]
Erick G. Maziero, Thiago A. S. Pardo, Ariani Di Felippo, and Bento C. Dias-da Silva. 2008. A Base de Dados Lexical e a Interface Web Do TeP 2.0: Thesaurus EletrôNico Para o Portuguěs Do Brasil. In Companion Proceedings of the XIV Brazilian Symposium on Multimedia and the Web (Vila Velha, Espírito Santo, Brazil) (WebMedia '08). Association for Computing Machinery, New York, NY, USA, 390--392.
[18]
Hemant Misra, François Yvon, Olivier Cappé, and Joemon Jose. 2011. Text segmentation: A topic modeling perspective. Information Processing & Management 47, 4 (2011), 528--544.
[19]
Lourdes Moreno, Paloma Martnez, Javier Muguerza, and Julio Abascal. 2018. Support Resource Based on Standards for Accessible E-Government Transactional Services. Computer Standards & Interfaces 58, C (May 2018), 146--157.
[20]
Marwa Naili, Anja Habacha Chaibi, and Henda Hajjami Ben Ghezala. 2017. Comparative study of word embedding methods in topic segmentation. Procedia Computer Science 112 (2017), 340--349. Knowledge-Based and Intelligent Information & Engineering Systems: Proceedings of the 21st International Conference.
[21]
Marwa Naili, Anja Chaibi Habacha, and Henda Hajjami Ben Ghezala. 2018. Parameters Driving Effectiveness of LSA on Topic Segmentation. In Computational Linguistics and Intelligent Text Processing. Springer International Publishing, Cham, 560--572. https://link.springer.com/chapter/10.1007%2F978-3-319-75477-2_40
[22]
Christopher Power, Helen Petrie, David Swallow, Emma Murphy, Bláithín Gallagher, and Carlos A. Velasco. 2013. Navigating, Discovering and Exploring the Web: Strategies Used by People with Print Disabilities on Interactive Websites. In Human-Computer Interaction - INTERACT 2013. Springer Berlin Heidelberg, Berlin, Heidelberg, 667--684. https://link.springer.com/chapter/10.1007%2F978-3-642-40483-2_47
[23]
Keith Rayner, Elizabeth R. Schotter, Michael E. J. Masson, Mary C. Potter, and Rebecca Treiman. 2016. So Much to Read, So Little Time: How Do We Read, and Can Speed Reading Help? Psychological Science in the Public Interest 17, 1 (Jan. 2016), 4--34.
[24]
Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. https://arxiv.org/abs/1908.10084
[25]
Nils Reimers and Iryna Gurevych. 2020. Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. https://arxiv.org/abs/2004.09813
[26]
JC Reynar. 1998. Topic segmentation: Algorithms and applications. Ph.D. Thesis, Computer and Information Science, University of Pennsylvania.
[27]
Jeffrey C. Reynar. 1994. An Automatic Method of Finding Topic Boundaries. In Proceedings of the 32nd Annual Meeting on Association for Computational Linguistics (Las Cruces, New Mexico) (ACL '94). Association for Computational Linguistics, USA, 331--333.
[28]
Romisa Rohani Ghahari, Mexhid Ferati, Tao Yang, and Davide Bolchini. 2012. Back Navigation Shortcuts for Screen Reader Users. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (Boulder, Colorado, USA) (ASSETS '12). Association for Computing Machinery, New York, NY, USA, 1--8.
[29]
Alessandro Solbiati, Kevin Heffernan, Georgios Damaskinos, Shivani Poddar, Shubham Modi, and Jacques Cali. 2021. Unsupervised Topic Segmentation of Meetings with BERT Embeddings. arXiv preprint arXiv:2106.12978 (2021). https://export.arxiv.org/abs/2106.12978
[30]
Milan Straka. 2018. UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. Association for Computational Linguistics, Brussels, Belgium, 197--207.
[31]
John Sweller, Paul Ayres, and Slava Kalyuga. 2011. Measuring Cognitive Load. In Cognitive Load Theory. Springer New York, New York, NY, 71--85.
[32]
J. Tombaugh, A. Lickorish, and P. Wright. 1987. Multi-window displays for readers of lengthy texts. International Journal of Man-Machine Studies 26, 5 (1987), 597--615.
[33]
Johanne R. Trippas. 2016. Spoken Conversational Search: Speech-only Interactive Information Retrieval. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval (Carrboro, North Carolina, USA) (CHIIR '16). ACM, New York, NY, USA, 373--375.
[34]
Tamara van Gog, Femke Kirschner, Liesbeth Kester, and Fred Paas. 2012. Timing and Frequency of Mental Effort Measurement: Evidence in Favour of Repeated Measures. Applied Cognitive Psychology 26, 6 (2012), 833--839. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/acp.2883
[35]
WebAIM. 2021. Screen Reader User Survey #9 Results. Availableonlineathttps://webaim.org/projects/screenreadersurvey9/, lastaccessedon24February2022

Cited By

View all
  • (2024)In-Page Navigation Aids for Screen-Reader Users with Automatic Topicalisation and LabellingACM Transactions on Accessible Computing10.1145/364922317:2(1-45)Online publication date: 22-Jul-2024
  • (2023)Identification of Challenges and Best Practices for Including Users with Disabilities in User-Based TestingApplied Sciences10.3390/app1309549813:9(5498)Online publication date: 28-Apr-2023
  • (2022)Accessibility landmarks identification in web applications based on DOM elements classificationUniversal Access in the Information Society10.1007/s10209-022-00959-823:2(765-777)Online publication date: 13-Dec-2022

Index Terms

  1. When headers are not there: design and user evaluation of an automatic topicalisation and labelling tool to aid the exploration of web documents by blind users

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    W4A '22: Proceedings of the 19th International Web for All Conference
    April 2022
    209 pages
    ISBN:9781450391702
    DOI:10.1145/3493612
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 April 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. accessibility
    2. automatic topicalisation and labelling
    3. natural language processing
    4. screen readers

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    W4A'22
    W4A'22: 19th Web for All Conference
    April 25 - 26, 2022
    Lyon, France

    Acceptance Rates

    W4A '22 Paper Acceptance Rate 18 of 36 submissions, 50%;
    Overall Acceptance Rate 171 of 371 submissions, 46%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 11 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)In-Page Navigation Aids for Screen-Reader Users with Automatic Topicalisation and LabellingACM Transactions on Accessible Computing10.1145/364922317:2(1-45)Online publication date: 22-Jul-2024
    • (2023)Identification of Challenges and Best Practices for Including Users with Disabilities in User-Based TestingApplied Sciences10.3390/app1309549813:9(5498)Online publication date: 28-Apr-2023
    • (2022)Accessibility landmarks identification in web applications based on DOM elements classificationUniversal Access in the Information Society10.1007/s10209-022-00959-823:2(765-777)Online publication date: 13-Dec-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media