"I look at it as the king of knowledge": How Blind People Use and Understand Generative AI Tools
Article No.: 64, Pages 1 - 14
Abstract
The proliferation of Generative Artificial Intelligence (GenAI) tools has brought a critical shift in how people approach information retrieval and content creation in diverse contexts. Yet, we have limited understanding of how blind people use and make sense of GenAI systems. To bridge this gap, we report findings from interviews with 19 blind individuals who incorporate mainstream GenAI tools like ChatGPT and Be My AI in their everyday practices. Our findings reveal how blind users navigate accessibility issues, inaccuracies, hallucinations, and idiosyncracies associated with GenAI and develop interesting (but often flawed) mental models of how these tools work. We discuss key considerations for rethinking access and information verification in GenAI tools, unpacking erroneous mental models among blind users, and reconciling harms and benefits of GenAI from an accessibility perspective.
Supplemental Material
ZIP File
The supplementary material includes the interview guide used for the semi-structured interviews.
- Download
- 71.25 KB
References
[1]
Ali Abdolrahmani, Kevin M. Storer, Antony Rishin Mukkath Roy, Ravi Kuber, and Stacy M. Branham. 2020. Blind Leading the Sighted: Drawing Design Insights from Blind Users towards More Productivity-oriented Voice Interfaces. ACM Transactions on Accessible Computing (TACCESS) 12, 4, Article 18 (jan 2020), 35 pages. https://doi.org/10.1145/3368426
[2]
Gus Alexiou. 2023. Envision Adds ChatGPT AI Sight Assistance To Its Smart Glasses For The Blind. Retrieved 23 April, 2024 from https://www.forbes.com/sites/gusalexiou/2023/04/30/envision-adds-chatgpt-ai-sight-assistance-to-its-smart-glasses-for-the-blind/?sh=d443c835446f.
[3]
Safinah Ali, Prerna Ravi, Randi Williams, Daniella DiPaola, and Cynthia Breazeal. 2024. Constructing Dreams Using Generative AI. Proceedings of the AAAI Conference on Artificial Intelligence 38, 21 (Mar. 2024), 23268–23275. https://doi.org/10.1609/aaai.v38i21.30374
[4]
Matin Amoozadeh, David Daniels, Daye Nam, Aayush Kumar, Stella Chen, Michael Hilton, Sruti Srinivasa Ragavan, and Mohammad Amin Alipour. 2024. Trust in Generative AI among Students: An exploratory study. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 (Portland, OR, USA) (SIGCSE 2024). ACM, 67–73. https://doi.org/10.1145/3626252.3630842
[5]
Anthropic. 2024. Claude: Conversational AI by Anthropic. Retrieved 23 April, 2024 from https://www.anthropic.com/claude.
[6]
Gagan Bansal, Besmira Nushi, Ece Kamar, Walter S Lasecki, Daniel S Weld, and Eric Horvitz. 2019. Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7. 2–11. https://doi.org/10.1609/hcomp.v7i1.5285
[7]
Edward C Bell and Natalia M Mino. 2015. Employment Outcomes for Blind and Visually Impaired Adults. Journal of Blindness Innovation and Research 5, 2 (2015). http://dx.doi.org/10.5241/5-85
[8]
Nathan Bos, Kimberly Glasgow, John Gersh, Isaiah Harbison, and Celeste Lyn Paul. 2019. Mental models of AI-based systems: User predictions and explanations of image classification results. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 63. 184–188. https://doi.org/10.1177/1071181319631392
[9]
Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, and Tovi Grossman. 2023. Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST ’23). ACM, Article 96, 14 pages. https://doi.org/10.1145/3586183.3606725
[10]
Virginia Braun and Victoria Clarke. 2021. Thematic analysis: a practical guide. SAGE Publications Ltd. https://us.sagepub.com/en-us/nam/thematic-analysis/book248481
[11]
Ritvik Budhiraja, Ishika Joshi, Jagat Sesh Challa, Harshal D. Akolekar, and Dhruv Kumar. 2024. “It’s not like Jarvis, but it’s pretty close!” - Examining ChatGPT’s Usage among Undergraduate Students in Computer Science. In Proceedings of the 26th Australasian Computing Education Conference (Sydney, NSW, Australia) (ACE ’24). ACM, 124–133. https://doi.org/10.1145/3636243.3636257
[12]
Raluca Budiu. 2024. Generative AI Diary. Retrieved 23 April, 2024 from https://www.nngroup.com/articles/generative-ai-diary/.
[13]
Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, and Colin Raffel. 2021. Extracting Training Data from Large Language Models. In 30th USENIX Security Symposium (USENIX Security 21). USENIX Association, 2633–2650. https://www.usenix.org/conference/usenixsecurity21/presentation/carlini-extracting
[14]
Tiffany Chen, Cassandra Lee, Jessica R Mindel, Neska Elhaouij, and Rosalind Picard. 2023. Closer Worlds: Using Generative AI to Facilitate Intimate Conversations. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). ACM, Article 68, 15 pages. https://doi.org/10.1145/3544549.3585651
[15]
Yuyan Chen, Qiang Fu, Yichen Yuan, Zhihao Wen, Ge Fan, Dayiheng Liu, Dongmei Zhang, Zhixu Li, and Yanghua Xiao. 2023. Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management (Birmingham, United Kingdom) (CIKM ’23). ACM, 245–255. https://doi.org/10.1145/3583780.3614905
[16]
Ruijia Cheng, Ruotong Wang, Thomas Zimmermann, and Denae Ford. 2024. “It would work for me too”: How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools. ACM Transactions on Interactive Intelligent Systems (TIIS) 14, 2, Article 11 (may 2024), 39 pages. https://doi.org/10.1145/3651990
[17]
Debby R. E. Cotton, Peter A. Cotton, and J. Reuben Shipway. 2024. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International 61, 2 (2024), 228–239. https://doi.org/10.1080/14703297.2023.2190148
[18]
Maitraye Das, Alexander J. Fiannaca, Meredith Ringel Morris, Shaun K. Kane, and Cynthia L. Bennett. 2024. From Provenance to Aberrations: Image Creator and Screen Reader User Perspectives on Alt Text for AI-Generated Images. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). 21 pages. https://doi.org/10.1145/3613904.3642325
[19]
Maitraye Das, Darren Gergle, and Anne Marie Piper. 2019. “It doesn’t win you friends”: Understanding Accessibility in Collaborative Writing for People with Vision Impairments. Proceedings of the ACM on Human-Computer Interaction 3, CSCW, Article 191 (nov 2019), 26 pages. https://doi.org/10.1145/3359293
[20]
Michael Ann DeVito, Jeremy Birnholtz, Jeffery T. Hancock, Megan French, and Sunny Liu. 2018. How People Form Folk Theories of Social Media Feeds and What it Means for How We Study Self-Presentation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, 1–12. https://doi.org/10.1145/3173574.3173694
[21]
Nicholas Epley, Adam Waytz, and John T Cacioppo. 2007. On seeing human: a three-factor theory of anthropomorphism.Psychological review 114, 4 (2007), 864. https://doi.org/10.1037/0033-295X.114.4.864
[22]
Motahhare Eslami, Karrie Karahalios, Christian Sandvig, Kristen Vaccaro, Aimee Rickman, Kevin Hamilton, and Alex Kirlik. 2016. First I "like" it, then I hide it: Folk Theories of Social Feeds. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, 2371–2382. https://doi.org/10.1145/2858036.2858494
[23]
Be My Eyes. 2023. Image to Text AI and Blurred Faces: What’s Going On?Retrieved April 23, 2024 from https://www.bemyeyes.com/blog/image-to-text-ai-and-blurred-faces-whats-going-on.
[24]
Stefan Feuerriegel, Jochen Hartmann, Christian Janiesch, and Patrick Zschech. 2024. Generative AI. Business & Information Systems Engineering 66, 1 (2024), 111–126. https://link.springer.com/article/10.1007/s12599-023-00834-7
[25]
Vinitha Gadiraju, Shaun Kane, Sunipa Dev, Alex Taylor, Ding Wang, Emily Denton, and Robin Brewer. 2023. “I wouldn’t say offensive but...": Disability-Centered Perspectives on Large Language Models. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (Chicago, IL, USA) (FAccT ’23). ACM, 205–216. https://doi.org/10.1145/3593013.3593989
[26]
Katy Ilonka Gero, Zahra Ashktorab, Casey Dugan, Qian Pan, James Johnson, Werner Geyer, Maria Ruiz, Sarah Miller, David R. Millen, Murray Campbell, Sadhana Kumaravel, and Wei Zhang. 2020. Mental Models of AI Agents in a Cooperative Game Setting. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, 1–12. https://doi.org/10.1145/3313831.3376316
[27]
Katy Ilonka Gero, Tao Long, and Lydia B Chilton. 2023. Social Dynamics of AI Support in Creative Writing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 245, 15 pages. https://doi.org/10.1145/3544548.3580782
[28]
Sarah Gibbons, Tarun Mugunthan, and Jakob Nielsen. 2023. Accordion Editing and Apple Picking: Early Generative-AI User Behaviors. Retrieved 23 April, 2024 from https://www.nngroup.com/articles/accordion-editing-apple-picking/.
[29]
Kate Glazko, Yusuf Mohammed, Ben Kosa, Venkatesh Potluri, and Jennifer Mankoff. 2024. Identifying and Improving Disability Bias in GPT-Based Resume Screening. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (Rio de Janeiro, Brazil) (FAccT ’24). ACM, 687–700. https://doi.org/10.1145/3630106.3658933
[30]
Kate S Glazko, Momona Yamagami, Aashaka Desai, Kelly Avery Mack, Venkatesh Potluri, Xuhai Xu, and Jennifer Mankoff. 2023. An Autoethnographic Case Study of Generative Artificial Intelligence’s Utility for Accessibility. In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA) (ASSETS ’23). ACM, Article 99, 8 pages. https://doi.org/10.1145/3597638.3614548
[31]
Ricardo E Gonzalez Penuela, Jazmin Collins, Cynthia Bennett, and Shiri Azenkot. 2024. Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision People. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). ACM, Article 901, 21 pages. https://doi.org/10.1145/3613904.3642211
[32]
Steven M. Goodman, Erin Buehler, Patrick Clary, Andy Coenen, Aaron Donsbach, Tiffanie N. Horne, Michal Lahav, Robert MacDonald, Rain Breaw Michaels, Ajit Narayanan, Mahima Pushkarna, Joel Riley, Alex Santana, Lei Shi, Rachel Sweeney, Phil Weaver, Ann Yuan, and Meredith Ringel Morris. 2022. LaMPost: Design and Evaluation of an AI-assisted Email Writing Prototype for Adults with Dyslexia. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (Athens, Greece) (ASSETS ’22). ACM, Article 24, 18 pages. https://doi.org/10.1145/3517428.3544819
[33]
Google. 2024. Gemini. Retrieved 12 April, 2024 from https://gemini.google.com/app.
[34]
Jan Grue. 2016. The problem with inspiration porn: a tentative definition and a provisional critique. Disability & Society 31, 6 (2016), 838–849. https://doi.org/10.1080/09687599.2016.1205473
[35]
Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, and Jeffrey P. Bigham. 2018. VizWiz Grand Challenge: Answering Visual Questions from Blind People. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 3608–3617. https://doi.org/10.1109/CVPR.2018.00380
[36]
Orit Hazzan and Yael Erez. 2024. Generative AI in Computer Science Education. In Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2 (Portland, OR, USA) (SIGCSE 2024). ACM, 1899. https://doi.org/10.1145/3626253.3633409
[37]
Amanda Heidt. 2024. ‘Without these tools, I’d be lost’: how generative AI aids in accessibility. Retrieved 23 April, 2024 from https://www.nature.com/articles/d41586-024-01003-w.
[38]
Laurie Henneborn. 2023. Designing Generative AI to Work for People with Disabilities. Retrieved 23 April, 2024 from https://hbr.org/2023/08/designing-generative-ai-to-work-for-people-with-disabilities.
[39]
Jonggi Hong, Jaina Gandhi, Ernest Essuah Mensah, Farnaz Zamiri Zeraati, Ebrima Jarjue, Kyungjun Lee, and Hernisa Kacorri. 2022. Blind Users Accessing Their Training Images in Teachable Object Recognizers. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (Athens, Greece) (ASSETS ’22). ACM, Article 14, 18 pages. https://doi.org/10.1145/3517428.3544824
[40]
Aike C. Horstmann, Clara Strathmann, Lea Lambrich, and Nicole C. Krämer. 2023. Alexa, What’s Inside of You: A Qualitative Study to Explore Users’ Mental Models of Intelligent Voice Assistants. In Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents (Würzburg, Germany) (IVA ’23). ACM, Article 5, 10 pages. https://doi.org/10.1145/3570945.3607335
[41]
Irene Hou, Sophia Mettille, Owen Man, Zhuo Li, Cynthia Zastudil, and Stephen MacNeil. 2024. The Effects of Generative AI on Computing Students’ Help-Seeking Preferences. In Proceedings of the 26th Australasian Computing Education Conference (Sydney, NSW, Australia) (ACE ’24). ACM, 39–48. https://doi.org/10.1145/3636243.3636248
[42]
Yue Huang, Borke Obada-Obieh, and Konstantin (Kosta) Beznosov. 2020. Amazon vs. My Brother: How Users of Shared Smart Speakers Perceive and Cope with Privacy Risks. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, 1–13. https://doi.org/10.1145/3313831.3376529
[43]
Mina Huh, Yi-Hao Peng, and Amy Pavel. 2023. GenAssist: Making Image Generation Accessible. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST ’23). ACM, Article 38, 17 pages. https://doi.org/10.1145/3586183.3606735
[44]
Nanna Inie, Stefania Druga, Peter Zukerman, and Emily M. Bender. 2024. From "AI" to Probabilistic Automation: How Does Anthropomorphization of Technical Systems Descriptions Influence Trust?. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (Rio de Janeiro, Brazil) (FAccT ’24). ACM, 2322–2347. https://doi.org/10.1145/3630106.3659040
[45]
Nanna Inie, Jeanette Falk, and Steve Tanimoto. 2023. Designing Participatory AI: Creative Professionals’ Worries and Expectations about Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). ACM, Article 82, 8 pages. https://doi.org/10.1145/3544549.3585657
[46]
JiWoong Jang, Sanika Moharana, Patrick Carrington, and Andrew Begel. 2024. “It’s the only thing I can trust”: Envisioning Large Language Model Use by Autistic Workers for Communication Assistance. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). ACM, Article 77, 18 pages. https://doi.org/10.1145/3613904.3642894
[47]
Rie Kamikubo, Kyungjun Lee, and Hernisa Kacorri. 2023. Contributing to Accessibility Datasets: Reflections on Sharing Study Data by Blind People. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 827, 18 pages. https://doi.org/10.1145/3544548.3581337
[48]
Ruogu Kang, Laura Dabbish, Nathaniel Fruchter, and Sara Kiesler. 2015. “My data just goes everywhere": User mental models of the internet and implications for privacy and security. In Proceedings of the Eleventh USENIX Conference on Usable Privacy and Security (Ottawa, Canada) (SOUPS ’15). USENIX Association, USA, 39–52. https://www.usenix.org/conference/soups2015/proceedings/presentation/kang
[49]
Majeed Kazemitabaar, Justin Chow, Carl Ka To Ma, Barbara J. Ericson, David Weintrop, and Tovi Grossman. 2023. Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 455, 23 pages. https://doi.org/10.1145/3544548.3580919
[50]
David E Kieras and Susan Bovair. 1984. The role of a mental model in learning to operate a device. Cognitive science 8, 3 (1984), 255–273. https://doi.org/10.1207/s15516709cog0803_3
[51]
Tanya Kraljic and Michal Lahav. 2024. From Prompt Engineering to Collaborating: A Human-Centered Approach to AI Interfaces. Interactions 31, 3 (may 2024), 30–35. https://doi.org/10.1145/3652622
[52]
Sri H. Kurniawan, Alistair G. Sutcliffe, Paul L. Blenkhorn, and Jae Eun Shin. 2003. Mental Models of Blind Users in the Windows Environment. International Journal of Rehabilitation Research 26, 2 (June 2003), 145–147. https://doi.org/10.1097/00004356-200306000-00011
[53]
Nimatul Lailiyah, Iswahyuni Iswahyuni, and Alies Poetri Lintangsari. 2020. English Spelling Errors Committed by the Blind. Indonesian Journal of Disability Studies 7, 1 (May 2020), 66–71. https://doi.org/10.21776/ub.ijds.2019.007.01.7
[54]
Jenny T. Liang, Chenyang Yang, and Brad A. Myers. 2024. A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges. In Proceedings of the IEEE/ACM 46th International Conference on Software Engineering (Lisbon, Portugal) (ICSE ’24). ACM, Article 52, 13 pages. https://doi.org/10.1145/3597503.3608128
[55]
Q. Vera Liao and Jennifer Wortman Vaughan. 2024. AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap. Harvard Data Science ReviewSpecial Issue 5 (feb 29 2024). https://hdsr.mitpress.mit.edu/pub/aelql9qy
[56]
Lauren Lin and Duri Long. 2023. Generative AI Futures: A Speculative Design Exploration. In Proceedings of the 15th Conference on Creativity and Cognition (Virtual Event, USA) (C&C ’23). ACM, 380–383. https://doi.org/10.1145/3591196.3596616
[57]
Nelson F. Liu, Tianyi Zhang, and Percy Liang. 2023. Evaluating Verifiability in Generative Search Engines. In Conference on Empirical Methods in Natural Language Processing(EMNLP ’23). https://doi.org/10.48550/arXiv.2304.09848
[58]
Duri Long and Brian Magerko. 2020. What is AI Literacy? Competencies and Design Considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). ACM, 1–16. https://doi.org/10.1145/3313831.3376727
[59]
Darren Lunn, Simon Harper, and Sean Bechhofer. 2011. Identifying Behavioral Strategies of Visually Impaired Users to Improve Access to Web Content. ACM ACM Transactions on Accessible Computing (TACCESS) 3, 4, Article 13 (April 2011), 35 pages. https://doi.org/10.1145/1952388.1952390
[60]
Avery Mack, Rida Qadri, Remi Denton, Shaun K Kane, and Cynthia L Bennett. 2024. “They only care to show us the wheelchair”: disability representation in text-to-image AI models. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). 21 pages. https://doi.org/10.1145/3613904.3642166
[61]
Haley MacLeod, Cynthia L. Bennett, Meredith Ringel Morris, and Edward Cutrell. 2017. Understanding Blind People’s Experiences with Computer-Generated Captions of Social Media Images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, 5988–5999. https://doi.org/10.1145/3025453.3025814
[62]
Kamil Malinka, Martin Peresíni, Anton Firc, Ondrej Hujnák, and Filip Janus. 2023. On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree?. In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 (Turku, Finland) (ITiCSE 2023). ACM, 47–53. https://doi.org/10.1145/3587102.3588827
[63]
Shahan Ali Memon and Jevin D. West. 2024. Search engines post-ChatGPT: How generative artificial intelligence could make search less reliable. Retrieved April 27, 2024 from https://www.cip.uw.edu/2024/02/18/search-engines-chatgpt-generative-artificial-intelligence-less-reliable/
[64]
Meta AI. 2023. Multimodal Generative AI Systems. Retreived 23 April, 2024 from https://ai.meta.com/tools/system-cards/multimodal-generative-ai-systems/.
[65]
Microsoft. 2024. Copilot. Retrieved 12 April, 2024 from https://copilot.microsoft.com/.
[66]
Omid Mohaddesi, Noah Chicoine, Min Gong, Ozlem Ergun, Jacqueline Griffin, David Kaeli, Stacy Marsella, and Casper Harteveld. 2023. Thought Bubbles: A Proxy into Players’ Mental Model Development. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 729, 21 pages. https://doi.org/10.1145/3544548.3581570
[67]
Lourdes M. Morales, Sonia M. Arteaga, Peter Cottrell, and Sri Kurniawan. 2014. Design Guidelines of Tools for Facilitating Blind People to Independently Format Their Documents. In Computers Helping People with Special Needs, Klaus Miesenberger, Deborah Fels, Dominique Archambault, Petr Peňáz, and Wolfgang Zagler (Eds.). Springer International Publishing, Cham, 634–641.
[68]
Cecily Morrison, Martin Grayson, Rita Faia Marques, Daniela Massiceti, Camilla Longden, Linda Wen, and Edward Cutrell. 2023. Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People who are Blind or Low Vision. In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA) (ASSETS ’23). ACM, Article 31, 12 pages. https://doi.org/10.1145/3597638.3608395
[69]
Fatemeh Mosaiyebzadeh, Seyedamin Pouriyeh, Reza Parizi, Nasrin Dehbozorgi, Mohsen Dorodchi, and Daniel Macêdo Batista. 2023. Exploring the Role of ChatGPT in Education: Applications and Challenges. In Proceedings of the 24th Annual Conference on Information Technology Education (Marietta, GA, USA) (SIGITE ’23). ACM, 84–89. https://doi.org/10.1145/3585059.3611445
[70]
Dan Myers and Brian P Blake. 2017. An Evaluation of the Conformed Dimensions of Data Quality in Application to an Existing Information Quality-Privacy-Trust Research Framework. (2017). https://ualr.edu/informationquality/files/2023/02/P26-ICIQ2017-Conformed-Dimenstions-of-DQ.pdf
[71]
Donald A. Norman. 2014. Some Observations on Mental Models. In Mental models. Psychology Press, 15–22.
[72]
National Federation of the Blind. 2024. Blindness Statistics. Retrieved 23 April, 2024 from https://nfb.org/resources/blindness-statistics.
[73]
OpenAI. 2024. ChatGPT. Retrieved 12 April, 2024 from https://openai.com/chatgpt.
[74]
Eng Lieh Ouh, Benjamin Kok Siew Gan, Kyong Jin Shim, and Swavek Wlodkowski. 2023. ChatGPT, Can You Generate Solutions for my Coding Exercises? An Evaluation on its Effectiveness in an Undergraduate Java Programming Course. (2023), 54–60. https://doi.org/10.1145/3587102.3588794
[75]
Konstantinos S. Papadopoulos, Evmorfia K. Arvaniti, Despina I. Dimitriadi, Vasiliki G. Gkoutsioudi, and Christina I. Zantali. 2009. Spelling performance of visually impaired adults. British Journal of Visual Impairment 27, 1 (2009), 49–64. https://doi.org/10.1177/0264619608097746
[76]
Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. “Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, 1–13. https://doi.org/10.1145/3173574.3174033
[77]
David Redmond. 2023. This Face Looks Redacted: The Be My Eyes Faces Controversy Explained. Retrieved 23 April, 2024 from https://vi.ie/this-face-looks-redacted-the-be-my-eyes-faces-controversy-explained/.
[78]
Matthew Rueben, Jeffrey Klow, Madelyn Duer, Eric Zimmerman, Jennifer Piacentini, Madison Browning, Frank J. Bernieri, Cindy M. Grimm, and William D. Smart. 2021. Mental Models of a Mobile Shoe Rack: Exploratory Findings from a Long-term In-the-Wild Study. ACM Transactions on Human-Robot Interaction (THRI) 10, 2, Article 16 (feb 2021), 36 pages. https://doi.org/10.1145/3442620
[79]
Heleen Rutjes, Martijn Willemsen, and Wijnand IJsselsteijn. 2019. Considerations on Explainable AI and Users’ Mental Models. In CHI 2019 Workshop: Where is the Human? Bridging the Gap Between AI and HCI. ACM, Inc. https://www.martijnwillemsen.nl/recommenderlab/RutjesChHI2019ws.pdf
[80]
Abir Saha and Anne Marie Piper. 2020. Understanding Audio Production Practices of People with Vision Impairments. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event) (ASSETS ’20). ACM, Article 36, 13 pages. https://doi.org/10.1145/3373625.3416993
[81]
Filipo Sharevski and Aziz N Zeidieh. 2023. “I Just Didn’t Notice It:” Experiences with Misinformation Warnings on Social Media amongst Users Who Are Low Vision or Blind. In Proceedings of the 2023 New Security Paradigms Workshop (Segovia, Spain) (NSPW ’23). ACM, 17–33. https://doi.org/10.1145/3633500.3633502
[82]
Renee Shelby, Shalaleh Rismani, Kathryn Henne, AJung Moon, Negar Rostamzadeh, Paul Nicholas, N’Mah Yilla-Akbari, Jess Gallegos, Andrew Smart, Emilio Garcia, and Gurleen Virk. 2023. Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (Montréal, QC, Canada) (AIES ’23). ACM, 723–741. https://doi.org/10.1145/3600211.3604673
[83]
Marita Skjuve, Asbjørn Følstad, and Petter Bae Brandtzaeg. 2023. The User Experience of ChatGPT: Findings from a Questionnaire Study of Early Users. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI ’23). ACM, Article 2, 10 pages. https://doi.org/10.1145/3571884.3597144
[84]
Yuan Sun, Eunchae Jang, Fenglong Ma, and Ting Wang. 2024. Generative AI in the Wild: Prospects, Challenges, and Strategies. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). ACM, Article 747, 16 pages. https://doi.org/10.1145/3613904.3642160
[85]
David Touretzky, Christina Gardner-McCune, and Deborah Seehorn. 2023. Machine Learning and the Five Big Ideas in AI. International Journal of Artificial Intelligence in Education 33 (2023), 233–266. https://doi.org/10.1007/s40593-022-00314-1
[86]
Stephanie Valencia, Richard Cave, Krystal Kallarackal, Katie Seaver, Michael Terry, and Shaun K. Kane. 2023. “The less I type, the better”: How AI-Language Models can Enhance or Impede Communication for AAC Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 830, 14 pages. https://doi.org/10.1145/3544548.3581560
[87]
Sheena Vasani. 2023. Be My Eyes AI offers GPT-4-powered support for blind Microsoft customers. Retrieved 23 April, 2024 from https://www.theverge.com/2023/11/15/23962709/microsoft-blind-users-open-ai-chatgpt-4-be-my-eyes.
[88]
Mathias Peter Verheijden and Mathias Funk. 2023. Collaborative Diffusion: Boosting Designerly Co-Creation with Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). ACM, Article 73, 8 pages. https://doi.org/10.1145/3544549.3585680
[89]
Markel Vigo and Simon Harper. 2013. Coping Tactics Employed by Visually Disabled Users on the Web. International Journal of Human-Computer Studies 71, 11 (November 2013), 1013–1025. https://doi.org/10.1016/j.ijhcs.2013.08.002
[90]
World Wide Web Consortium (W3C). 2024. WCAG 2 Overview. Retrieved 21 April, 2024 from https://www.w3.org/WAI/standards-guidelines/wcag/.
[91]
Jingran Wang, Yi Liu, Peigong Li, Zhenxing Lin, Stavros Sindakis, and Sakshi Aggarwal. 2023. Overview of Data Quality: Examining the Dimensions, Antecedents, and Impacts of Data Quality. Journal of the Knowledge Economy (2023), 1–20. https://doi.org/10.1007/s13132-022-01096-6
[92]
Ruotong Wang, Ruijia Cheng, Denae Ford, and Thomas Zimmermann. 2024. Investigating and Designing for Trust in AI-powered Code Generation Tools. In Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency (Rio de Janeiro, Brazil) (FAccT ’24). ACM, 1475–1493. https://doi.org/10.1145/3630106.3658984
[93]
Yunlong Wang, Shuyuan Shen, and Brian Y Lim. 2023. RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 22, 29 pages. https://doi.org/10.1145/3544548.3581402
[94]
Yuxia Wang, Minghan Wang, Muhammad Arslan Manzoor, Fei Liu, Georgi Georgiev, Rocktim Jyoti Das, and Preslav Nakov. 2024. Factuality of Large Language Models in the Year 2024. arXiv (2024). https://doi.org/10.48550/arXiv.2402.02420 arXiv:2402.02420
[95]
Laura Weidinger, Jonathan Uesato, Maribeth Rauh, Conor Griffin, Po-Sen Huang, John Mellor, Amelia Glaese, Myra Cheng, Borja Balle, Atoosa Kasirzadeh, Courtney Biles, Sasha Brown, Zac Kenton, Will Hawkins, Tom Stepleton, Abeba Birhane, Lisa Anne Hendricks, Laura Rimell, William Isaac, Julia Haas, Sean Legassick, Geoffrey Irving, and Iason Gabriel. 2022. Taxonomy of Risks posed by Language Models. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT ’22). ACM, 214–229. https://doi.org/10.1145/3531146.3533088
[96]
Meredith Whittaker, Meryl Alper, Cynthia L. Bennett, Sara Hendren, Elizabeth Kaziunas, Mara Mills, Meredith Ringel Morris, Joy Lisi Rankin, Emily Rogers, Marcel Salas, and Sarah Myers West. 2019. Disability, Bias & AI Report. Technical Report. AI Now Institute. https://ainowinstitute.org/publication/disabilitybiasai-2019
[97]
J.D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, and Qian Yang. 2023. Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 437, 21 pages. https://doi.org/10.1145/3544548.3581388
[98]
Zhiping Zhang, Michelle Jia, Hao-Ping (Hank) Lee, Bingsheng Yao, Sauvik Das, Ada Lerner, Dakuo Wang, and Tianshi Li. 2024. “It’s a Fair Game”, or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’24). ACM, Article 156, 26 pages. https://doi.org/10.1145/3613904.3642385
[99]
Yong Zheng. 2023. ChatGPT for Teaching and Learning: An Experience from Data Science Education. In Proceedings of the 24th Annual Conference on Information Technology Education (Marietta, GA, USA) (SIGITE ’23). ACM, 66–72. https://doi.org/10.1145/3585059.3611431
[100]
Jiawei Zhou, Yixuan Zhang, Qianni Luo, Andrea G Parker, and Munmun De Choudhury. 2023. Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human Solutions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). ACM, Article 436, 20 pages. https://doi.org/10.1145/3544548.3581318
Index Terms
- "I look at it as the king of knowledge": How Blind People Use and Understand Generative AI Tools
Recommendations
Blind Leading the Sighted: Drawing Design Insights from Blind Users towards More Productivity-oriented Voice Interfaces
Regular Papers and Special Issue on ASSETS 2018Voice-activated personal assistants (VAPAs) are becoming smaller, cheaper, and more accurate, such that they are now prevalent in homes (e.g., Amazon Echo, Sonos One) and on mobile devices (e.g., Google Assistant, Apple Siri) around the world. VAPAs ...
What Makes Videos Accessible to Blind and Visually Impaired People?
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsUser-generated videos are an increasingly important source of information online, yet most online videos are inaccessible to blind and visually impaired (BVI) people. To find videos that are accessible, or understandable without additional description ...
Understanding Curators' Practices and Challenge of Making Exhibitions More Accessible for People with Visual Impairments
ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and AccessibilityAssistive technologies are increasingly developed and applied in exhibition environments to help blind and low vision (BLV) people deal with the challenges they face when visiting exhibitions. While studies have examined the experiences of BLV people ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
1475 pages
ISBN:9798400706776
DOI:10.1145/3663548
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ASSETS '24
Sponsor:
ASSETS '24: The 26th International ACM SIGACCESS Conference on Computers and Accessibility
October 27 - 30, 2024
NL, St. John's, Canada
Acceptance Rates
Overall Acceptance Rate 436 of 1,556 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 213Total Downloads
- Downloads (Last 12 months)213
- Downloads (Last 6 weeks)157
Reflects downloads up to 14 Dec 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in