More Web Proxy on the site http://driver.im/

research-article

“It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability

Authors:

Cynthia L. Bennett,

Morgan Klaus Scheuerman,

Jeffrey P. Bigham,

Alexandra ToAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 375, Pages 1 - 19

https://doi.org/10.1145/3411764.3445498

Published: 07 May 2021 Publication History

Abstract

Content creators are instructed to write textual descriptions of visual content to make it accessible; yet existing guidelines lack specifics on how to write about people’s appearance, particularly while remaining mindful of consequences of (mis)representation. In this paper, we report on interviews with screen reader users who were also Black, Indigenous, People of Color, Non-binary, and/or Transgender on their current image description practices and preferences, and experiences negotiating theirs and others’ appearances non-visually. We discuss these perspectives, and the ethics of humans and AI describing appearance characteristics that may convey the race, gender, and disabilities of those photographed. In turn, we share considerations for more carefully describing appearance, and contexts in which such information is perceived salient. Finally, we offer tensions and questions for accessibility research to equitably consider politics and ecosystems in which technologies will embed, such as potential risks of human and AI biases amplifying through image descriptions.

References

[1]

Algorithmic Justice League. 2020. Unmasking AI harms and biases. https://www.ajl.org/

[2]

Bobby Allyn. 2020. ‘The Computer Got It Wrong’: How Facial Recognition Led to False Arrest Of Black Man. https://www.npr.org/2020/06/24/882683463/the-computer-got-it-wrong-how-facial-recognition-led-to-a-false-arrest-in-michig

[3]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233

Digital Library

[4]

Subini Ancy Annamma, Darrell D Jackson, and Deb Morrison. 2017. Conceptualizing color-evasiveness: using dis/ability critical race theory to expand a color-blind racial ideology in education and society. Race Ethnicity and Education 20, 2 (2017), 147–162. https://doi.org/10.1080/13613324.2016.1248837

[5]

Apple Inc. 2020. How To Make Your Own Memoji. https://apps.apple.com/us/story/id1445637997

[6]

Mariam Asad. 2019. Prefigurative Design as a Method for Research Justice. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 200 (Nov. 2019), 18 pages. https://doi.org/10.1145/3359302

Digital Library

[7]

Stijn Baert. 2018. Facebook profile picture appearance affects recruiters’ first hiring decisions. New Media & Society 20, 3 (2018), 1220–1239. https://doi.org/10.1177/1461444816687294

[8]

Shaowen Bardzell. 2010. Feminist HCI: Taking Stock and Outlining an Agenda for Design. Association for Computing Machinery, New York, NY, USA, 1301–1310. https://doi.org/10.1145/1753326.1753521

Digital Library

[9]

Roy F Baumeister. 1982. A self-presentational view of social phenomena.Psychological Bulletin 91, 1 (1982), 3–26. https://doi.org/10.1037/0033-2909.91.1.3

[10]

Ruha Benjamin. 2019. Race After Technology: Abolitionist Tools for the New Jim Code. Social Forces 98, 4 (12 2019), 1–3. https://doi.org/10.1093/sf/soz162 arXiv:https://academic.oup.com/sf/article-pdf/98/4/1/33382045/soz162.pdf

[11]

Cynthia Bennett and Os Keyes. 2020. What is the Point of Fairness?Interactions 27, 3 (April 2020), 35–39. https://doi.org/10.1145/3386383

Digital Library

[12]

Cynthia L. Bennett, Jane E, Martez E. Mott, Edward Cutrell, and Meredith Ringel Morris. 2018. How Teens with Visual Impairments Take, Edit, and Share Photos on Social Media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173650

Digital Library

[13]

Berkeley Lab. 2020. Zoom Tip For Gender Pronouns (April 2020). https://diversity.lbl.gov/2020/04/14/zoom-tip-for-gender-pronouns/

[14]

Jeffrey P. Bigham, Ryan S. Kaminsky, Richard E. Ladner, Oscar M. Danielsson, and Gordon L. Hempton. 2006. WebInSight: Making Web Images Accessible. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Portland, Oregon, USA) (Assets ’06). Association for Computing Machinery, New York, NY, USA, 181–188. https://doi.org/10.1145/1168987.1169018

Digital Library

[15]

Stacy M. Branham, Ali Abdolrahmani, William Easley, Morgan Scheuerman, Erick Ronquillo, and Amy Hurst. 2017. “Is Someone There? Do They Have a Gun”: How Visual Information about Others Can Improve Personal Safety Management for Blind Individuals. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(Baltimore, Maryland, USA) (ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 260–269. https://doi.org/10.1145/3132525.3132534

Digital Library

[16]

André Brock. 2012. From the Blackhand Side: Twitter as a Cultural Conversation. Journal of Broadcasting & Electronic Media 56, 4 (2012), 529–549. https://doi.org/10.1080/08838151.2012.732147

[17]

Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, New York, NY, USA, 77–91. http://proceedings.mlr.press/v81/buolamwini18a.html

[18]

Matthew Carrasco and Andruid Kerne. 2018. Queer Visibility: Supporting LGBT+ Selective Visibility on Social Media. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173824

Digital Library

[19]

Jiang Chang, Hailong Ren, and Qiguang Yang. 2018. A virtual gender asylum? The social media profile picture, young Chinese women’s self-empowerment, and the emergence of a Chinese digital feminism. International Journal of Cultural Studies 21, 3 (2018), 325–340. https://doi.org/10.1177/1367877916682085

[20]

Kathy Charmaz. 2014. Constructing grounded theory.

[21]

Alex Chen. 2020. How to write an image description (July 2020). https://uxdesign.cc/how-to-write-an-image-description-2f30d3bf5546

[22]

Coalition for Critical Technology. 2020. Abolish the #TechToPrisonPipeline (June 2020). https://medium.com/@CoalitionForCriticalTechnology/abolish-the-techtoprisonpipeline-9b5b14366b16

[23]

Rachel Cohen-Rottenberg. 2015. We Need Your Help: Specifying Race and Gender in Image Descriptions (July 2015). https://thebodyisnotanapology.com/magazine/we-need-your-help-specifying-race-and-gender-in-image-descriptions/

[24]

Sasha Costanza-Chock. 2020. Design Justice: Community-Led Practices to Build the Worlds We Need. https://doi.org/10.7551/mitpress/12255.001.0001

[25]

Kimberle Crenshaw. 1989. Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory and Antiracist Policies. University of Chicago Legal Forum 1989, 1 (1989), 139–167. http://chicagounbound.uchicago.edu/uclf/vol1989/iss1/8/

[26]

Crip Camp Impact Campaign. 2020. Crip Camp: The Official Virtual Experience. https://cripcamp.com/officialvirtualexperience/

[27]

Data for Black Lives. 2020. Data for Black Lives. https://d4bl.org

[28]

Bryan Dosono and Bryan Semaan. 2018. Identity Work as Deliberation: AAPI Political Discourse in the 2016 US Presidential Election. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174207

Digital Library

[29]

Emory James Edwards, Cella Monet Sum, and Stacy M. Branham. 2020. Three Tensions Between Personas and Complex Disability Identities. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3334480.3382931

Digital Library

[30]

Nirmala Erevelles and Andrea Minear. 2010. Unspeakable Offenses: Untangling Race and Disability in Discourses of Intersectionality. Journal of Literary & Cultural Disability Studies (2010). https://doi.org/10.3828/jlcds.2010.11

[31]

Heather A. Faucett, Kate E. Ringland, Amanda L. L. Cullen, and Gillian R. Hayes. 2017. (In)Visibility in Disability and Assistive Technology. ACM Trans. Access. Comput. 10, 4, Article 14 (Oct. 2017), 17 pages. https://doi.org/10.1145/3132040

Digital Library

[32]

Glenn Fleishman. 2000. Cartoon Captures Spirit of the Internet. https://www.nytimes.com/2000/12/14/technology/cartoon-captures-spirit-of-the-internet.html

[33]

Asia Friedman. 2016. “There are Two People at Work That I’m Fairly Certain are Black”: Uncertainty and Deliberative Thinking in Blind Race Attribution. The Sociological Quarterly 57, 3 (2016), 437–461. https://doi.org/10.1111/tsq.12140

[34]

Future of Privacy Forum. 2018. Privacy Principles for Facial Recognition Technology in Commercial Applications. https://fpf.org/wp-content/uploads/2019/03/Final-Privacy-Principles-Edits-1.pdf

[35]

Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III au2, and Kate Crawford. 2020. Datasheets for Datasets. arxiv:1803.09010 [cs.DB]

[36]

Gender Spectrum. 2019. The Language of Gender. https://genderspectrum.org/articles/language-of-gender

[37]

Shona Ghosh. 2019. Google AI will no longer use gender labels like ‘woman’ or ‘man’ on images of people to avoid bias. https://www.businessinsider.com/google-cloud-vision-api-wont-tag-images-by-gender-2020-2

[38]

W. Gies, J. Overby, N. Saraceno, J. Frome, E. York, and A. Salman. 2020. Restricting Data Sharing and Collection of Facial Recognition Data by the Consent of the User: A Systems Analysis. In 2020 Systems and Information Engineering Design Symposium (SIEDS). 1–6. https://doi.org/10.1109/SIEDS49339.2020.9106661

[39]

Cole Gleason, Patrick Carrington, Cameron Cassidy, Meredith Ringel Morris, Kris M. Kitani, and Jeffrey P. Bigham. 2019. “It’s Almost like They’re Trying to Hide It”: How User-Provided Image Descriptions Have Failed to Make Twitter Accessible. In The World Wide Web Conference (San Francisco, CA, USA) (WWW ’19). Association for Computing Machinery, New York, NY, USA, 549–559. https://doi.org/10.1145/3308558.3313605

Digital Library

[40]

Cole Gleason, Amy Pavel, Emma McCamey, Christina Low, Patrick Carrington, Kris M. Kitani, and Jeffrey P. Bigham. 2020. Twitter A11y: A Browser Extension to Make Twitter Images Accessible. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376728

Digital Library

[41]

Neil Gotanda. 1991. A Critique of “Our Constitution Is Color-Blind”. Stanford Law Review 44, 1 (1991), 1–68. http://www.jstor.org/stable/1228940

[42]

Martin Grayson, Anja Thieme, Rita Marques, Daniela Massiceti, Ed Cutrell, and Cecily Morrison. 2020. A Dynamic AI System for Extending the Capabilities of Blind People. In CHI 2020 Extended Abstracts. ACM. https://www.microsoft.com/en-us/research/publication/a-dynamic-ai-system-for-extending-the-capabilities-of-blind-people/

Digital Library

[43]

Darren Guinness, Edward Cutrell, and Meredith Ringel Morris. 2018. Caption Crawler: Enabling Reusable Alternative Text Descriptions Using Reverse Image Search. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3174092

Digital Library

[44]

Anhong Guo, Ece Kamar, Jennifer Wortman Vaughan, Hanna Wallach, and Meredith Ringel Morris. 2020. Toward Fairness in AI for People with Disabilities: A Research Roadmap. SIGACCESS Access. Comput.125, Article 2 (March 2020), 1 pages. https://doi.org/10.1145/3386296.3386298

Digital Library

[45]

Jessica Guynn. 2020. You can now have your very own digital avatar on Facebook and Messenger. https://www.usatoday.com/story/tech/2020/05/13/facebook-messenger-avatars-bitmoji-snapchat-emoji/3118525001/

[46]

Anthony Ha. 2020. Microsoft’s Brad Smith says company will not sell facial recognition tech to police. https://techcrunch.com/2020/06/11/microsofts-brad-smith-says-company-will-not-sell-facial-recognition-tech-to-police/

[47]

Stephanie Hackett, Bambang Parmanto, and Xiaoming Zeng. 2003. Accessibility of Internet Websites through Time. In Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility (Atlanta, GA, USA) (Assets ’04). Association for Computing Machinery, New York, NY, USA, 32–39. https://doi.org/10.1145/1028630.1028638

Digital Library

[48]

Stephanie Hackett, Bambang Parmanto, and Xiaoming Zeng. 2005. A retrospective look at website accessibility over time. Behaviour & Information Technology 24, 6 (2005), 407–417. https://doi.org/10.1080/01449290500066661

[49]

Ever Lee Hairston, Denice Brown, Ron Brown, Bobbi Pompei, and Tarik Williams. 2020. Not Blind to Color in the Federation: A Panel on the Experience of Black and Blind in America. https://www.nfb.org/images/nfb/publications/bm/bm20/bm2008/bm200813.htm

[50]

Foad Hamidi, Morgan Klaus Scheuerman, and Stacy M. Branham. 2018. Gender Recognition or Gender Reductionism? The Social Implications of Embedded Gender Recognition Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173582

Digital Library

[51]

Alex Hanna, Emily Denton, Andrew Smart, and Jamila Smith-Loud. 2020. Towards a Critical Race Methodology in Algorithmic Fairness. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* ’20). Association for Computing Machinery, New York, NY, USA, 501–512. https://doi.org/10.1145/3351095.3372826

Digital Library

[52]

Taylor Hatmaker. 2020. Portland passes expansive city ban on facial recognition tech. https://techcrunch.com/2020/09/09/facial-recognition-ban-portland-oregon/

[53]

Anna Lauren Hoffmann. [n.d.]. Terms of inclusion: Data, discourse, violence. New Media & Society 0, 0 ([n. d.]), 1461444820958725. https://doi.org/10.1177/1461444820958725

[54]

Anna Lauren Hoffmann. 2019. Where fairness fails: data, algorithms, and the limits of antidiscrimination discourse. Information, Communication & Society 22, 7 (2019), 900–915. https://doi.org/10.1080/1369118X.2019.1573912

[55]

Megan Hofmann, Devva Kasnitz, Jennifer Mankoff, and Cynthia L Bennett. 2020. Living Disability Theory: Reflections on Access, Research, and Design. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, Greece) (ASSETS ’20). Association for Computing Machinery, New York, NY, USA, Article 4, 13 pages. https://doi.org/10.1145/3373625.3416996

Digital Library

[56]

Noelle J Hum, Perrin E Chamberlin, Brittany L Hambright, Anne C Portwood, Amanda C Schat, and Jennifer L Bevan. 2011. A picture is worth a thousand words: A content analysis of Facebook profile photographs. Computers in Human Behavior 27, 5 (2011), 1828–1833. https://doi.org/10.1016/j.chb.2011.04.003

Digital Library

[57]

Margaret Hunter. 2007. The Persistent Problem of Colorism: Skin Tone, Status, and Inequality. Sociology Compass 1, 1 (2007), 237–254. https://doi.org/10.1111/j.1751-9020.2007.00006.x

[58]

IBM. 2020. IBM CEO’s Letter to Congress on Racial Justice Reform. https://www.ibm.com/blogs/policy/facial-recognition-sunset-racial-justice-reforms/

[59]

IBM Research. 2020. 2018 Workshop on AI Fairness for People with Disabilities. https://researcher.watson.ibm.com/researcher/view_group.php?id=9642

[60]

James M Jones. 1997. Prejudice and racism. McGraw-Hill Companies, New York.

[61]

Alison Kafer. 2013. Feminist, Queer, Crip. Indiana University Press. http://www.jstor.org/stable/j.ctt16gz79x

[62]

Sanja Kapidzic and Susan C Herring. 2015. Race, gender, and self-presentation in teen profile photographs. New Media & Society 17, 6 (2015), 958–976. https://doi.org/10.1177/1461444813520301

[63]

Ellyn Kaschak. 2015. Sight Unseen. Columbia University Press. https://doi.org/10.7312/kasc17290

[64]

Os Keyes. 2018. The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 88 (Nov. 2018), 22 pages. https://doi.org/10.1145/3274357

Digital Library

[65]

Sooyeon Lee, Madison Reddie, Chun-Hua Tsai, Jordan Beck, Mary Beth Rosson, and John M. Carroll. 2020. The Emerging Professional Practice of Remote Sighted Assistance for People with Visual Impairments. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376591

Digital Library

[66]

Talila A. Lewis. 2020. Ableism 2020: An Updated Definition. https://www.talilalewis.com/blog/ableism-2020-an-updated-definition

[67]

Veronica Lewis. 2020. How to write alt text and image descriptions for photojournalism images. https://veroniiiica.com/2020/05/31/how-to-write-alt-text-and-image-descriptions-for-photojournalism-images/

[68]

Haley MacLeod, Cynthia L. Bennett, Meredith Ringel Morris, and Edward Cutrell. 2017. Understanding Blind People’s Experiences with Computer-Generated Captions of Social Media Images. Association for Computing Machinery, New York, NY, USA, 5988–5999. https://doi.org/10.1145/3025453.3025814

Digital Library

[69]

Christine Malec and JJ Hunt. 2020. Talk Description to Me. https://talkdescriptiontome.buzzsprout.com/

[70]

Microsoft Research. 2017. Seeing AI app – Scene Channel. https://youtu.be/4krZgdX_WT8

[71]

Ryan A Miller. 2017. “My voice is definitely strongest in online communities”: Students using social media for queer and disability identity-making., 509–525 pages. https://doi.org/10.1353/csd.2017.0040

[72]

Meredith Ringel Morris. 2020. AI and Accessibility. Commun. ACM 63, 6 (May 2020), 35–37. https://doi.org/10.1145/3356727

Digital Library

[73]

Meredith Ringel Morris, Jazette Johnson, Cynthia L. Bennett, and Edward Cutrell. 2018. Rich Representations of Visual Content for Screen Reader Users. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3173574.3173633

Digital Library

[74]

Meredith Ringel Morris, Annuska Zolyomi, Catherine Yao, Sina Bahram, Jeffrey P. Bigham, and Shaun K. Kane. 2016. “With Most of It Being Pictures Now, I Rarely Use It”: Understanding Twitter’s Evolving Accessibility to Blind Users. Association for Computing Machinery, New York, NY, USA, 5506–5516. https://doi.org/10.1145/2858036.2858116

Digital Library

[75]

Paul Mozur. 2019. One Month, 500,000 Face Scans: How China Is Using A.I. to Profile a Minority. https://www.nytimes.com/2019/04/14/technology/china-surveillance-artificial-intelligence-racial-profiling.html

[76]

Katie Murphy. 2018. An Audio Describer Responds to “On Black Panther Audio Description — Race, Selection & Time”. https://disarts.org/an-audio-describer-responds-to-on-black-panther-audio-description-race-selection-time/

[77]

Karen Nakamura. 2019. My Algorithms Have Determined You’re Not Human: AI-ML, Reverse Turing-Tests, and the Disability Experience. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS ’19). Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/3308561.3353812

Digital Library

[78]

National Center on Disability and Journalism. 2020. Disability Language Style Guide. https://ncdj.org/style-guide/

[79]

Netflix. 2020. Black Lives Matter recommendations. https://www.netflix.com/browse/genre/81299227

[80]

Safiya Umoja Noble. 2018. Algorithms of oppression: How search engines reinforce racism., xv, 229–xv, 229 pages.

[81]

Osagie Obasogie. 2010. Do Blind People See Race? Social, Legal, and Theoretical Considerations. Law & society review 44 (09 2010), 585–616. https://doi.org/10.1111/j.1540-5893.2010.00417.x

[82]

Ihudiya Finda Ogbonnaya-Ogburu, Angela D.R. Smith, Alexandra To, and Kentaro Toyama. 2020. Critical Race Theory for HCI. Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3313831.3376392

Digital Library

[83]

Katrina M Overby. 2019. Doin’It for the Culture: Defining Blackness, Culture, and Identity on Black Twitter. (2019).

[84]

Helen Petrie, Chandra Harrison, and Sundeep Dev. 2005. Describing images on the web: a survey of current practice and prospects for the future. Proceedings of Human Computer Interaction International (HCII) 71 (2005), 2.

[85]

John R. Porter, Kiley Sobel, Sarah E. Fox, Cynthia L. Bennett, and Julie A. Kientz. 2017. Filtered Out: Disability Disclosure Practices in Online Dating Communities. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 87 (Dec. 2017), 13 pages. https://doi.org/10.1145/3134722

Digital Library

[86]

Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K. Kane. 2016. The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use. Association for Computing Machinery, New York, NY, USA, 4884–4895. https://doi.org/10.1145/2858036.2858130

Digital Library

[87]

Protest Access. 2020. ProtestAccess - Twitter. https://twitter.com/protestaccess

[88]

Yolanda A. Rankin and Jakita O. Thomas. 2019. Straighten up and Fly Right: Rethinking Intersectionality in HCI Research. Interactions 26, 6 (Oct. 2019), 64–68. https://doi.org/10.1145/3363033

Digital Library

[89]

Thomas Reid. 2018. Reid My Mind Radio: On Black Panther Audio Description – Race, Selection & Time. http://reidmymind.com/reid-my-mind-radio-on-black-panther-audio-description-race-selection-time/

[90]

Sander De Ridder and Sofie Van Bauwel. 2013. Commenting on pictures: Teens negotiating gender and sexualities on social networking sites. Sexualities 16, 5-6 (2013), 565–586. https://doi.org/10.1177/1363460713487369

[91]

Kathryn E. Ringland, Christine T. Wolf, LouAnne E. Boyd, Mark S. Baldwin, and Gillian R. Hayes. 2016. Would You Be Mine: Appropriating Minecraft as an Assistive Technology for Youth with Autism. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (Reno, Nevada, USA) (ASSETS ’16). Association for Computing Machinery, New York, NY, USA, 33–41. https://doi.org/10.1145/2982142.2982172

Digital Library

[92]

Wendy D Roth. 2016. The multiple dimensions of race. Ethnic and Racial Studies 39, 8 (2016), 1310–1338.

[93]

Elliot Salisbury, Ece Kamar, and Meredith Morris. 2017. Toward scalable social alt text: Conversational crowdsourcing as a tool for refining vision-to-language technology for the blind. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 5.

[94]

Sigal Samuel. 2019. Some AI just shouldn’t exist. https://www.vox.com/future-perfect/2019/4/19/18412674/ai-bias-facial-recognition-black-gay-transgender

[95]

Morgan Klaus Scheuerman, Jacob M. Paul, and Jed R. Brubaker. 2019. How Computers See Gender: An Evaluation of Gender Classification in Commercial Facial Analysis Services. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 144 (Nov. 2019), 33 pages. https://doi.org/10.1145/3359246

Digital Library

[96]

Morgan Klaus Scheuerman, Katta Spiel, Oliver L. Haimson, Foad Hamidi, and Stacy M. Branham. 2020. HCI Guidelines for Gender Equity and Inclusivity. https://www.morgan-klaus.com/gender-guidelines.html

[97]

Morgan Klaus Scheuerman, Kandrea Wade, Caitlin Lustig, and Jed R. Brubaker. 2020. How We’ve Taught Algorithms to See Identity: Constructing Race and Gender in Image Databases for Facial Analysis. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 058 (May 2020), 35 pages. https://doi.org/10.1145/3392866

Digital Library

[98]

Ari Schlesinger, W. Keith Edwards, and Rebecca E. Grinter. 2017. Intersectional HCI: Engaging Identity through Gender, Race, and Class. Association for Computing Machinery, New York, NY, USA, 5412–5427. https://doi.org/10.1145/3025453.3025766

Digital Library

[99]

Ari Schlesinger, Kenton P. O’Hara, and Alex S. Taylor. 2018. Let’s Talk About Race: Identity, Chatbots, and AI. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173889

Digital Library

[100]

Cristina Segalin, Fabio Celli, Luca Polonio, Michal Kosinski, David Stillwell, Nicu Sebe, Marco Cristani, and Bruno Lepri. 2017. What Your Facebook Profile Picture Reveals about Your Personality. In Proceedings of the 25th ACM International Conference on Multimedia (Mountain View, California, USA) (MM ’17). Association for Computing Machinery, New York, NY, USA, 460–468. https://doi.org/10.1145/3123266.3123331

Digital Library

[101]

Sins Invalid. 2020. An Unshamed Claim to Beauty in the Face of Invisibility.https://www.sinsinvalid.org/

[102]

Olivia Solon. 2020. Facial recognition’s ‘dirty little secret’: Millions of online photos scraped without consent. https://www.nbcnews.com/tech/internet/facial-recognition-s-dirty-little-secret-millions-online-photos-scraped-n981921

[103]

Katta Spiel, Os Keyes, Ashley Marie Walker, Michael A. DeVito, Jeremy Birnholtz, Emeline Brulé, Ann Light, Pınar Barlas, Jean Hardy, Alex Ahmed, Jennifer A. Rode, Jed R. Brubaker, and Gopinaath Kannabiran. 2019. Queer(Ing) HCI: Moving Forward in Theory and Practice. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3290607.3311750

Digital Library

[104]

Abigale Stangl, Meredith Ringel Morris, and Danna Gurari. 2020. “Person, Shoes, Tree. Is the Person Naked?” What People with Vision Impairments Want in Image Descriptions. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376404

Digital Library

[105]

Abigale J. Stangl, Esha Kothari, Suyog D. Jain, Tom Yeh, Kristen Grauman, and Danna Gurari. 2018. BrowseWithMe: An Online Clothes Shopping Assistant for People with Visual Impairments. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 107–118. https://doi.org/10.1145/3234695.3236337

Digital Library

[106]

Lee Stearns and Anja Thieme. 2018. Automated Person Detection in Dynamic Scenes to Assist People with Vision Impairments: An Initial Investigation. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 391–394. https://doi.org/10.1145/3234695.3241017

Digital Library

[107]

Anselm Strauss and Juliet Corbin. 1998. Basics of qualitative research techniques. Sage publications Thousand Oaks, CA.

[108]

Derald Wing Sue. 2010. Microaggressions in everyday life: Race, gender, and sexual orientation. John Wiley & Sons.

[109]

The Amazon blog. 2020. We are implementing a one-year moratorium on police use of Rekognition. https://blog.aboutamazon.com/policy/we-are-implementing-a-one-year-moratorium-on-police-use-of-rekognition

[110]

Matt Thompson. 2013. Five Reasons Why People Code-Switch. https://www.npr.org/sections/codeswitch/2013/04/13/177126294/five-reasons-why-people-code-switch

[111]

Jutta Treviranus. 2020. We Count: Fair Treatment, Disability and Machine Learning - by Jutta Treviranus (OCAD University). https://www.w3.org/2020/06/machine-learning-workshop/talks/we_count_fair_treatment_disability_and_machine_learning.html

[112]

Shari Trewin. 2018. AI fairness for people with disabilities: Point of view. (2018). arxiv:1811.10670

[113]

Shari Trewin, Meredith Ringel Morris, Shiri Azenkot, Stacy Branham, Nicole Bleuel, Phill Jenkins, Jeffrey P. Bigham, and Walter S. Lasecki. 2019. Workshop: AI Fairness for People with Disabilities. https://assets19.sigaccess.org/ai_fairness_workshop.html

[114]

James Vincent. 2018. Amazon reportedly scraps internal AI recruiting tool that was biased against women. https://www.theverge.com/2018/10/10/17958784/ai-recruiting-tool-bias-amazon-report

[115]

Violeta Voykinska, Shiri Azenkot, Shaomei Wu, and Gilly Leshed. 2016. How Blind People Interact with Visual Content on Social Networking Services. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (San Francisco, California, USA) (CSCW ’16). Association for Computing Machinery, New York, NY, USA, 1584–1595. https://doi.org/10.1145/2818048.2820013

Digital Library

[116]

W3C. 2018. Web Content Accessibility Guidelines (WCAG) 2.1. https://www.w3.org/TR/WCAG21/

[117]

W3C. 2019. Informative Images • Images • WAI Web Accessibility Tutorials. https://www.w3.org/WAI/tutorials/images/informative/

[118]

Sarah Myers West, Meredith Whittaker, and Kate Crawford. 2019. DISCRIMINATING SYSTEMS: Gender, Race, and Power in AI. https://ainowinstitute.org/discriminatingsystems.html

[119]

Meredith Whittaker, Meryl Alper, Cynthia L Bennett, Sara Hendren, Liz Kaziunas, Mara Mills, Meredith Ringel Morris, Joy Rankin, Emily Rogers, Marcel Salas, 2019. Disability, Bias, and AI. AI Now Institute, November(2019).

[120]

Rua M. Williams and Juan E. Gilbert. 2019. Cyborg Perspectives on Computing Research Reform. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3290607.3310421

Digital Library

[121]

Writing with Color. 2021. Writing with Color. https://writingwithcolor.tumblr.com/

[122]

Shaomei Wu and Lada A. Adamic. 2014. Visually Impaired Users on an Online Social Network. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3133–3142. https://doi.org/10.1145/2556288.2557415

Digital Library

[123]

Shaomei Wu, Jeffrey Wieland, Omid Farivar, and Julie Schiller. 2017. Automatic Alt-Text: Computer-Generated Image Descriptions for Blind Users on a Social Network Service. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW ’17). Association for Computing Machinery, New York, NY, USA, 1180–1192. https://doi.org/10.1145/2998181.2998364

Digital Library

[124]

Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2017. The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 121 (Dec. 2017), 22 pages. https://doi.org/10.1145/3134756

Digital Library

[125]

Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2018. A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3173789

Digital Library

[126]

Wenzhi Zheng, Chih-Hung Yuan, Wei-Hung Chang, and Yen-Chun Jim Wu. 2016. Profile pictures on social media: Gender and regional differences. Computers in Human Behavior 63 (2016), 891–898.

Digital Library

Cited By

Xie IChoi WWang SLee HHong BWang NCudjoe E(2024)Help-Seeking Situations Related to Visual Interactions on Mobile Platforms and Recommended Designs for Blind and Visually Impaired UsersJournal of Imaging10.3390/jimaging1008020510:8(205)Online publication date: 22-Aug-2024
https://doi.org/10.3390/jimaging10080205
Haider AAbu Tair SObeidat MSaed HSahari Y(2024)Shaping the visually impaired perception of gender through Netflix audio description of movies and seriesLebende Sprachen10.1515/les-2023-003469:2(317-345)Online publication date: 26-Sep-2024
https://doi.org/10.1515/les-2023-0034
Lyu YCai JDosono BYadav DCarroll J(2024)"I Upload... All Types of Different Things to Say the World of Blindness Is More Than What They Think It Is": A Study of Blind TikTokers' Identity Work from a Flourishing PerspectiveProceedings of the ACM on Human-Computer Interaction10.1145/36870138:CSCW2(1-24)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687013
Show More Cited By

Index Terms

“It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability

Index terms have been assigned to the content through auto-classification.

Recommendations

Working at the Intersection of Race, Disability and Accessibility
ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

Examinations of intersectionality and identity dimensions in accessibility research have primarily considered disability separately from a person’s race and ethnicity. Accessibility work often does not include considerations of race as a construct, or ...
What Makes Videos Accessible to Blind and Visually Impaired People?
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

User-generated videos are an increasingly important source of information online, yet most online videos are inaccessible to blind and visually impaired (BVI) people. To find videos that are accessible, or understandable without additional description ...
Challenges and opportunities to improve the accessibility of YouTube for people with visual impairments as content creators
Abstract
This position paper proposes technology opportunities for supporting people with visual impairments (PVI) as content creators, rather than just content consumers. While previous studies examined accessibility issues with functions and visual ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

60
Total Citations
View Citations
2,024
Total Downloads

Downloads (Last 12 months)646
Downloads (Last 6 weeks)71

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xie IChoi WWang SLee HHong BWang NCudjoe E(2024)Help-Seeking Situations Related to Visual Interactions on Mobile Platforms and Recommended Designs for Blind and Visually Impaired UsersJournal of Imaging10.3390/jimaging1008020510:8(205)Online publication date: 22-Aug-2024
https://doi.org/10.3390/jimaging10080205
Haider AAbu Tair SObeidat MSaed HSahari Y(2024)Shaping the visually impaired perception of gender through Netflix audio description of movies and seriesLebende Sprachen10.1515/les-2023-003469:2(317-345)Online publication date: 26-Sep-2024
https://doi.org/10.1515/les-2023-0034
Lyu YCai JDosono BYadav DCarroll J(2024)"I Upload... All Types of Different Things to Say the World of Blindness Is More Than What They Think It Is": A Study of Blind TikTokers' Identity Work from a Flourishing PerspectiveProceedings of the ACM on Human-Computer Interaction10.1145/36870138:CSCW2(1-24)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687013
Niu SLiu LBian Y(2024)Please Understand My Disability: An Analysis of YouTubers' Discourse on Disability ChallengesProceedings of the ACM on Human-Computer Interaction10.1145/36869468:CSCW2(1-25)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686946
Akter TSwaminathan MKapadia A(2024)Toward Effective Communication of AI-Based Decisions in Assistive Tools: Conveying Confidence and Doubt to People with Visual Impairments at Accelerated SpeechProceedings of the 21st International Web for All Conference10.1145/3677846.3677862(177-189)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3677846.3677862
Dang KLee S(2024)Musical Performances in Virtual Reality with Spatial and View-Dependent Audio Descriptions for Blind and Low-Vision UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3688492(1-5)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3688492
Alharbi RLor PHerskovitz JSchoenebeck SBrewer R(2024)Misfitting With AI: How Blind People Verify and Contest AI ErrorsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675659(1-17)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675659
Figueira ICha YBranham S(2024)Intersecting Liminality: Acquiring a Smartphone as a Blind or Low Vision Older AdultProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675622(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675622
Dang KBurke GKorreshi HLee S(2024)Towards Accessible Musical Performances in Virtual Reality: Designing a Conceptual Framework for Omnidirectional Audio DescriptionsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675618(1-17)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675618
Mo WSingh AHolloway C(2024)From Information Seeking to Empowerment: Using Large Language Model Chatbot in Supporting Wheelchair Life in Low Resource SettingsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675609(1-18)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675609
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents