More Web Proxy on the site http://driver.im/

poster

Collecting and Reporting Race and Ethnicity Data in HCI

Authors:

Angela D. R. Smith,

Katharina Reinecke,

Alexandra ToAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 327, Pages 1 - 8

https://doi.org/10.1145/3491101.3519685

Published: 28 April 2022 Publication History

Abstract

Engaging racially and ethnically diverse participants in Human-Computer Interaction (HCI) research is critical for creating safe, inclusive, and equitable technology. However, it remains unclear why and how HCI researchers collect study participants’ race and ethnicity. Through a systematic literature analysis of 2016–2021 CHI proceedings and a survey with 15 authors who published in these proceedings, we found that reporting race and ethnicity of participants is uncommon and that HCI researchers are far from consensus on the collection and analysis of this data. Because a majority (>90%) of the articles that report participants’ race and ethnicity are conducted in the United States, we focused our discussion on race and ethnicity accordingly. In future work, we plan to investigate considerations and best practices for collecting and analyzing race and ethnicity data in a global context.

References

[1]

Julio Abascal and Colette Nicolle. 2005. Moving towards inclusive design guidelines for socially and ethically aware HCI. Interacting with Computers 17, 5 (Sept. 2005), 484–505.

Digital Library

[2]

American Psychological Association. 2019. Publication Manual of the American Psychological Association: 7th Edition, 2020 Copyright (7ed.). American Psychological Association.

[3]

American Sociological Association. 2017. The Importance of Collecting Data and Doing Social Science Research on Race. https://www.asanet.org/importance-collecting-data-and-doing-social-science-research-race. Accessed: 2021-8-5.

[4]

Margo Anderson and Stephen E Fienberg. 2000. Race and ethnicity and the controversy over the US Census. Current Sociology 48, 3 (2000), 87–110.

[5]

Jack M Bloom. 2019. Class, Race, and the Civil Rights Movement, Second Edition. Indiana University Press.

[6]

Center for Drug Evaluation and Research. 2019. Drug Trials Snapshots. Accessed: 2021-3-8.

[7]

Derrick L Cogburn. 2003. HCI in the so-called developing world: what’s in it for everyone. Interactions 10, 2 (March 2003), 80–87.

Digital Library

[8]

Patricia Hill Collins and Sirma Bilge. 2020. Intersectionality. John Wiley & Sons.

[9]

Nicholas David Bowman, Jihhsuan Tammy Lin, and Chieh Wu. 2021. A Chinese-Language Validation of the Video Game Demand Scale (VGDS-C): Measuring the Cognitive, Emotional, Physical, and Social Demands of Video Games. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–10.

Digital Library

[10]

Bryan Dosono and Bryan Semaan. 2019. Moderation Practices as Emotional Labor in Sustaining Online Communities: The Case of AAPI Identity Work on Reddit. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.

Digital Library

[11]

Susan M Dray, David A Siegel, and Paula Kotzé. 2003. Indra’s Net: HCI in the developing world. Interactions 10, 2 (March 2003), 28–37.

Digital Library

[12]

Tracy Frey and Roxanne K. Young. 2020. Race/Ethnicity. AMA Manual of Style. https://www.amamanualofstyle.com/view/10.1093/jama/9780190246556.001.0001/med-9780190246556-chapter-11-div2-23. Accessed: 2021-8-5.

[13]

Darren Gergle and Desney S Tan. 2014. Experimental Research in HCI. In Ways of Knowing in HCI, Judith S Olson and Wendy A Kellogg (Eds.). Springer New York, New York, NY, 191–227.

[14]

Maureen T Hallinan. 2001. Sociological Perspectives on Black-White Inequalities in American Schooling. Sociology of Education 74 (2001), 50–70.

[15]

Foad Hamidi, Lydia Stamato, Lisa Scheifele, Rian Ciela Visscher Hammond, and S Nisa Asgarali-Hoffman. 2021. “Turning the Invisible Visible”: Transdisciplinary Bioart Explorations in Human-DNA Interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.

Digital Library

[16]

Julia Himmelsbach, Stephanie Schwarz, Cornelia Gerdenitsch, Beatrix Wais-Zechmann, Jan Bobeth, and Manfred Tscheligi. 2019. Do We Care About Diversity in Human Computer Interaction: A Comprehensive Content Analysis on Diversity Dimensions in Research. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–16.

Digital Library

[17]

Ariel T Holland and Latha P Palaniappan. 2012. Problems with the collection and interpretation of Asian-American health data: omission, aggregation, and extrapolation. Annals of Epidemiology 22, 6 (June 2012), 397–405.

[18]

Institute of Medicine (US) Subcommittee on Standardized Collection of Race/Ethnicity Data for Healthcare Quality Improvement. 2014. Race, Ethnicity, and Language Data: Standardization for Health Care Quality Improvement. National Academies Press (US), Washington (DC).

[19]

C P Jones. 2001. Invited commentary: “race,” racism, and the practice of epidemiology. American Journal of Epidemiology 154, 4 (Aug. 2001), 299–304; discussion 305–6.

[20]

Camara Phyllis Jones, Benedict I Truman, Laurie D Elam-Evans, Camille A Jones, Clara Y Jones, Ruth Jiles, Susan F Rumisha, and Geraldine S Perry. 2008. Using “socially assigned race” to probe white advantages in health status. Ethnicity & Disease 18, 4 (2008), 496–504.

[21]

Bliss Kaneshiro, Olga Geling, Kapuaola Gellert, and Lynnae Millar. 2011. The challenges of collecting data on race and ethnicity in a diverse, multiethnic state. Hawaii medical journal 70, 8 (Aug. 2011), 168–171.

[22]

J S Kaufman and R S Cooper. 2001. Commentary: considerations for use of racial/ethnic classification in etiologic research. American Journal of Epidemiology 154, 4 (Aug. 2001), 291–298.

[23]

Masoud Mehrabi Koushki, Borke Obada-Obieh, Jun Ho Huh, and Konstantin Beznosov. 2021. On Smartphone Users’ Difficulty with Understanding Implicit Authentication. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–14.

Digital Library

[24]

Nancy Krieger, Jaquelyn L Jahn, and Pamela D Waterman. 2017. Jim Crow and estrogen-receptor-negative breast cancer: US-born black and white non-Hispanic women, 1992-2012. Cancer Causes & Control 28, 1 (Jan. 2017), 49–59.

[25]

Sharon M Lee. 1993. Racial classifications in the US census: 1890–1990. Ethnic and racial studies 16, 1 (Jan. 1993), 75–94.

[26]

Kevin E Levay, Jeremy Freese, and James N Druckman. 2016. The Demographic and Political Composition of Mechanical Turk Samples. SAGE Open 6, 1 (Jan. 2016).

[27]

Sarah Lopez, Yi Yang, Kevin Beltran, Soo Jung Kim, Jennifer Cruz Hernandez, Chelsy Simran, Bingkun Yang, and Beste F Yuksel. 2019. Investigating Implicit Gender Bias and Embodiment of White Males in Virtual Reality with Full Body Visuomotor Synchrony. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.

Digital Library

[28]

Neda Maghbouleh, Ariela Schachter, and René D Flores. 2022. Middle Eastern and North African Americans may not be perceived, nor perceive themselves, to be White. PNAS 119, 7 (Feb. 2022).

[29]

Patrick L Mason and Andrew Matella. 2014. Stigmatization and racial selection after September 11, 2001: self-identity among Arab and Islamic Americans. IZA Journal of Migration 3, 1 (Oct. 2014), 1–21.

[30]

National Institutes of Health. 2001. NOT-OD-01-053: NIH POLICY ON REPORTING RACE AND ETHNICITY DATA: SUBJECTS IN CLINICAL RESEARCH. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-01-053.html. Accessed: 2021-8-5.

[31]

National Science Foundation. 2017. Technical Notes. https://www.nsf.gov/statistics/2017/nsf17310/technical-notes.cfm. Accessed: 2021-8-5.

[32]

Anna Offenwanger, Alan John Milligan, Minsuk Chang, Julia Bullard, and Dongwook Yoon. 2021. Diagnosing Bias in the Gender Representation of HCI Research Participants: How it Happens and Where We Are. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21, Article 399). Association for Computing Machinery, New York, NY, USA, 1–18.

Digital Library

[33]

Ihudiya Finda Ogbonnaya-Ogburu, Angela D R Smith, Alexandra To, and Kentaro Toyama. 2020. Critical Race Theory for HCI. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–16.

Digital Library

[34]

Newton G Osborne and Marvin D Feit. 1992. The Use of Race in Medical Research. JAMA: the journal of the American Medical Association 267, 2 (Jan. 1992), 275–279.

[35]

Cale J Passmore, Max V Birk, and Regan L Mandryk. 2018. The Privilege of Immersion: Racial and Ethnic Experiences, Perceptions, and Beliefs in Digital Gaming. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–19.

Digital Library

[36]

Pew Research Center. 2015. Multiracial in America: Proud, Diverse and Growing in Numbers. https://www.pewsocialtrends.org/wp-content/uploads/sites/3/2015/06/2015-06-11_multiracial-in-america_final-updated.pdf. Accessed: 2021-6-25.

[37]

Race in HCI Collective, Angela D R Smith, Adriana Alvarado Garcia, Ian Arawjo, Audrey Bennett, Khalia Braswell, Bryan Dosono, Ron Eglash, Denae Ford, Daniel Gardner, Shamika Goddard, Jaye Nias, Cale Passmore, Yolanda Rankin, Naba Rizvi, Carol F Scott, Jakita Thomas, Alexandra To, Ihudiya Finda Ogbonnaya-Ogburu, and Marisol Wong-Villacres. 2021. Keepin’ it real about race in HCI. Interactions 28, 5 (Aug. 2021), 28–33.

[38]

Shan M Randhawa, Tallal Ahmad, Jay Chen, and Agha Ali Raza. 2021. Karamad: A Voice-based Crowdsourcing Platform for Underserved Populations. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.

Digital Library

[39]

Yolanda A Rankin and Jakita O Thomas. 2019. Straighten up and fly right: Rethinking intersectionality in HCI research. Interactions 26, 6 (2019), 64–68.

Digital Library

[40]

Helen Hatab Samhan. 2001. Who Are Arab Americans?

[41]

Morgan Klaus Scheuerman, Katta Spiel, Oliver L. Haimson, Foad Hamidi, and Stacy M. Branham. 2021. HCI Gender Guidelines. https://www.morgan-klaus.com/gender-guidelines.html. Accessed: 2021-8-6.

[42]

Ari Schlesinger, W Keith Edwards, and Rebecca E Grinter. 2017. Intersectional HCI: Engaging Identity through Gender, Race, and Class. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5412–5427.

Digital Library

[43]

Jonathan Schwabish and Alice Feng. 2020. Applying Racial Equity Awareness in Data Visualization. (Aug. 2020).

[44]

Angela D R Smith, Alex A Ahmed, Adriana Alvarado Garcia, Bryan Dosono, Ihudiya Ogbonnaya-Ogburu, Yolanda Rankin, Alexandra To, and Kentaro Toyama. 2020. What’s Race Got To Do With It? Engaging in Race in HCI. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8.

Digital Library

[45]

Katta Spiel, Oliver L Haimson, and Danielle Lottridge. 2019. How to do better with gender on surveys: a guide for HCI researchers. Interactions 26, 4 (June 2019), 62–65.

Digital Library

[46]

Simone Stumpf, Anicia Peters, Shaowen Bardzell, Margaret Burnett, Daniela Busse, Jessica Cauchard, and Elizabeth Churchill. 2020. Gender-Inclusive HCI Research and Design: A Conceptual Review. Now Foundations and Trends.

[47]

Christian Sturm, Alice Oh, Sebastian Linxen, Jose Abdelnour Nocera, Susan Dray, and Katharina Reinecke. 2015. How WEIRD is HCI? Extending HCI Principles to other Countries and Cultures. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 2425–2428.

Digital Library

[48]

Kentaro Toyama. 2010. Human–Computer Interaction and Global Development. Foundations and Trends® in Human–Computer Interaction 4, 1(2010), 1–79.

[49]

US Census Bureau. 2019. National Demographic Analysis Tables: 2020. Accessed: 2021-3-8.

[50]

Tavish Vaidya, Daniel Votipka, Michelle L Mazurek, and Micah Sherr. 2019. Does Being Verified Make You More Credible? Account Verification’s Effect on Tweet Credibility. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.

[51]

Judy van Biljon and Karen Renaud. 2019. Human-Computer Interaction for Development (HCI4D): The Southern African Landscape. In Information and Communication Technologies for Development. Strengthening Southern-Driven Cooperation as a Catalyst for ICT4D. Springer International Publishing, 253–266.

[52]

Kelly Walters, Dimitri A Christakis, and Davene R Wright. 2018. Are Mechanical Turk worker samples representative of health status and health behaviors in the U.S.?PloS one 13, 6 (June 2018), e0198835.

[53]

Kim M Williams. 2006. Mark One or More. University of Michigan Press.

Cited By

Kim SHo JLi YFan BYang WRamey JFox SZhu HZimmerman JEslami M(2024)Integrating Equity in Public Sector Data-Driven Decision Making: Exploring the Desired Futures of Underserved StakeholdersProceedings of the ACM on Human-Computer Interaction10.1145/36869058:CSCW2(1-39)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686905
Seaborn KKotani HPennefather P(2024)From “Made In” to Mukokuseki: Exploring the Visual Perception of National Identity in RobotsACM Transactions on Human-Robot Interaction10.1145/368178214:1(1-21)Online publication date: 28-Aug-2024
https://dl.acm.org/doi/10.1145/3681782
Taylor JBruckman A(2024)Mitigating Epistemic Injustice: The Online Construction of a Bisexual CultureACM Transactions on Computer-Human Interaction10.1145/364861431:4(1-34)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648614
Show More Cited By

Index Terms

Collecting and Reporting Race and Ethnicity Data in HCI
1. Human-centered computing

Index terms have been assigned to the content through auto-classification.

Recommendations

Why, when, and from whom: considerations for collecting and reporting race and ethnicity data in HCI
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Engaging diverse participants in HCI research is critical for creating safe, inclusive, and equitable technology. However, there is a lack of guidelines on when, why, and how HCI researchers collect study participants’ race and ethnicity. Our paper aims ...
What's Race Got To Do With It? Engaging in Race in HCI
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

There is an urgent and ongoing need to engage critically with race in human-computer interaction. In this workshop, we consider two intertwining aspects: first, how HCI research and practice should engage with race; second, how the HCI community itself ...
Intersectional HCI: Engaging Identity through Gender, Race, and Class
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Understanding users becomes increasingly complicated when we grapple with various overlapping attributes of an individual's identity. In this paper we introduce intersectionality as a framework for engaging with the complexity of users' "and authors" "...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
304
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)11

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim SHo JLi YFan BYang WRamey JFox SZhu HZimmerman JEslami M(2024)Integrating Equity in Public Sector Data-Driven Decision Making: Exploring the Desired Futures of Underserved StakeholdersProceedings of the ACM on Human-Computer Interaction10.1145/36869058:CSCW2(1-39)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686905
Seaborn KKotani HPennefather P(2024)From “Made In” to Mukokuseki: Exploring the Visual Perception of National Identity in RobotsACM Transactions on Human-Robot Interaction10.1145/368178214:1(1-21)Online publication date: 28-Aug-2024
https://dl.acm.org/doi/10.1145/3681782
Taylor JBruckman A(2024)Mitigating Epistemic Injustice: The Online Construction of a Bisexual CultureACM Transactions on Computer-Human Interaction10.1145/364861431:4(1-34)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648614
Nigatu HCanny JChasins S(2024)Low-Resourced Languages and Online Knowledge Repositories: A Need-Finding Study.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642605(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642605
Tu JWang DDurmanova ENacke L(2023)LEVI: Exploring Possibilities for an Adaptive Board Game SystemCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616096(181-186)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3573382.3616096
To ASmith AShowkat DAdjagbodjou AHarrington C(2023)Flourishing in the Everyday: Moving Beyond Damage-Centered Design in HCI for BIPOC CommunitiesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596057(917-933)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596057
Seaborn KNam SKeckeis JItagaki T(2023)Can Voice Assistants Sound Cute? Towards a Model of Kawaii VocalicsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585656(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585656

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents