More Web Proxy on the site http://driver.im/

research-article

“Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment

Authors:

Feng TianAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 697, Pages 1 - 18

https://doi.org/10.1145/3411764.3445432

Published: 07 May 2021 Publication History

Abstract

Artificial intelligence (AI) technology has been increasingly used in the implementation of advanced Clinical Decision Support Systems (CDSS). Research demonstrated the potential usefulness of AI-powered CDSS (AI-CDSS) in clinical decision making scenarios. However, post-adoption user perception and experience remain understudied, especially in developing countries. Through observations and interviews with 22 clinicians from 6 rural clinics in China, this paper reports the various tensions between the design of an AI-CDSS system (“Brilliant Doctor”) and the rural clinical context, such as the misalignment with local context and workflow, the technical limitations and usability barriers, as well as issues related to transparency and trustworthiness of AI-CDSS. Despite these tensions, all participants expressed positive attitudes toward the future of AI-CDSS, especially acting as “a doctor’s AI assistant” to realize a Human-AI Collaboration future in clinical settings. Finally we draw on our findings to discuss implications for designing AI-CDSS interventions for rural clinical contexts in developing countries.

References

[1]

2018. Chinese Healthcare: The Rural Reality. https://www.coresponsibility.com/chinese-healthcare-the-rural-reality/

[2]

Dana L Alden, John Friend, Marilyn Schapira, and Anne Stiggelbout. 2014. Cultural targeting and tailoring of shared decision making technology: a theoretical framework for improving the effectiveness of patient decision aids in culturally diverse groups. Social Science & Medicine 105 (2014), 1–8.

[3]

Joan S Ash, Dean F Sittig, Kenneth P Guappone, Richard H Dykstra, Joshua Richardson, Adam Wright, James Carpenter, Carmit McMullen, Michael Shapiro, Arwen Bunce, 2012. Recommended practices for computerized clinical decision support and knowledge management in community settings: a qualitative study. BMC medical informatics and decision making 12, 1 (2012), 6.

[4]

G Octo Barnett, James J Cimino, Jon A Hupp, and Edward P Hoffer. 1987. DXplain: an evolving diagnostic decision-support system. Jama 258, 1 (1987), 67–74.

[5]

Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Paisan Ruamviboonsuk, and Laura M Vardoulakis. 2020. A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[6]

Eta S Berner. 2009. Clinical decision support systems: state of the art. AHRQ publication 90069(2009), 1–26.

[7]

Eta S Berner, George D Webster, Alwyn A Shugerman, James R Jackson, James Algina, Alfred L Baker, Eugene V Ball, C Glenn Cobbs, Vincent W Dennis, Eugene P Frenkel, 1994. Performance of four computer-based diagnostic systems. New England Journal of Medicine 330, 25 (1994), 1792–1796.

[8]

Suzanne V Blackley, Jessica Huynh, Liqin Wang, Zfania Korach, and Li Zhou. 2019. Speech recognition for clinical documentation from 1990 to 2018: a systematic review. Journal of the American Medical Informatics Association 26, 4(2019), 324–338.

[9]

Santiago Romero Brufau, Kirk D Wyatt, Patricia Boyum, Mindy Mickelson, Matthew Moore, and Cheristi Cognetta-Rieke. 2019. A lesson in implementation: a pre-post study of providers’ experience with artificial intelligence-based clinical decision support. International Journal of Medical Informatics (2019), 104072.

[10]

Carrie J Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S Corrado, Martin C Stumpe, 2019. Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 4.

Digital Library

[11]

Yunan Chen, Karen Cheng, Charlotte Tang, Katie A Siek, and Jakob E Bardram. 2013. Is my doctor listening to me?: impact of health it systems on patient-provider interaction. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, 2419–2426.

[12]

Hao-Fei Cheng, Ruotong Wang, Zheng Zhang, Fiona O’Connell, Terrance Gray, F Maxwell Harper, and Haiyi Zhu. 2019. Explaining decision-making algorithms through UI: Strategies to help non-expert stakeholders. In Proceedings of the 2019 chi conference on human factors in computing systems. 1–12.

Digital Library

[13]

Enrico Coiera. 2015. Guide to health informatics. CRC press.

[14]

David Coyle and Gavin Doherty. 2009. Clinical evaluations and collaborative design: developing new technologies for mental healthcare interventions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2051–2060.

Digital Library

[15]

Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. 2017. Calendar. help: Designing a workflow-based scheduling agent with humans in the loop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2382–2393.

Digital Library

[16]

Alessandra Curioni-Fontecedro. 2017. A new era of oncology through artificial intelligence.

[17]

Xianghua Ding, Yanqi Jiang, Xiankang Qin, Yunan Chen, Wenqiang Zhang, and Lizhe Qi. 2019. Reading Face, Reading Health: Exploring Face Reading Technologies for Everyday Health. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 205.

Digital Library

[18]

Jaimie Drozdal, Justin Weisz, Dakuo Wang, Gaurav Dass, Bingsheng Yao, Changruo Zhao, Michael Muller, Lin Ju, and Hui Su. 2020. Trust in AutoML: exploring information needs for establishing trust in automated machine learning systems. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 297–307.

Digital Library

[19]

Bradley J Erickson, Panagiotis Korfiatis, Zeynettin Akkus, and Timothy L Kline. 2017. Machine learning for medical imaging. Radiographics 37, 2 (2017), 505–515.

[20]

Andre Esteva, Brett Kuprel, Roberto A Novoa, Justin Ko, Susan M Swetter, Helen M Blau, and Sebastian Thrun. 2017. Dermatologist-level classification of skin cancer with deep neural networks. nature 542, 7639 (2017), 115–118.

[21]

Jerry Alan Fails and Dan R Olsen Jr. 2003. Interactive machine learning. In Proceedings of the 8th international conference on Intelligent user interfaces. ACM, 39–45.

Digital Library

[22]

Xiangmin Fan, Daren Chao, Zhan Zhang, Dakuo Wang, Xiaohua Li, and Feng Tian. 2020. Utilization of Self-Diagnosis Health Chatbots in Real-World Settings: Case Study. Journal of Medical Internet Research 22 (2020).

[23]

Hamish Fraser, Paul Biondich, Deshen Moodley, Sharon Choi, Burke Mamlin, and Peter Szolovits. 2005. Implementing electronic medical record systems in developing countries. Journal of Innovation in Health Informatics 13, 2 (2005), 83–95.

[24]

Mark W Friedberg, Peggy G Chen, Kristin R Van Busum, Frances Aunon, Chau Pham, John Caloyeras, Soeren Mattke, Emma Pitchforth, Denise D Quigley, Robert H Brook, 2014. Factors affecting physician professional satisfaction and their implications for patient care, health systems, and health policy. Rand health quarterly 3, 4 (2014).

[25]

Bo Gong, James P Nugent, William Guest, William Parker, Paul J Chang, Faisal Khosa, and Savvas Nicolaou. 2019. Influence of Artificial Intelligence on Canadian Medical Students’ Preference for Radiology Specialty: ANational Survey Study. Academic radiology 26, 4 (2019), 566–577.

[26]

Bryce Goodman and Seth Flaxman. 2017. European Union regulations on algorithmic decision-making and a “right to explanation”. AI magazine 38, 3 (2017), 50–57.

Digital Library

[27]

Lars Kai Hansen and Peter Salamon. 1990. Neural network ensembles. IEEE Transactions on Pattern Analysis & Machine Intelligence10 (1990), 993–1001.

Digital Library

[28]

Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 159–166.

Digital Library

[29]

Chun-Ju Hsiao and Esther Hing. 2012. Use and characteristics of electronic health record systems among office-based physician practices, United States, 2001-2012. Number 111. US Department of Health and Human Services, Centers for Disease Control and ….

[30]

MIT Technology Review Insights. 2019. AI in health care: Capacity, capability, and a future of active health in Asia.https://mit-insights.ai/ai-in-health-care/.

[31]

Richard Jacques, Asbjørn Følstad, Elizabeth Gerber, Jonathan Grudin, Ewa Luger, Andrés Monroy-Hernández, and Dakuo Wang. 2019. Conversational Agents: Acting on the Wave of Research and Development. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, W34.

Digital Library

[32]

Fei Jiang, Yong Jiang, Hui Zhi, Yi Dong, Hao Li, Sufeng Ma, Yilong Wang, Qiang Dong, Haipeng Shen, and Yongjun Wang. 2017. Artificial intelligence in healthcare: past, present and future. Stroke and vascular neurology 2, 4 (2017), 230–243.

[33]

Timothy J Judson, Anobel Y Odisho, Aaron B Neinstein, Jessica Chao, Aimee Williams, Christopher Miller, Tim Moriarty, Nathaniel Gleason, Gina Intinarelli, and Ralph Gonzales. 2020. Rapid design and implementation of an integrated patient self-triage and self-scheduling tool for COVID-19. Journal of the American Medical Informatics Association 27, 6(2020), 860–866.

[34]

C Jung, R Padman, G Shevchik, and S Paone. 2011. Who are portal users vs. early e-Visit adopters? A preliminary analysis. In AMIA Annual Symposium Proceedings, Vol. 2011. American Medical Informatics Association, 1070.

[35]

Naveena Karusala, Ding Wang, and Jacki O’Neill. 2020. Making Chat at Home in the Hospital: Exploring Chat Use by Nurses. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[36]

Jennifer King, Michael F Furukawa, and Melinda B Buntin. 2013. Geographic variation in ambulatory electronic health record adoption: implications for underserved communities. Health services research 48, 6pt1 (2013), 2037–2059.

[37]

Guilan Kong, Dong-Ling Xu, and Jian-Bo Yang. 2008. Clinical decision support systems: a review on knowledge representation and inference under uncertainties. International Journal of Computational Intelligence Systems 1, 2(2008), 159–167.

[38]

Leah Kulp and Aleksandra Sarcevic. 2018. Design in the “medical” wild: challenges of technology deployment. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, LBW040.

Digital Library

[39]

Dan Li, Jianqian Chao, Jing Kong, Gui Cao, Mengru Lv, and Man Zhang. 2019. The efficiency analysis and spatial implications of health information technology: A regional exploratory study in China. Health Informatics Journal(2019), 1460458219889794.

[40]

Q Vera Liao, Mas-ud Hussain, Praveen Chandar, Matthew Davis, Yasaman Khazaeni, Marco Patricio Crasso, Dakuo Wang, Michael Muller, N Sadat Shami, Werner Geyer, 2018. All Work and No Play?. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 3.

Digital Library

[41]

Robert Lindsey, Aaron Daluiski, Sumit Chopra, Alexander Lachapelle, Michael Mozer, Serge Sicular, Douglas Hanel, Michael Gardner, Anurag Gupta, Robert Hotchkiss, 2018. Deep neural network improves fracture detection by clinicians. Proceedings of the National Academy of Sciences 115, 45(2018), 11591–11596.

[42]

Meina Liu, Qiuju Zhang, Mingshan Lu, Churl-Su Kwon, and Hude Quan. 2007. Rural and urban disparity in health services utilization in China. Medical care 45, 8 (2007), 767–774.

[43]

Farah Magrabi, Elske Ammenwerth, Jytte Brender McNair, Nicolet F De Keizer, Hannele Hyppönen, Pirkko Nykänen, Michael Rigby, Philip J Scott, Tuulikki Vehko, Zoie Shui-Yee Wong, 2019. Artificial intelligence in clinical decision support: challenges for evaluating AI and practical implications. Yearbook of medical informatics 28, 01 (2019), 128–134.

[44]

B Middleton, DF Sittig, and A Wright. 2016. Clinical decision support: a 25 year retrospective and a 25 year vision. Yearbook of medical informatics 25, S 01 (2016), S103–S116.

[45]

Randolph A Miller, Melissa A McNeil, Sue M Challinor, Fred E Masarie Jr, and Jack D Myers. 1986. The INTERNIST-1/quick medical REFERENCE project—Status report. Western Journal of Medicine 145, 6 (1986), 816.

[46]

Lorenzo Moja. 2010. Navigators for medicine: evolution of online point-of-care evidence-based services. (2010).

[47]

Lorenzo Moja, Koren H Kwag, Theodore Lytras, Lorenzo Bertizzolo, Linn Brandt, Valentina Pecoraro, Giulio Rigon, Alberto Vaona, Francesca Ruggiero, Massimo Mangia, 2014. Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. American journal of public health 104, 12 (2014), e12–e22.

[48]

Lorenzo Moja, Elisa Giulia Liberati, Laura Galuppo, Mara Gorli, Marco Maraldi, Oriana Nanni, Giulio Rigon, Pietro Ruggieri, Francesca Ruggiero, Giuseppe Scaratti, 2014. Barriers and facilitators to the uptake of computerized clinical decision support systems in specialty hospitals: protocol for a qualitative cross-sectional study. Implementation Science 9, 1 (2014), 1–6.

[49]

Clara Mosquera-Lopez, Sos Agaian, Alejandro Velez-Hoyos, and Ian Thompson. 2014. Computer-aided prostate cancer diagnosis from digitized histopathology: a review on texture-based systems. IEEE reviews in biomedical engineering 8 (2014), 98–113.

[50]

Annette Moxey, Jane Robertson, David Newby, Isla Hains, Margaret Williamson, and Sallie-Anne Pearson. 2010. Computerized clinical decision support for prescribing: provision does not guarantee uptake. Journal of the American Medical Informatics Association 17, 1(2010), 25–33.

[51]

Shweta Narkar, Yunfeng Zhang, Vera Liao, Dakuo Wang, and Justin Weisz. 2021. Model LineUpper: Supporting Interactive Model Comparison at MultipleLevels for AutoML. In Proceedings of the ACM IUI 2021.

Digital Library

[52]

National Bureau of Statistics of the People’s Republic of China. 2020. Statistical Communiqué of the People’s Republic of China on the 2019 National Economic and Social Development. http://www.stats.gov.cn/english/PressRelease/202002/t20200228_1728917.html.

[53]

National Health Commission of the People’s Republic of China. 2020. Statistical report of the People’s Republic of China on the 2019 Healthcare Industry Development. http://www.nhc.gov.cn/guihuaxxs/s10748/202006/ebfe31f24cc145b198dd730603ec4442.shtml.

[54]

Jerome A Osheroff, Jonathan M Teich, Blackford Middleton, Elaine B Steen, Adam Wright, and Don E Detmer. 2007. A roadmap for national action on clinical decision support. Journal of the American medical informatics association 14, 2(2007), 141–145.

[55]

Sun Young Park. 2019. Identifying the challenges and opportunities in human-ai collaboration in healthcare. https://aihealth.wixsite.com/cscw2019

[56]

Vimla L Patel, Edward H Shortliffe, Mario Stefanelli, Peter Szolovits, Michael R Berthold, Riccardo Bellazzi, and Ameen Abu-Hanna. 2009. The coming of age of artificial intelligence in medicine. Artificial intelligence in medicine 46, 1 (2009), 5–17.

[57]

Emily S Patterson, Bradley N Doebbeling, Constance H Fung, Laura Militello, Shilo Anders, and Steven M Asch. 2005. Identifying barriers to the effective use of clinical reminders: bootstrapping multiple methods. Journal of biomedical informatics 38, 3 (2005), 189–199.

Digital Library

[58]

David Peiris, Tim Usherwood, Tarun Weeramanthri, Alan Cass, and Anushka Patel. 2011. New tools for an old trade: a socio-technical appraisal of how electronic decision support is used by primary care practitioners. Sociology of health & illness 33, 7 (2011), 1002–1018.

[59]

Fredrik Rehnmark, William Bluethmann, Jennifer Rochlis, Eric Huber, and Robert Ambrose. 2003. An effective division of labor between human and robotic agents performing a cooperative assembly task. (2003).

[60]

Jacobus Ridderikhoff and Bart van Herk. 1999. Who is afraid of the system? Doctors’ attitude towards diagnostic systems. International journal of medical informatics 53, 1(1999), 91–100.

[61]

Max J Romano and Randall S Stafford. 2011. Electronic health records and clinical decision support systems: impact on national ambulatory care quality. Archives of internal medicine 171, 10 (2011), 897–903.

[62]

Nikki Rousseau, Elaine McColl, John Newton, Jeremy Grimshaw, and Martin Eccles. 2003. Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. Bmj 326, 7384 (2003), 314.

[63]

Jason J Saleem, Emily S Patterson, Laura Militello, Marta L Render, Greg Orshansky, and Steven M Asch. 2005. Exploring barriers and facilitators to the use of computerized clinical reminders. Journal of the American Medical Informatics Association 12, 4(2005), 438–447.

[64]

Murali Sambasivan, Pouyan Esmaeilzadeh, Naresh Kumar, and Hossein Nezakati. 2012. Intention to adopt clinical decision support systems in a developing country: effect of physician’s perceived professional autonomy, involvement and belief: a cross-sectional study. BMC medical informatics and decision making 12, 1 (2012), 142.

[65]

Ameneh Shamekhi, Q Vera Liao, Dakuo Wang, Rachel KE Bellamy, and Thomas Erickson. 2018. Face Value? Exploring the effects of embodiment for a group facilitation agent. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 391.

Digital Library

[66]

Luv Sharma, Aravind Chandrasekaran, Kenneth K Boyer, and Christopher M McDermott. 2016. The impact of health information technology bundles on hospital performance: An econometric study. Journal of Operations Management 41 (2016), 25–41.

Digital Library

[67]

Richard N Shiffman, Jane Dixon, Cynthia Brandt, Abdelwaheb Essaihi, Allen Hsiao, George Michel, and Ryan O’Connell. 2005. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC medical informatics and decision making 5, 1 (2005), 1–8.

[68]

Duncan Short, Martin Frischer, and James Bashford. 2004. Barriers to the adoption of computerised decision support systems in general practice consultations: a qualitative study of GPs’ perspectives. International journal of medical informatics 73, 4(2004), 357–362.

[69]

Edward H Shortliffe and Martin J Sepúlveda. 2018. Clinical decision support in the era of artificial intelligence. Jama 320, 21 (2018), 2199–2200.

[70]

Ting Shu, Haiyi Liu, Foster R Goss, Wei Yang, Li Zhou, David W Bates, and Minghui Liang. 2014. EHR adoption across China’s tertiary hospitals: a cross-sectional observational study. International journal of medical informatics 83, 2(2014), 113–121.

[71]

Aneesha Singh, Nikki Newhouse, Jo Gibbs, Ann E Blandford, Yunan Chen, Pam Briggs, Helena Mentis, Kate M Sellen, and Jakob E Bardram. 2017. HCI and Health: Learning from Interdisciplinary Interactions. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1322–1325.

Digital Library

[72]

Dean F Sittig, Adam Wright, Jerome A Osheroff, Blackford Middleton, Jonathan M Teich, Joan S Ash, Emily Campbell, and David W Bates. 2008. Grand challenges in clinical decision support. Journal of biomedical informatics 41, 2 (2008), 387–392.

Digital Library

[73]

Anne M Stiggelbout, Trudy Van der Weijden, Maarten PT De Wit, Dominick Frosch, France Légaré, Victor M Montori, Lyndal Trevena, and Glenn Elwyn. 2012. Shared decision making: really putting patients at the centre of healthcare. Bmj 344(2012), e256.

[74]

Peter Stone, R Brooks, E Brynjolfsson, R Calo, O Etzioni, G Hager, and A Teller. 2016. One hundred year study on artificial intelligence. Artificial Intelligence and Life in 2030 (2016).

[75]

Eliza Strickland. 2019. IBM Watson, heal thyself: How IBM overpromised and underdelivered on AI health care. IEEE Spectrum 56, 4 (2019), 24–31.

[76]

Nicole Sultanum, Michael Brudno, Daniel Wigdor, and Fanny Chevalier. 2018. More text please! understanding and supporting the use of visualization for clinical text overview. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 422.

Digital Library

[77]

Henk Ten Have. 2000. Re-evaluating professional autonomy in health care. Theoretical medicine and bioethics 21, 5 (2000), 503–513.

[78]

Feng Tian, Xiangmin Fan, Junjun Fan, Yicheng Zhu, Jing Gao, Dakuo Wang, Xiaojun Bi, and Hongan Wang. 2019. What Can Gestures Tell?: Detecting Motor Impairment in Early Parkinson’s from Common Touch Gestural Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 83.

Digital Library

[79]

Elaine Tomasi, Luiz Augusto Facchini, and Maria de Fatima Santos Maia. 2004. Health information technology in primary health care in developing countries: a literature review. Bulletin of the World Health Organization 82 (2004), 867–874.

[80]

Zhiping Walter and Melissa Succi Lopez. 2008. Physician acceptance of information technologies: Role of perceived threat to professional autonomy. Decision Support Systems 46, 1 (2008), 206–215.

Digital Library

[81]

Dakuo Wang, Josh Andres, Justin Weisz, Erick Oduor, and Casey Dugan. 2021. AutoDS: Towards Human-Centered Automation of Data Science. In Proceedings of the CHI 2021.

Digital Library

[82]

Ding Wang, Santosh D Kale, and Jacki O’Neill. 2020. Please call the specialism: Using WeChat to support patient care in China. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[83]

Dakuo Wang, Justin D. Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019. Human-AI Collaboration in Data Science: Exploring Data Scientists’ Perceptions of Automated AI. To appear in Computer Supported Cooperative Work (CSCW) (2019).

[84]

Liuping Wang, Dakuo Wang, Feng Tian, Zhenhui Peng, Xiangmin Fan, Zhan Zhang, Shuai Ma, Mo Yu, Xiaojuan Ma, and Hongan Wang. 2021. CASS: Towards Building a Social-Support Chatbot for Online Health Community. In Proceedings of the CSCW 2021.

Digital Library

[85]

Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. Knowledge graph embedding by translating on hyperplanes. In Twenty-Eighth AAAI conference on artificial intelligence.

Digital Library

[86]

Daniel Karl I Weidele, Justin D Weisz, Erick Oduor, Michael Muller, Josh Andres, Alexander Gray, and Dakuo Wang. 2020. AutoAIViz: opening the blackbox of automated artificial intelligence with conditional parallel coordinates. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 308–312.

Digital Library

[87]

William E Worley and Herbert S Waxman. 1990. Meditel: Computer Assisted Diagnosis. Version 1.0.

[88]

Adam Wright, Dean F Sittig, Joan S Ash, Sapna Sharma, Justine E Pang, and Blackford Middleton. 2009. Clinical decision support capabilities of commercially-available clinical information systems. Journal of the American Medical Informatics Association 16, 5(2009), 637–644.

[89]

Huiwen Xu, Weijun Zhang, Linni Gu, Zhiyong Qu, Zhihong Sa, Xiulan Zhang, and Donghua Tian. 2014. Aging village doctors in five counties in rural China: situation and implications. Human resources for health 12, 1 (2014), 36.

[90]

Ying Xu, Dakuo Wang, Penelope Collins, Hyelim Lee, and Mark Warschauer. [n.d.]. Same benefits, different communication patterns: Comparing Children’s reading with a conversational agent vs. a human partner. Computers & Education 161 ([n. d.]), 104059.

[91]

Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 238.

Digital Library

[92]

Winnie Yip and William C Hsiao. 2008. The Chinese health system at a crossroads. Health affairs 27, 2 (2008), 460–468.

[93]

A Zamora, F Fernández de Bobadilla, C Carrion, G Vázquez, G Paluzie, R Elosua, M Vilaseca, A Martín-Urda, A Rivera, N Plana, 2013. Pilot study to validate a computer-based clinical decision support system for dyslipidemia treatment (HTE-DLP). Atherosclerosis 231, 2 (2013), 401–404.

[94]

Huiping Zhang, Bernard T Han, and Zhiwei Tang. 2017. Constructing a nationwide interoperable health information system in China: The case study of Sichuan Province. Health policy and technology 6, 2 (2017), 142–151.

[95]

Yupeng Zhang, Teng Han, Zhimin Ren, Nobuyuki Umetani, Xin Tong, Yang Liu, Takaaki Shiratori, and Xiang Cao. 2013. BodyAvatar. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST ’13. ACM Press, New York, New York, USA, 387–396. https://doi.org/10.1145/2501988.2502015

Digital Library

[96]

Zhe Zhang and Timothy W Bickmore. 2018. Medical Shared Decision Making with a Virtual Agent. In IVA. 113–118.

[97]

Kai Zheng, Rema Padman, Michael P Johnson, and Herbert S Diamond. 2005. Understanding technology adoption in clinical care: clinician adoption behavior of a point-of-care reminder system. International journal of medical informatics 74, 7-8(2005), 535–543.

[98]

Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018. Value-sensitive algorithm design: Method, case study, and lessons. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–23.

Digital Library

Cited By

Siraj MSiraj HShoaib MMiran SMahmood AHussain F(2024)Addressing Issues and Challenges Using AI in PharmacyAdvances in Computational Intelligence for the Healthcare Industry 4.010.4018/979-8-3693-2333-5.ch002(22-41)Online publication date: 7-Jun-2024
https://doi.org/10.4018/979-8-3693-2333-5.ch002
Sharna MGupta PShah JJoshi S(2024)Escalating Artificial Intelligence-Enabled Clinical Decision Support Systems to Enhance Home-Based CareDriving Global Health and Sustainable Development Goals With Smart Technology10.4018/979-8-3373-0240-9.ch005(99-114)Online publication date: 20-Dec-2024
https://doi.org/10.4018/979-8-3373-0240-9.ch005
Gomez-Cabello CBorna SPressman SHaider SHaider CForte A(2024)Artificial-Intelligence-Based Clinical Decision Support Systems in Primary Care: A Scoping Review of Current Clinical ImplementationsEuropean Journal of Investigation in Health, Psychology and Education10.3390/ejihpe1403004514:3(685-698)Online publication date: 13-Mar-2024
https://doi.org/10.3390/ejihpe14030045
Show More Cited By

Index Terms

“Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment
1. Applied computing
  1. Life and medical sciences
2. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Pre-Implementation Case Studies Evaluating Workflow and Informatics Challenges in Private Primary Care Clinics for Electronic Medical Record Implementation

Despite the potential benefits of electronic medical records EMRs, their implementations have failed in a number of instances because of misfit between the technology design, work practices, workflows, and clinicians' needs. To promote effective design ...
"What is Your Envisioned Future?": Toward Human-AI Enrichment in Data Work of Asthma Care
CSCW

Patient-generated health data (PGHD) is crucial for healthcare providers' decision making, as it complements clinical data by providing a more holistic view of patients' daily conditions. We interviewed 20 healthcare providers in asthma care to envision ...
Challenges and strategies for wide-scale artificial intelligence (AI) deployment in healthcare practices: A perspective for healthcare organizations
Abstract
Healthcare organizations have realized that Artificial intelligence (AI) can provide a competitive edge through personalized patient experiences, improved patient outcomes, early diagnosis, augmented clinician capabilities, enhanced operational ...
Highlights
- This study categorizes AI applications in healthcare and analyzes their deployment challenges at scale in medical practices.
- The paper emphasizes a cultural shift to view AI as a healthcare delivery enhancer and job creator, not a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

88
Total Citations
View Citations
2,684
Total Downloads

Downloads (Last 12 months)811
Downloads (Last 6 weeks)102

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Siraj MSiraj HShoaib MMiran SMahmood AHussain F(2024)Addressing Issues and Challenges Using AI in PharmacyAdvances in Computational Intelligence for the Healthcare Industry 4.010.4018/979-8-3693-2333-5.ch002(22-41)Online publication date: 7-Jun-2024
https://doi.org/10.4018/979-8-3693-2333-5.ch002
Sharna MGupta PShah JJoshi S(2024)Escalating Artificial Intelligence-Enabled Clinical Decision Support Systems to Enhance Home-Based CareDriving Global Health and Sustainable Development Goals With Smart Technology10.4018/979-8-3373-0240-9.ch005(99-114)Online publication date: 20-Dec-2024
https://doi.org/10.4018/979-8-3373-0240-9.ch005
Gomez-Cabello CBorna SPressman SHaider SHaider CForte A(2024)Artificial-Intelligence-Based Clinical Decision Support Systems in Primary Care: A Scoping Review of Current Clinical ImplementationsEuropean Journal of Investigation in Health, Psychology and Education10.3390/ejihpe1403004514:3(685-698)Online publication date: 13-Mar-2024
https://doi.org/10.3390/ejihpe14030045
Diaz-Asper CChandler CElvevåg B(2024)Cognitive Screening for Mild Cognitive Impairment: Clinician Perspectives on Current Practices and Future DirectionsJournal of Alzheimer’s Disease10.3233/JAD-24029399:3(869-876)Online publication date: 4-May-2024
https://doi.org/10.3233/JAD-240293
Dingel JKleine ACecil JSigl ALermer EGaube S(2024)Predictors of Healthcare Practitioners' Intention to Use AI-Enabled Clinical Decision Support Systems (AI-CDSSs): A Meta-Analysis Based on the Unified Theory of Acceptance and Use of Technology (UTAUT) (Preprint)Journal of Medical Internet Research10.2196/57224Online publication date: 15-Feb-2024
https://doi.org/10.2196/57224
Lorenzini GArbelaez Ossa LMilford SElger BShaw DDe Clercq E(2024)The “Magical Theory” of AI in Medicine: Thematic Narrative AnalysisJMIR AI10.2196/497953(e49795)Online publication date: 19-Aug-2024
https://doi.org/10.2196/49795
Botha NSegbedzi CDumahasi VManeen SKodom RTsedze IAkoto LAtsu FLasim OAnsah E(2024)Artificial intelligence in healthcare: a scoping review of perceived threats to patient rights and safetyArchives of Public Health10.1186/s13690-024-01414-182:1Online publication date: 23-Oct-2024
https://doi.org/10.1186/s13690-024-01414-1
Chen CLiao MWalther JSundar S(2024)When an AI Doctor Gets Personal: The Effects of Social and Medical Individuation in Encounters With Human and AI DoctorsCommunication Research10.1177/00936502241263482Online publication date: 2-Aug-2024
https://doi.org/10.1177/00936502241263482
Okolo CLin H(2024)Explainable AI in Practice: Practitioner Perspectives on AI for Social Good and User Engagement in the Global SouthProceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization10.1145/3689904.3694707(1-16)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3689904.3694707
Bahodi Mvan Berkel NSkov MMerritt T(2024)Show Me What's Wrong: Impact of Explicit Alerts on Novice Supervisors of a Multi-Robot Monitoring SystemProceedings of the Second International Symposium on Trustworthy Autonomous Systems10.1145/3686038.3686069(1-17)Online publication date: 16-Sep-2024
https://dl.acm.org/doi/10.1145/3686038.3686069
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents