More Web Proxy on the site http://driver.im/

research-article

Experience Matters: Design and Evaluation of an Anesthesia Support Tool Guided by User Experience Theory

Authors:

Franzisca Maas,

David Schraudt,

Tobias GrundgeigerAuthors Info & Claims

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

Pages 1523 - 1535

https://doi.org/10.1145/3357236.3395552

Published: 03 July 2020 Publication History

Abstract

Despite many advances, clinical decision support tools (DSTs) often suffer from implementation and acceptance problems in the actual clinical context. We suggest that considering psychological needs-based and embodied user experience theories in the design of DSTs could help to overcome these problems. To examine this idea, we iteratively developed a DST called Cassandra supporting anesthetic teams in crisis management, specifically focusing on psychological needs and fluent interaction with the social and physical environment. We preliminarily evaluated Cassandra in a medical simulation, requiring anesthetic teams to handle a crisis. Although not all features of Cassandra had the intended effect, the results indicated that interacting with Cassandra supported the fulfillment of the identified needs for autonomy, competence, and relatedness and was seamlessly integrated into existing diagnostic processes. Considering user experience theories for the design of DSTs seems a promising way to overcome implementation and acceptance problems and eventually improve patient safety.

Supplementary Material

ZIP File (disfp9453aux.zip)

The supplemental materials contain figures of the prototype iterations (Figure 1-3), a table with the set of questions asked during the evaluation sessions (Table 1), and the consolidated sequence models of all interactions with Cassandra (Figure 4-6).

Download
916.54 KB

References

[1]

John C. Alexander and Girish P. Joshi. 2018. Anesthesiology, automation, and artificial intelligence. In Baylor University Medical Center Proceedings. Taylor & Francis, 117--119. https://doi.org/10.1080/08998280.2017.1391036

[2]

Edouard Battegay and Stefano Bassetti. 2017. Grundlagen der Differenzialdiagnose. In: Differenzialdiagnose Innere Krankheiten, Georg Thieme Verlag, New York, NY, USA, https://doi.org/10.1055/b-004-129980

[3]

Marek Bekier and Brett R. Molesworth. 2017. Altering user' acceptance of automation through prior automation exposure. Ergonomics, 60, 6: 745753. https://doi.org/10.1080/00140139.2016.1216610

[4]

Casey C. Bennett and Kris Hauser. 2013. Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach. Artificial intelligence in medicine, 57, 1: 9--19. https://doi.org/10.1016/j.artmed.2012.12.003

Digital Library

[5]

Eta S. Berner and Tonya J. La Lande. 2007. Overview of Clinical Decision Support Systems. In: Clinical Decision Support Systems: Theory and Practice, Springer, Cham, Germany, 3--22. https://doi.org/10.1007/978-0-387-38319-4_1

[6]

Maxime Cannesson and Joseph Rinehart. 2014. Closed-loop systems and automation in the era of patients safety and perioperative medicine. Journal of clinical monitoring and computing, 28, 1--3: https://doi.org/10.1007/s10877-013-9537-3

[7]

Basit Chaudhry. 2008.computerized clinical decision support: will it transform healthcare? Journal of general internal medicine, 23: 85--87. https://doi.org/10.1007/s11606-007-0432-9

[8]

Keng Sheng Chew, Jeroen van Merrienboer, and Steven J. Durning. 2017. Investing in the use of a checklist during differential diagnoses consideration: what's the trade-off? BMC medical education, 17, 1: 234. https://doi.org/10.1186/s12909-017-1078-x

[9]

David Cumin, Jennifer M. Weller, Kaylene Henderson, and Alan. F. Merry. 2010. Standards for simulation in anaesthesia: creating confidence in the tools. British journal of anaesthesia, 105, 1: 4551. https://doi.org/10.1093/bja/aeq095

[10]

Paul Dourish. 2004. Where the action is: the foundations of embodied interaction. MIT press, Cambridge, MA, USA.

[11]

Pelle Ehn. 1993. Scandinavian design: On participation and skill. In: Participatory design: Principles and practices, 41--77.

[12]

Glyn Elwyn, Isabelle Scholl, Caroline Tietbohl, Mala Mann, Adrian Edwards, Catharine Clay, France Légaré, Trudy van der Weijden, Carmen L. Lewis, Richard M. Wexler, and Dominick L. Frosch. 2013. "Many miles to go?": a systematic review of the implementation of patient decision support interventions into routine clinical practice. BMC medical informatics and decision making, 13: https://doi.org/10.1186/1472-6947-13-S2-S14

[13]

Aude Fourcade, Jean-Louis Blache, Catherine Grenier, Jean-Louis Bourgain, and Etienne Minvielle. 2012. Barriers to staff adoption of a surgical safety checklist. BMJ Quality & Safety, 21, 3: 191--197. http://dx.doi.org/10.1136/bmjqs-2011000094

[14]

David M. Gaba, Kevin J. Fish, and Steven K. Howard. 1994. Crisis management in anesthesiology. Churchill Livingstone, New York, NY, USA.

[15]

Atul Gawande. 2009. The checklist manifesto: How to get things right. Metropolitan Books, New York.

[16]

Michael J. Gonzales, Joshua M. Henry, Aaron W. Calhoun, and Laurel D. Riek. 2016. Visual task: a collaborative cognitive aid for acute care resuscitation. In Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare. 45--52. http://dl.acm.org/citation.cfm?id=3021319.302132

[17]

Mark L. Graber, Nancy Franklin, and Ruthanna Gordon. 2005. Diagnostic error in internal medicine. Archives of internal medicine, 165, 13: 1493--1499. https://doi.org/10.1001/archinte.165.13.1493

[18]

Jonathan Grudin. 2017. From tool to partner: The evolution of human-computer interaction. Synthesis Lectures on Human-Centered informatics, 10, 1: https://doi.org/10.2200/S00745ED1V01Y201612H CI035

[19]

Tobias Grundgeiger, Stephan Huber, Daniel Reinhardt, Andreas Steinisch, Oliver Happel, and Thomas Wurmb. 2019. Cognitive Aids in Acute Care: Investigating How Cognitive Aids Affect and Support In-hospital Emergency Teams. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 1--14. http://doi.acm.org/10.1145/3290605.3300884

Digital Library

[20]

Tobias Grundgeiger, Joern Hurtienne, and Oliver Happel. 2020. Why and How to Approach User Experience in Safety-Critical Domains: The Example of Healthcare. Human Factors: https://doi.org/10.1177/0018720819887575

[21]

Marc Hassenzahl, Sarah Diefenbach, and Anja Göritz. 2010. Needs, affect, and interactive products -- Facets of user experience. Interacting with computers, 22, 5: 353--362. https://doi.org/10.1016/j.intcom.2010.04.002

Digital Library

[22]

Thomas M. Hemmerling, Fabrizio Cirillo, and Shantale Cyr. 2012. Decision support systems in medicine-anesthesia, critical care and intensive care medicine. In: Decision Support Systems, IntechOpen, London, UK, http://dx.doi.org/10.5772/51756

[23]

David L. Hepner, Alexander F. Arriaga, Jeffrey B. Cooper, Sara N. Goldhaber-Fiebert, David M. Gaba, William R. Berry, Daniel J. Boorman, and Angela M. Bader. 2017. Operating room crisis checklists and emergency manuals. Anesthesiology: The Journal of the American Society of Anesthesiologists, 127, 2: 384--392. https://doi.org/10.1097/ALN.0000000000001731

[24]

Karen Holtzblatt and Hugh Beyer. 2017. Contextual Design: Design for Life. Morgan Kaufmann, Burlington, MA, USA.

[25]

Monique W. Jaspers, Marian Smeulers, Hester Vermeulen, and Linda W. Peute. 2011. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. Journal of the American Medical Informatics Association, 18, 3: 327--334. https://doi.org/10.1136/amiajnl-2011000094

[26]

Robert A. Jenders. 2017. Advances in clinical decision support: Highlights of practice and the literature 2015--2016. Yearbook of medical informatics, 26, 1: 125--132. http://doi.org/10.15265/IY-2017-012

[27]

Kensaku Kawamoto, Caitlin A. Houlihan, Andrew Balas, and David F. Lobach. 2005. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ, 330: 765. https://doi.org/10.1136/bmj.38398.500764.8F

[28]

A. King and L.M. Weaving. 2017. General anesthesia: Induction. Retrieved September 10, 2019 from https://www.uptodate.com/contents/generalanesthesiainduction'source=search_result&search=general% 20anesthesia&selectedTitle=3 150.

[29]

Leah Kulp, Aleksandra Sarcevic, Megan Cheng, Yinan Zheng, and Randall S Burd. 2019.comparing the Effects of Paper and Digital Checklists on Team Performance in Time-Critical Work. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--13. http://doi.acm.org/10.1145/3290605.3300777

Digital Library

[30]

John D. Lee, Christopher D. Wickens, Yili Liu, and Linda Ng Boyle. 2017. Human Automation Interaction. In: Designing for people: An introduction to human factors engineering, CreateSpace, Scotts Valley, CA, USA, 357--387.

[31]

Stuart Marshall. 2013. The Use of Cognitive Aids During Emergencies in Anesthesia: A Review of the Literature. Anesthesia Analgesia, 117, 5: 11621171. https://doi.org/10.1213/ANE.0b013e31829c397b

[32]

Philipp Mayring. 2008. Qualitative Inhaltsanalyse: Grundlagen und Techniken. Beltz, Weinheim.

[33]

John McCarthy and Peter Wright. 2005. Putting 'felt-life' at the centre of human--computer interaction (HCI). Cognition, technology & work, 7, 4: 262--271. https://doi.org/10.1007/s10111-0050011-y

[34]

Tilo Mentler and Michael Herczeg. 2016. On the role of user experience in mission-or safety-critical systems. In Mensch und Computer 2016-- Workshopband. Gesellschaft für Informatik e.V., Aachen, Germany, http://doi.org/10.18420/muc2016-ws01-0001

[35]

Mark A. Musen, Blackford Middleton, and Robert A. Greenes. 2014. Clinical decision-support systems. In: Biomedical informatics, Springer, London, UK, 643--674. https://doi.org/10.1007/9781-4471-4474-8_22

[36]

Bala G. Nair, Eilon Gabel, Ira Hofer, Howard A. Schwid, and Maxime Cannesson. 2017. Intraoperative Clinical Decision Support for Anesthesia: A Narrative Review of Available Systems. Anesthesia & Analgesia, 124, 2: 603--617. 10.1213/ane.0000000000001636

[37]

Julia Neily, Joseph M. DeRosier, Peter D. Mills, Michael J. Bishop, William B. Weeks, and James P. Bagian. 2007. Awareness and use of a cognitive aid for anesthesiology. The Joint Commission Journal on Quality and Patient Safety, 33, 8: 502--511. https://doi.org/10.1016/S1553--7250(07)33054-7

[38]

Thierry Pelaccia, Jacques Tardif, Emmanuel Triby, and Bernard Charlin. 2011. An analysis of clinical reasoning through a recent and comprehensive approach: the dual-process theory. Medical education online, 16, 1: https://doi.org/10.3402/meo.v16i0.5890

[39]

Meera Ramachandran, Joel S. Greenstein, Michael Mcevoy, and Matthew D. Mcevoy. 2014. Using a context-sensitive ranking method to organize reversible causes of cardiac arrest in a digital cognitive aid. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. SAGE Publications, Los Angeles, CA, USA, 788--792. https://doi.org/10.1177/1541931214581144

[40]

Nicholas Riches, Maria Panagioti, Rahul Alam, Sudeh Cheraghi-Sohi, Stephen Campbell, Aneez Esmail, and Peter Bower. 2016. The effectiveness of electronic differential diagnoses (DDX) generators: a systematic review and meta-analysis. PloS one, 11, 3: https://doi.org/10.1371/journal.pone.0148991

[41]

Paula Savioja, Marja Liinasuo, and Hanna Koskinen. 2014. User experience: does it matter in complex systems? Cognition, Technology & Work, 16, 4: 429--449. https://doi.org/10.1007/s10111013-0271-x

Digital Library

[42]

Daniel Schneiderbanger, Stephan Johannsen, Norbert Roewer, and Frank Schuster. 2014. Management of malignant hyperthermia: diagnosis and treatment. Therapeutics and clinical risk management, 10: 355--362. http://doi.org/10.2147/TCRM.S47632

[43]

Kennon M. Sheldon, Andrew J. Elliot, Youngmee Kim, and Tim Kasser. 2001. What is satisfying about satisfying events? Testing 10 candidate psychological needs. Journal of personality and social psychology, 80, 2: 325--339. https://doi.org/10.1037/0022-3514.80.2.325

[44]

Allan F. Simpao, Jonathan M. Tan, Arul M. Lingappan, Jorge A. Gálvez, Sherry E. Morgan, and Michael A. Krall. 2017. A systematic review of near real-time and point-of-care clinical decision support in anesthesia information management systems. Journal of clinical monitoring and computing, 31, 5: 885--894. https://doi.org/10.1007/s10877-016-9921-x

[45]

Marjorie Stiegler, Jacques P. Neelankavil, Cecilia Canales, and A. Dhillon. 2011. Cognitive errors detected in anaesthesiology: a literature review and pilot study. British journal of anaesthesia, 108, 2: 229--235. https://doi.org/10.1093/bja/aer387

[46]

Marjorie Stiegler and Keith J. Ruskin. 2012. Decision-making and safety in anesthesiology. Current Opinion in Anesthesiology, 25, 6: 724--729. http://doi.org/10.1097/ACO.0b013e328359307a

[47]

Annette L. Valenta, Margaret M. Browning, Timothy E. Weddle, Greer Stevenson, Andrew D. Boyd, and Denise M. Hynes. 2010. Physician perceptions of clinical reminders. In Proceedings of the 1st ACM International Health Informatics Symposium. ACM, New York, NY, USA, 710--717. http://doi.acm.org/10.1145/1882992.1883101

[48]

Jelle Van Dijk and Caroline Hummels. 2017. Designing for embodied being-in-the-world: Two cases, seven principles and one framework. In Proceedings of the eleventh international conference on tangible, embedded, and embodied interaction. ACM, New York, NY, USA, 47--56. http://doi.acm.org/10.1145/3024969.3025007

Digital Library

[49]

Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing Theory-Driven User-Centric Explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--15. http://doi.acm.org/10.1145/3290605.3300831

[50]

Robert L. Wears and Marc Berg. 2005.computer technology and clinical work: still waiting for Godot. Jama, 293, 10: 1261--1263. http://doi.org/10.1001/jama.293.10.1261

[51]

Leslie Wu, Jesse Cirimele, Kristen Leach, Stuart Card, Larry Chu, T Kyle Harrison, and Scott R Klemmer. 2014. Supporting crisis response with dynamic procedure aids. In Proceedings of the 2014 conference on Designing interactive systems. ACM, New York, NY, USA, 315--324. http://doi.acm.org/10.1145/2598510.2598565

Digital Library

[52]

Qian Yang, John Zimmerman, Aaron Steinfeld, Lisa Carey, and James F. Antaki. 2016. Investigating the heart pump implant decision process: opportunities for decision support tools to help. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4477--4488. http://doi.acm.org/10.1145/2858036.2858373

[53]

Qian Yang, Aaron Steinfeld, and John Zimmerman. 2019. Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision Making Processes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1--11. http://doi.acm.org/10.1145/3290605.3300468

Digital Library

[54]

Dimitrios Zikos and Nailya DeLellis. 2018. CDSSRM: a clinical decision support system reference model. BMC medical research methodology, 18, 1: https://doi.org/10.1186/s12874-018-0587-6

Cited By

Mastrianni ASarcevic AHu AAlmengor LTempel PGao SBurd R(2023)Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design GuidelinesACM Transactions on Computer-Human Interaction10.1145/358243130:3(1-28)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582431
Hohm AHappel OHurtienne JGrundgeiger T(2023)"When the Beeping Stops, you Completely Freak Out" - How Acute Care Teams Experience and Use TechnologyProceedings of the ACM on Human-Computer Interaction10.1145/35795907:CSCW1(1-29)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579590
Mastrianni A(2023)Designing and Evaluating Decision Support Systems for Clinical TeamsCompanion Proceedings of the 2023 ACM International Conference on Supporting Group Work10.1145/3565967.3571755(54-56)Online publication date: 8-Jan-2023
https://dl.acm.org/doi/10.1145/3565967.3571755
Show More Cited By

Index Terms

Experience Matters: Design and Evaluation of an Anesthesia Support Tool Guided by User Experience Theory

Recommendations

The experience of interactive storytelling: comparing “fahrenheit” with “façade”
ICEC'11: Proceedings of the 10th international conference on Entertainment Computing

At the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...
Narrative agency and user experience in transmedia narratives: Brazilian telenovelas case
CLIHC '15: Proceedings of the Latin American Conference on Human Computer Interaction

This short paper proposes a reflection about the transmedia strategies in brazilian telenovelas, more specifically on how is the user experience in this kind of narratives. The user experience design in these narratives in multiple platforms is key to ...
How do users experience the interaction with an immersive screen?
Abstract
Ultra-high definition television (UHDTV) is designed using a variety of immersive technologies that are believed to promote user engagement. This study examines the immersion feature of UHDTV by focusing on user experience (UX) to ...
Highlights
- Examine the immersion feature of UHDTV.
- User experience and quality perception ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

July 2020

2264 pages

ISBN:9781450369749

DOI:10.1145/3357236

General Chairs:
Ron Wakkary
Simon Fraser University, CA and Eindhoven University of Technology, NL
,
Kristina Andersen
Eindhoven University of Technology, NL
,
Program Chairs:
Will Odom
Simon Fraser University, CA
,
Audrey Desjardins
University of Washington, USA
,
Marianne Graves Petersen
Aarhus University, DK

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DIS '20

Sponsor:

SIGCHI

DIS '20: Designing Interactive Systems Conference 2020

July 6 - 10, 2020

Eindhoven, Netherlands

Acceptance Rates

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)6

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mastrianni ASarcevic AHu AAlmengor LTempel PGao SBurd R(2023)Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design GuidelinesACM Transactions on Computer-Human Interaction10.1145/358243130:3(1-28)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3582431
Hohm AHappel OHurtienne JGrundgeiger T(2023)"When the Beeping Stops, you Completely Freak Out" - How Acute Care Teams Experience and Use TechnologyProceedings of the ACM on Human-Computer Interaction10.1145/35795907:CSCW1(1-29)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579590
Mastrianni A(2023)Designing and Evaluating Decision Support Systems for Clinical TeamsCompanion Proceedings of the 2023 ACM International Conference on Supporting Group Work10.1145/3565967.3571755(54-56)Online publication date: 8-Jan-2023
https://dl.acm.org/doi/10.1145/3565967.3571755
Mastrianni A(2023)Supporting Clinical Teams in Decision-Making: Designing and Evaluating Clinical Decision-Support Systems for Time-Critical Medical WorkCompanion Publication of the 2023 ACM Designing Interactive Systems Conference10.1145/3563703.3593064(32-36)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563703.3593064
Venkatasubramanian KRanalli TKirupaharan PSolanki DMankodiya K(2023)Understanding the Challenges Nurses Encounter with Monitoring Technologies in a NICUInternational Journal of Human–Computer Interaction10.1080/10447318.2023.227829740:23(8142-8165)Online publication date: 14-Nov-2023
https://doi.org/10.1080/10447318.2023.2278297
Golay DSving CCajander Å(2022)An Emotion-driven Approach to Hospital Physicians’ Work-Related User ExperienceNordic Human-Computer Interaction Conference10.1145/3546155.3546684(1-12)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546684
Jo ERyu MKenderova GSo SShapiro BPapoutsaki AEpstein D(2022)Designing Flexible Longitudinal Regimens: Supporting Clinician Planning for Discontinuation of Psychiatric DrugsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502206(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502206
Mastrianni ACui HSarcevic A(2022)”Pop-Up Alerts are the Bane of My Existence”: Designing Alerts for Cognitive Aids Used in Time-Critical Medical SettingsCHI Conference on Human Factors in Computing Systems Extended Abstracts10.1145/3491101.3519669(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519669
Hohm AHappel OHurtienne JGrundgeiger T(2022)User experience in safety–critical domains: a survey on motivational orientations and psychological need satisfaction in acute careCognition, Technology and Work10.1007/s10111-022-00697-024:2(247-260)Online publication date: 1-May-2022
https://dl.acm.org/doi/10.1007/s10111-022-00697-0
Zestic JLiley HSanderson P(2021)Concordance of expert clinicians’ interpretations of the newborn’s true physiological statePediatric Research10.1038/s41390-021-01565-991:5(1222-1230)Online publication date: 28-Jun-2021
https://doi.org/10.1038/s41390-021-01565-9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents