[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Investigating the Use of Head Mounted Devices for Remote Cooperation and Guidance during the Treatment of Wounds

Published: 14 January 2022 Publication History

Abstract

Professional caregivers often face complex situations in which they need the support of a colleague or a specialist. This is especially necessary for caregivers during their training or with less practice in certain tasks. Due to time and space restrictions, colleagues or specialists are not always available for local support. Remote support by streaming videos to a remote helper has been discussed in healthcare domains as a so-called teleconsultation. However, little is known about how to apply teleconsultation in care. We conducted a study with caregivers and remote helpers to compare head mounted devices (HMDs) for teleconsultation in care to two alternative solutions using smartphones. We found that despite lacking familiarity, HMDs have good potential for remote support in care, and that creating video streams with smartphones is not preferable for teleconsultations. We suggest that ideal support needs to balance freedom and guidance and suggest how such support needs to be further explored.

References

[1]
Aldaz, G., Shluzas, L.A., Pickham, D., Eris, O., Sadler, J., Joshi, S. and Leifer, L. 2015. Hands-Free Image Capture, Data Tagging and Transfer Using Google Glass: A Pilot Study for Improved Wound Care Management. PLOS ONE. 10, 4 (Apr. 2015), e0121179.
[2]
Anton, D., Kurillo, G., Yang, A.Y. and Bajcsy, R. 2017. Augmented Telemedicine Platform for Real-Time Remote Medical Consultation. MultiMedia Modeling. L. Amsaleg, G.Þ. Guðmundsson, C. Gurrin, B.Þ. Jónsson, and S. Satoh, eds. Springer International Publishing. 77--89.
[3]
Armstrong, D.G., Rankin, T.M., Giovinco, N.A., Mills, J.L. and Matsuoka, Y. 2014. A Heads-Up Display for Diabetic Limb Salvage Surgery: A View Through the Google Looking Glass. Journal of Diabetes Science and Technology. 8, 5 (Sep. 2014), 951--956.
[4]
Aschenbrenner, D., Leutert, F., Çençen, A., Verlinden, J., Schilling, K., Latoschik, M. and Lukosch, S. 2019. Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial Robots. Frontiers in Robotics and AI. 6, (2019).
[5]
Azimi, E., Winkler, A., Tucker, E., Qian, L., Sharma, M., Doswell, J., Navab, N. and Kazanzides, P. 2018. Evaluation of Optical See-Through Head-Mounted Displays in Training for Critical Care and Trauma. 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (Mar. 2018), 1--9.
[6]
Bai, H., Sasikumar, P., Yang, J. and Billinghurst, M. 2020. A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA, Apr. 2020), 1--13.
[7]
Baldwin, A.C.W., Mallidi, H.R., Baldwin, J.C., Sandoval, E., Cohn, W.E., Frazier, O.H. and Singh, S.K. 2016. Through the Looking Glass: Real-Time Video Using ?Smart' Technology Provides Enhanced Intraoperative Logistics. World Journal of Surgery. 40, 1 (Jan. 2016), 242--244.
[8]
Barbosa, I. de A. and Silva, M.J.P. da 2017. Nursing care by telehealth: what is the influence of distance on communication? Revista Brasileira de Enfermagem. 70, 5 (Oct. 2017), 928--934.
[9]
Barsom, E.Z., Graafland, M. and Schijven, M.P. 2016. Systematic review on the effectiveness of augmented reality applications in medical training. Surgical Endoscopy. 30, 10 (Oct. 2016), 4174--4183.
[10]
Bashshur, R.L. et al. 2014. The Empirical Foundations of Telemedicine Interventions for Chronic Disease Management. Telemedicine and e-Health. 20, 9 (Sep. 2014), 769--800.
[11]
Blattgerste, J., Strenge, B., Renner, P., Pfeiffer, T. and Essig, K. 2017. Comparing conventional and augmented reality instructions for manual assembly tasks. Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments (2017), 75--82.
[12]
Boehm, A. 2004. Chapter 5.13 "Theoretical Coding: Text Analysis in Grounded Theory."
[13]
Botrugno, C. 2019. Information technologies in healthcare: Enhancing or dehumanising doctor--patient interaction? Health: An Interdisciplinary Journal for the Social Study of Health, Illness and Medicine. (Dec. 2019), 136345931989121.
[14]
Brooke, J. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry. P.W. Jordan, B. Thomas, B.A. Weerdmeester, and I.L. McClelland, eds. Taylor & Francis. 189--194.
[15]
Brown, G. and Prilla, M. 2020. The Effects of Consultant Avatar Size and Dynamics on Customer Trust in Online Consultations. Proceedings of Mensch und Computer 2020 (Sep. 2020).
[16]
Budde, V., Reichling, J. and Kraetsch, C. 2019. Requirement analysis for an AR-based teleconsultation system. Mensch und Computer 2019 - Workshopband (Bonn, 2019).
[17]
Datcu, D., Lukosch, S.G. and Lukosch, H.K. 2016. Handheld Augmented Reality for Distributed Collaborative Crime Scene Investigation. Proceedings of the 19th International Conference on Supporting Group Work (New York, NY, USA, 2016), 267--276.
[18]
Fakourfar, O., Ta, K., Tang, R., Bateman, S. and Tang, A. 2016. Stabilized Annotations for Mobile Remote Assistance. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2016), 1548--1560.
[19]
Funk, M., Kosch, T. and Schmidt, A. 2016. Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (2016), 934--939.
[20]
Garrett, J.J. 2010. The Elements of User Experience: User-Centered Design for the Web and Beyond. New Riders Pub.
[21]
Glenn, I.C., Bruns, N.E., Hayek, D., Hughes, T. and Ponsky, T.A. 2017. Rural surgeons would embrace surgical telementoring for help with difficult cases and acquisition of new skills. Surgical Endoscopy. 31, 3 (Mar. 2017), 1264--1268.
[22]
van Gurp, J., van Selm, M., van Leeuwen, E., Vissers, K. and Hasselaar, J. 2016. Teleconsultation for integrated palliative care at home: A qualitative study. Palliative Medicine. 30, 3 (Mar. 2016), 257--269.
[23]
Hart, S.G. and Staveland, L.E. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology. P.A. Hancock and N. Meshkati, eds. North-Holland. 139--183.
[24]
Henderson, S. and Feiner, S. 2011. Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair. IEEE Transactions on Visualization and Computer Graphics. 17, 10 (Oct. 2011), 1355--1368.
[25]
Hoek, P.D., Schers, H.J., Bronkhorst, E.M., Vissers, K.C.P. and Hasselaar, J.G.J. 2017. The effect of weekly specialist palliative care teleconsultations in patients with advanced cancer --a randomized clinical trial. BMC Medicine. 15, 1 (Jun. 2017), 119.
[26]
Johnson, S., Gibson, M. and Mutlu, B. 2015. Handheld or Handsfree?: Remote Collaboration via Lightweight Head-Mounted Displays and Handheld Devices. (2015), 1825--1836.
[27]
Karusala, N., Wang, D. and O'Neill, J. 2020. Making Chat at Home in the Hospital: Exploring Chat Use by Nurses. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2020), 1--15.
[28]
Kim, S., Lee, G., Huang, W., Kim, H., Woo, W. and Billinghurst, M. 2019. Evaluating the Combination of Visual Communication Cues for HMD-based Mixed Reality Remote Collaboration. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19 (Glasgow, Scotland Uk, 2019), 1--13.
[29]
Kobayashi, L., Zhang, X.C., Collins, S.A., Karim, N. and Merck, D.L. 2018. Exploratory Application of Augmented Reality/Mixed Reality Devices for Acute Care Procedure Training. Western Journal of Emergency Medicine. 19, 1 (Jan. 2018), 158--164.
[30]
Lee, M.K., Fruchter, N. and Dabbish, L. 2015. Making Decisions From a Distance: The Impact of Technological Mediation on Riskiness and Dehumanization. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (New York, NY, USA, Feb. 2015), 1576--1589.
[31]
Mather, C., Barnett, T., Broucek, V., Saunders, A., Grattidge, D. and Huang, W. 2017. Helping Hands: Using Augmented Reality to Provide Remote Guidance to Health Professionals. Studies in health technology and informatics. 241, (2017), 57--62.
[32]
Mentis, H.M., Rahim, A. and Theodore, P. 2016. Crafting the image in surgical telemedicine. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (2016), 744--755.
[33]
Mobasheri, M.H., King, D., Johnston, M., Gautama, S., Purkayastha, S. and Darzi, A. 2015. The ownership and clinical use of smartphones by doctors and nurses in the UK: a multicentre survey study. BMJ Innovations. 1, 4 (Oct. 2015), 174--181.
[34]
Moshtaghi, O., Kelley, K.S., Armstrong, W.B., Ghavami, Y., Gu, J. and Djalilian, H.R. 2015. Using google glass to solve communication and surgical education challenges in the operating room. The Laryngoscope. 125, 10 (Oct. 2015), 2295--2297.
[35]
Muensterer, O.J., Lacher, M., Zoeller, C., Bronstein, M. and Kübler, J. 2014. Google Glass in pediatric surgery: An exploratory study. International Journal of Surgery. 12, 4 (Apr. 2014), 281--289.
[36]
Nochomovitz, M. and Sharma, R. 2018. Is It Time for a New Medical Specialty?: The Medical Virtualist. JAMA. 319, 5 (Feb. 2018), 437.
[37]
Norman, M., Lee, G.A., Smith, R.T. and Billingurst, M. 2019. The Impact of Remote User's Role in a Mixed Reality Mixed Presence System. The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry (2019), 1--9.
[38]
Piumsomboon, T., Lee, G.A., Hart, J.D., Ens, B., Lindeman, R.W., Thomas, B.H. and Billinghurst, M. 2018. Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (Montreal QC, Canada, 2018), 1--13.
[39]
Plaumann, K., Ehlers, J., Geiselhart, F., Yuras, G., Huckauf, A. and Rukzio, E. 2015. Better Than You Think: Head Gestures for Mid Air Input. Human-Computer Interaction (2015), 526--533.
[40]
Prilla, M., Janßen, M., Kunzendorff, T., Clausthal University of Technology, Kunzendorff, T., and Clausthal University of Technology 2019. How to Interact with Augmented Reality Head Mounted Devices in Care Work? A Study Comparing Handheld Touch (Hands-on) and Gesture (Hands-free) Interaction. AIS Transactions on Human-Computer Interaction. (Sep. 2019), 157--178.
[41]
Riedlinger, U., Oppermann, L. and Prinz, W. 2019. Tango vs. HoloLens: A comparison of collaborative indoor AR visualisations using hand-held and hands-free devices. Multimodal Technologies and Interaction. 3, 2 (2019), 23.
[42]
Ryan, R.M. and Deci, E.L. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American psychologist. 55, 1 (2000), 68.
[43]
Ryan, R.M. and Deci, E.L. 2017. Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford Publications.
[44]
Siebert, J.N., Ehrler, F., Gervaix, A., Haddad, K., Lacroix, L., Schrurs, P., Sahin, A., Lovis, C. and Manzano, S. 2017. Adherence to AHA Guidelines When Adapted for Augmented Reality Glasses for Assisted Pediatric Cardiopulmonary Resuscitation: A Randomized Controlled Trial. Journal of Medical Internet Research. 19, 5 (May 2017), e183.
[45]
Steventon, A., Bardsley, M., Billings, J., Dixon, J., Doll, H., Hirani, S., Cartwright, M., Rixon, L., Knapp, M., Henderson, C., Rogers, A., Fitzpatrick, R., Hendy, J. and Newman, S. 2012. Effect of telehealth on use of secondary care and mortality: findings from the Whole System Demonstrator cluster randomised trial. BMJ. 344, (Jun. 2012).
[46]
Strauss, A.L. and Corbin, J.M. 1998. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage Publications.
[47]
Tang, A., Owen, C., Biocca, F. and Mou, W. 2003. Comparative effectiveness of augmented reality in object assembly. Proceedings of the conference on Human factors in computing systems - CHI '03 (Ft. Lauderdale, Florida, USA, 2003), 73.
[48]
Teo, T., Lee, G.A., Billinghurst, M. and Adcock, M. 2019. Investigating the use of Different Visual Cues to Improve Social Presence within a 360 Mixed Reality Remote Collaboration*. The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry (Brisbane QLD Australia, Nov. 2019), 1--9.
[49]
Wang, D., Kale, S.D. and O'Neill, J. 2020. Please Call the Specialism: Using WeChat to Support Patient Care in China. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu HI USA, Apr. 2020), 1--13.
[50]
Wang, I., Smith, J. and Ruiz, J. 2019. Exploring Virtual Agents for Augmented Reality. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2019), 281:1--281:12.
[51]
Weibel, N., Gasques, D., Johnson, J., Sharkey, T., Xu, Z.R., Zhang, X., Zavala, E., Yip, M. and Davis, K. 2020. ARTEMIS: Mixed-Reality Environment for Immersive Surgical Telementoring. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA, Apr. 2020), 1--4.
[52]
Wilson, L.S. and Maeder, A.J. 2015. Recent Directions in Telemedicine: Review of Trends in Research and Practice. Healthcare Informatics Research. 21, 4 (2015), 213.
[53]
Wüller, H., Behrens, J., Garthaus, M., Marquard, S. and Remmers, H. 2019. A scoping review of augmented reality in nursing. BMC Nursing. 18, 1 (May 2019), 19.
[54]
Zhu, E., Hadadgar, A., Masiello, I. and Zary, N. 2014. Augmented reality in healthcare education: an integrative review. PeerJ. 2, (2014), e469.

Cited By

View all
  • (2022)Measuring Decubitus Wounds Using Augmented Reality Glasses - A User Interface StudyHCI International 2022 – Late Breaking Posters10.1007/978-3-031-19679-9_64(512-519)Online publication date: 24-Nov-2022

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 6, Issue GROUP
GROUP
January 2022
992 pages
EISSN:2573-0142
DOI:10.1145/3511803
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 January 2022
Published in PACMHCI Volume 6, Issue GROUP

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. head mounted devices
  3. healthcare
  4. remote support
  5. teleconsultation

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Measuring Decubitus Wounds Using Augmented Reality Glasses - A User Interface StudyHCI International 2022 – Late Breaking Posters10.1007/978-3-031-19679-9_64(512-519)Online publication date: 24-Nov-2022

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media