More Web Proxy on the site http://driver.im/

research-article

Put That Needle There: Customized Flexible On-Body Thin-Film Displays for Medical Navigation

Authors:

Anke V. Reinschluessel,

Markus Willems,

Nils Langhorst,

Christian Rieder,

Rainer MalakaAuthors Info & Claims

ACM Transactions on Computing for Healthcare , Volume 1, Issue 3

Article No.: 16, Pages 1 - 17

https://doi.org/10.1145/3386307

Published: 30 May 2020 Publication History

Abstract

Informed by modern imaging techniques, current medical navigation systems support physicians during a variety of interventions, such as needle-based operations. During these, an abundance of information is often displayed on monitors placed in positions that are uncomfortable for the operator to view. In this article, we address these issues with the concept and prototype of a customized flexible display that is placed on the patient’s body to provide the essential information at just the right location. We present an empirical evaluation comparing the flexible display against a control condition using a standard interventional monitor setup and an additional condition that combines both. Our results show that the flexible display significantly reduces task load while improving overall usability. Furthermore, we found indications that the flexible display reduces task completion time while also observing a negative effect on accuracy, which needs to be balanced carefully.

References

[1]

Fred S. Azar, Nathalie Perrin, Ali Khamene, Sebastian Vogt, and Frank Sauer. 2004. User performance analysis of different image-based navigation systems for needle placement procedures. In Proceedings of SPIE, Vol. 5367. 110--121.

[2]

Holger Baethis. 2013. Brainlab Dash®: iPod®-based navigation system in total knee and hip replacements. In Computer and Template Assisted Orthopedic Surgery. Springer, Berlin, Germany, 89--95.

[3]

W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, et al. 2002. A head-mounted operating binocular for augmented reality visualization in medicine—Design and initial evaluation. IEEE Transactions on Medical Imaging 21, 8 (Aug. 2002), 991--997.

[4]

Noemi Bitterman. 2006. Technologies and solutions for data display in the operating room. Journal of Clinical Monitoring and Computing 20, 3 (May 2006), 165--173.

[5]

D. Black, J. Al Issawi, C. Hansen, C. Rieder, and H. Hahn. 2013. Auditory support for navigated radiofrequency ablation. In Proceedings of the CURAC Annual Meeting. 30.

[6]

David Black, Christian Hansen, Arya Nabavi, Ron Kikinis, and Horst Hahn. 2017. A survey of auditory display in image-guided interventions. International Journal of Computer Assisted Radiology and Surgery 12, 10 (March 2017), 1665--1676.

[7]

David Black, Julian Hettig, Maria Luz, Christian Hansen, Ron Kikinis, and Horst Hahn. 2017. Auditory feedback to support image-guided medical needle placement. International Journal of Computer Assisted Radiology and Surgery 12, 9 (Sept. 2017), 1655--1663.

[8]

John Brooke. 1996. SUS—A quick and dirty usability scale. In Usability Evaluation in Industry. Taylor 8 Francis, London, England.

[9]

Florian Echtler, Fabian Sturm, Kay Kindermann, Gudrun Klinker, Joachim Stilla, Joern Trilk, and Hesam Najafi. 2004. The intelligent welding gun: Augmented reality for experimental vehicle construction. In Virtual and Augmented Reality Applications in Manufacturing, S. K. Ong and A. Y. C. Nee (Eds.). Springer, London, England, 333--360.

[10]

P. J. Edwards, D. J. Hawkes, D. L. Hill, D. Jewell, R. Spink, A. Strong, and M. Gleeson. 1995. Augmentation of reality using an operating microscope for otolaryngology and neurosurgical guidance. Computer Aided Surgery 1, 3 (Jan. 1995), 172--178.

[11]

Luke Franzke. 2013. Decay Designing Ephemeral Interactive Devices. Master’s Thesis. Zürcher Hochschule der Künste.

[12]

Henry Fuchs, Mark A. Livingston, Ramesh Raskar, D’nardo Colucci, Kurtis Keller, Andrei State, Jessica R. Crawford, Paul Rademacher, Samuel H. Drake, and Anthony A. Meyer. 1998. Augmented reality visualization for laparoscopic surgery. In Medical Image Computing and Computer-Assisted Intervention—MICCAI’98. Lecture Notes in Computer Science, Vol. 1496. Springer, 934--943.

[13]

Kate Alicia Gavaghan, Sylvain Anderegg, Matthias Peterhans, Thiago Oliveira-Santos, and Stefan Weber. 2012. Augmented reality image overlay projection for image guided open liver ablation of metastatic liver cancer. In Augmented Environments for Computer-Assisted Interventions. Springer, 36--46.

[14]

Christian Hansen, David Black, Christoph Lange, Fabian Rieber, Wolfram Lamade, Marcello Donati, Karl J. Oldhafer, and Horst K. Hahn. 2013. Auditory support for resection guidance in navigated liver surgery. International Journal of Medical Robotics and Computer Assisted Surgery 9, 1 (March 2013), 36--43.

[15]

Christian Hansen, Jan Wieferich, Felix Ritter, Christian Rieder, and Heinz-Otto Peitgen. 2009. Illustrative visualization of 3D planning models for augmented reality in liver surgery. International Journal of Computer Assisted Radiology and Surgery 5, 2 (June 2009), 133--141.

[16]

Sandra G. Hart and Lowell E. Stavenland. 1988. Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Human Mental Workload. Elsevier, 139--183.

[17]

Marc Herrlich, Jöran Benker, David Black, Frank Dylla, and Rainer Malaka. 2015. Tool-mounted ring displays for intraoperative navigation. In Tagungsband der 14. Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie (CURAC). Deutsche Gesellschaft für Computer- und Roboterassistierte Chirurgie e.V. (CURAC), 273--278.

[18]

Marc Herrlich, Parnian Tavakol, David Black, Dirk Wenig, Christian Rieder, Rainer Malaka, and Ron Kikinis. 2017. Instrument-mounted displays for reducing cognitive load during surgical navigation. International Journal of Computer Assisted Radiology and Surgery 12, 9 (Sept. 2017), 1599--1605.

[19]

Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and challenges for data physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, New York, NY, 3227--3236.

Digital Library

[20]

Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly prototyping on-skin user interfaces using skin-friendly materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC’16). ACM, New York, NY, 16--23.

[21]

Mustafa Emre Karagozler, Ivan Poupyrev, Gary K. Fedder, and Yuri Suzuki. 2014. Paper generators: Harvesting energy from touching, rubbing and sliding. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST’14). 161--162.

[22]

Kevin Kassil and A. James Stewart. 2009. Evaluation of a tool-mounted guidance display for computer-assisted surgery. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, NY, 1275--1278.

[23]

Konstantin Klamka and Raimund Dachselt. 2017. IllumiPaper: Illuminated interactive paper. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI’17). ACM, New York, NY, 5605--5618.

Digital Library

[24]

Uli Mezger, Claudia Jendrewski, and Michael Bartels. 2013. Navigation in surgery. Langenbeck’s Archives of Surgery 398, 4 (Feb. 2013), 501--514.

[25]

Simon Olberding, Michael Wessely, and Juergen Steimle. 2014. PrintScreen: Fabricating highly customizable thin-film touch-displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST’14). ACM, New York, NY, 281--290.

Digital Library

[26]

Anke V. Reinschluessel, Marc Herrlich, Tanja Döring, Mark Vangel, Clare Tempany, Rainer Malaka, and Junichi Tokuda. 2018. Insert needle here! A custom display for optimized biopsy needle placement. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI’18). ACM, New York, NY, 263.

Digital Library

[27]

Andrea Schenk, A. Koehn, R. Matsuyama, and I. Endo. 2013. Transfer of liver surgery planning into the operating room: Initial experience with the iPad. In Proceedings of the 10th Congress of the European-African Hepato Pancreato Biliary Association (E-AHPBA’13).

[28]

Andrei State, Mark A. Livingston, William F. Garrett, Gentaro Hirota, Mary C. Whitton, Etta D. Pisano, and Henry Fuchs. 1996. Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’96). ACM, New York, NY, 439--446.

[29]

G. D. Stetten and V. S. Chib. 2001. Overlaying ultrasonographic images on direct vision. Journal of Ultrasound in Medicine 20, 3 (March 2001), 235--240.

[30]

Philipp J. Stolka, Pezhman Foroughi, Matthew Rendina, Clifford R. Weiss, Gregory D. Hager, and Emad M. Boctor. 2014. Needle guidance using handheld stereo vision and projection for ultrasound-based interventions. Medical Image Computing and Computer-Assisted Intervention 17, Pt. 2 (2014), 684--691.

[31]

Joerg Traub, Philipp Stefan, Sandro Michael Heining, Tobias Sielhorst, Christian Riquarts, Ekkehard Euler, and Nassir Navab. 2006. Hybrid navigation interface for orthopedic and trauma surgery. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2006. Lecture Notes in Computer Science, Vol. 4190. Springer, 373--380.

[32]

Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Juergen Steimle. 2015. iSkin: Flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI’15). ACM, New York, NY, 2991--3000.

Digital Library

[33]

M. Whelan. 2013. Using Electric Current Through a Phosphor or Semiconductor. Retrieved March 30, 2020 from http://edisontechcenter.org/electroluminescent.html.

Cited By

Heinrich FSchwenderling LJoeres FHansen C(2022)2D versus 3D: A Comparison of Needle Navigation Concepts between Augmented Reality Display Devices2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00045(260-269)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00045
Heinrich FSchwenderling LJoeres FLawonn KHansen C(2020)Comparison of Augmented Reality Display Techniques to Support Medical Needle InsertionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302363726:12(3568-3575)Online publication date: Dec-2020
https://doi.org/10.1109/TVCG.2020.3023637

Index Terms

Put That Needle There: Customized Flexible On-Body Thin-Film Displays for Medical Navigation

Recommendations

Vibro-Band: Supporting Needle Placement for Physicians with Vibrations
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

Medical images and navigation systems support physicians during needle-based interventions. As the information is primarily displayed on monitors, the physician's attention is drawn away from the patient's body. To address this issue, we explore the ...
Insert Needle Here! A Custom Display for Optimized Biopsy Needle Placement
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Needle-guiding templates are used for a variety of minimally invasive medical interventions. While physically supporting needle placement with a grid of holes, they lack integrated information where needles need to be inserted. Physicians must manually ...
PrintScreen: fabricating highly customizable thin-film touch-displays
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

PrintScreen is an enabling technology for digital fabrication of customized flexible displays using thin-film electroluminescence (TFEL). It enables inexpensive and rapid fabrication of highly customized displays in low volume, in a simple lab ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computing for Healthcare

ACM Transactions on Computing for Healthcare Volume 1, Issue 3

July 2020

152 pages

EISSN:2637-8051

DOI:10.1145/3403604

Editors:
Insup Lee
University of Pennsylvania, USA
,
John A. Stankovic
University of Virginia, USA

Issue’s Table of Contents

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 May 2020

Online AM: 07 May 2020

Accepted: 01 February 2020

Revised: 01 December 2019

Received: 01 February 2019

Published in HEALTH Volume 1, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Institutes of Health
Klaus Tschira Foundation
German “Exzellenzinitiative” at the University of Bremen

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
286
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Heinrich FSchwenderling LJoeres FHansen C(2022)2D versus 3D: A Comparison of Needle Navigation Concepts between Augmented Reality Display Devices2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00045(260-269)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00045
Heinrich FSchwenderling LJoeres FLawonn KHansen C(2020)Comparison of Augmented Reality Display Techniques to Support Medical Needle InsertionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302363726:12(3568-3575)Online publication date: Dec-2020
https://doi.org/10.1109/TVCG.2020.3023637

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents