short-paper

Shape Recognition and Selection in Medical Volume Visualisation with Haptic Gloves

Authors:

Vahid Pooryousef,

Ross Brown,

Selen TurkayAuthors Info & Claims

OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction

Pages 433 - 436

https://doi.org/10.1145/3369457.3369508

Published: 10 January 2020 Publication History

Get Access

Abstract

Volume-visualised medical images are translucent objects that are hard to perceive accurately. Yet 2D image segmentation is used to distinguish some parts of the volume and make them more understandable. Many studies have proposed haptic feedbacks to find organs inside the body, but it is not easy to feel the shape of the part with using those devices. We realised that better results can be achieved via devices with more than one-point feedback. We describe a method that makes a user feel the shape in the same way we perceive the shape of an object in a dark room with the help of our tactile sense. Hence modern haptic devices such as "HaptX" and "Manus VR" gloves help us to imagine organ shapes by controlling the amount of forces on each fingertip. Another method is also proposed that guides a user to select intended parts of a volume, which is a fast manual segmentation tool but in an immersive VR or AR environment with a much more convenient interface.

References

[1]

R. S. Avila and L. M. Sobierajski. 1996. A haptic interaction method for volume visualization. In Proceedings of Seventh Annual IEEE Visualization '96. IEEE, San Francisco, CA, USA, 197--204.

Crossref

Google Scholar

[2]

S. Chan, N. H. Blevins, and K. Salisbury. 2013. Deformable haptic rendering for volumetric medical image data. In 2013 World Haptics Conference (WHC). IEEE, Daejeon, South Korea, 73--78.

Crossref

Google Scholar

[3]

R. A. Drebin, L. Carpenter, and P. Hanrahan. 1988. Volume Rendering. ACM Siggraph Computer Graphics 22, 4 (Aug. 1988), 65--74.

Digital Library

Google Scholar

[4]

A. Elnakib, G. Gimel'Farb, J. S. Suri, and A. El-Baz. 2011. Medical Image Segmentation: A Brief Survey. Multi Modality State-of-the-Art Medical Image Segmentation and Registration Methodologies. Springer, New York.

Crossref

Google Scholar

[5]

S. Holland. (May 2019). The HaptX Gloves: 'Hands-on' Haptic VR and How it Works. Retrived August 3, 2019 from https://www.electronicspoint.com/product-highlights/the-haptx-gloves-hands-on-haptic-vr-and-how-it-works/

Google Scholar

[6]

R. L. Klatzky and S. J. Lederman. 2007. Object Recognition by Touch. Blindness and brain plasticity in navigation and object perception (1st. ed.). Lawrence Erlbaum, NewYork.

Google Scholar

[7]

S. A. Panëels, J. C. Roberts, and P. J. Rodgers. 2009. Haptic Interaction Techniques for Exploring Chart Data. In International Conference on Haptic and Audio Interaction Design (HAID 2009). Lecture Notes in Computer Science, vol. 5763, Springer, Berlin, Heidelberg, 31--40.

Digital Library

Google Scholar

[8]

J. Perret and E. B. Vander Poorten. 2018. Touching Virtual Reality: A Review of Haptic Gloves. ACTUATOR 2018; 16th International Conference on New Actuators. VDE, Bremen, Germany, 1--5.

Google Scholar

[9]

A. Prouzeau, M. Cordeil, C. Robin, B. Ens, B. H. Thomas, and T. Dwyer. 2019. Scaptics and Highlight-Planes: Immersive Interaction Techniques for Finding Occluded Features in 3D Scatterplots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12.

Digital Library

Google Scholar

[10]

Sh. Rasool and A. Sourin. 2011. Haptic interaction with 2D images. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI '11). Association for Computing Machinery, New York, NY, USA, 13--22.

Digital Library

Google Scholar

[11]

M. Shigapov, V. Kugurakova, and E. Zykov. 2018. Design of Digital Gloves with Feedback for VR. 2018 IEEE East-West Design & Test Symposium (EWDTS). IEEE, Kazan, Russia, 1--5.

Crossref

Google Scholar

[12]

R. Shih, A. Dubrowski, and H. Carnahan. 2009. Evidence for haptic memory. In World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, Salt Lake City, UT, USA, 145--149.

Digital Library

Google Scholar

[13]

S. Ullrich and T. Kuhlen. 2012. Haptic Palpation for Medical Simulation in Virtual Environments. IEEE Transactions on Visualization and Computer Graphics 18, 4 (Apr. 2012), 617--625.

Digital Library

Google Scholar

[14]

P. Vávra, J. Roman, P. Zonča, P. Ihnát, M. Němec, J. Kumar, N. Habib and A. El-Gendi, 2017. Recent Development of Augmented Reality in Surgery: A Review. Journal of Healthcare Engineering (Aug. 2017), 1--9.

Crossref

Google Scholar

Cited By

View all

Pooryousef VCordeil MBesançon LBassed RDwyer T(2024)Collaborative Forensic Autopsy Documentation and Supervised Report Generation Using a Hybrid Mixed-Reality Environment and Generative AIIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345621230:11(7452-7462)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456212
Minopoulos GMemos VStergiou KStergiou CPsannis K(2023)A Medical Image Visualization Technique Assisted with AI-Based Haptic Feedback for Robotic Surgery and HealthcareApplied Sciences10.3390/app1306359213:6(3592)Online publication date: 11-Mar-2023
https://doi.org/10.3390/app13063592
Pooryousef VCordeil MBesançon LHurter CDwyer TBassed R(2023)Working with Forensic Practitioners to Understand the Opportunities and Challenges for Mixed-Reality Digital AutopsyProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580768(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580768
Show More Cited By

Index Terms

Shape Recognition and Selection in Medical Volume Visualisation with Haptic Gloves
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Image segmentation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
  2. Visualization
    1. Visualization application domains
      1. Information visualization

Recommendations

Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays
UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Virtual and augmented reality headsets are making significant progress in audio-visual immersion and consumer adoption. However, their haptic immersion remains low, due in part to the limitations of vibrotactile actuators which dominate the AR/VR ...
Virtual Reality Learning Environment with Haptic Gloves
ICEDS '22: Proceedings of the 2022 3rd International Conference on Education Development and Studies

Several new types of sense gloves have been developed in recent years. These can generate a dynamically changing haptic force for each individual finger and can be effectively integrated with virtual environments that contain new applications. This ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction

December 2019

631 pages

ISBN:9781450376969

DOI:10.1145/3369457

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

HFESA: Human Factors and Ergonomics Society of Australia Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 January 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

OZCHI'19

OZCHI'19: 31ST AUSTRALIAN CONFERENCE ON HUMAN-COMPUTER-INTERACTION

December 2 - 5, 2019

WA, Fremantle, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
230
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pooryousef VCordeil MBesançon LBassed RDwyer T(2024)Collaborative Forensic Autopsy Documentation and Supervised Report Generation Using a Hybrid Mixed-Reality Environment and Generative AIIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345621230:11(7452-7462)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456212
Minopoulos GMemos VStergiou KStergiou CPsannis K(2023)A Medical Image Visualization Technique Assisted with AI-Based Haptic Feedback for Robotic Surgery and HealthcareApplied Sciences10.3390/app1306359213:6(3592)Online publication date: 11-Mar-2023
https://doi.org/10.3390/app13063592
Pooryousef VCordeil MBesançon LHurter CDwyer TBassed R(2023)Working with Forensic Practitioners to Understand the Opportunities and Challenges for Mixed-Reality Digital AutopsyProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580768(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580768
Minopoulos GMemos VStergiou CStergiou KPlageras AKoidou MPsannis K(2022)Exploitation of Emerging Technologies and Advanced Networks for a Smart Healthcare SystemApplied Sciences10.3390/app1212585912:12(5859)Online publication date: 9-Jun-2022
https://doi.org/10.3390/app12125859

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays

Virtual Reality Learning Environment with Haptic Gloves

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality