More Web Proxy on the site http://driver.im/

research-article

NextMed: How to enhance 3D radiological images with Augmented and Virtual Reality

Authors:

Santiago González Izard,

Juan A. Juanes Méndez,

Francisco José García-PeñalvoAuthors Info & Claims

TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

Pages 397 - 404

https://doi.org/10.1145/3284179.3284247

Published: 24 October 2018 Publication History

Abstract

CT and MR scans are used to understand diseases, so every new technology that makes it easier to study the results of these scans can help doctors reach a diagnosis. Nowadays, there are several systems that are able to create and visualize the scan results as a 3D model, however the latest technologies for 3D visualization are not being used yet. We have designed a software to visualize the 3D models created using DICOM images from CT and MR scan results. This Augmented and Virtual Reality system not only allows doctors to visualize the 3D models, but also to manipulate them in order to, for example, cut them and study the inside to plan a surgical approach. The system is fully prepared for the integration in the daily activity of doctors and radiologists, including a cloud platform and the visualization system to easily manipulate the 3D models generated.

References

[1]

Calzado, J. Geleijns (December 2010). "Computed Tomography. Evolution, technical principles and applications". Revista de física médica. ISSN 1576-6632.

[2]

Berrington de González A, Mahesh M, Kim KP, Bhargavan M, Lewis R, Mettler F, Land C (December 2009). "Projected cancer risks from computed tomographic scans performed in the United States in 2007". Arch. Intern. Med. 169 (22): 2071-7. PMID 20008689.

[3]

N. Solange P. Sabalisck. Reconstrucción y clasificación de estructuras anatómicas a partir de secuencias de imágenes ecográficas. Universidad de Las Palmas de Gran Canaria.

[4]

B. M. Hemminger, P. L. Molina, T. H. Egan, F.C. Detterbeck, K. E. Muller, C. S. Coffey, J. K. T. Lee. Assessment of Real-Time 3D Visualization for Cardiothoracic Diagnostic Evaluation and Surgery Planning. April, 2005.

[5]

S. González Izard, J.A. Juanes Méndez (Nov. 2016). Virtual reality medical training system. Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality.

Digital Library

[6]

H. Petterson, D. Sinkvist, C. Wang, Ö. Smedby (April 2009). Web-based interactive 3D visualization as a tool for improved anatomy learning. Anatomical Sciences Education, Vol. 2, Issue 2, pages 61--68.

[7]

M. J. Alegría Martín (2015). Aplicaciones de la realidad aumentada en el ámbito de la Enseñanza Superior. Diseño de un proyecto piloto. Cuadernos de Gestión de Información, 5, p18--35. ISSN 2253-8429

[8]

J. Hong (Nov, 2016). Hanyang Med Rev., 36(4):242--247. Department of Robotics Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Daegu, South Korea.

[9]

S. González Izard, J.A. Juanes Méndez, P. R. Palomera. J Med Syst (2017) 41: 76.

[10]

S. González Izard, J.A. Juanes Méndez, J. M. Gonçalvez Estella, M.J. Sánchez Ledesma, F. J. García-Peñalvo, P. Ruisoto, Virtual Simulation for Scoliosis Surgery, Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality, p.1--8, October 18-20, 2017, Cádiz, Spain.

Digital Library

[11]

J. Belda (May 2015). Leap Motion (II): principio de funcionamiento. Showleap Technologies. Recuperado de http://blog.showleap.com/2015/05/leap-motion-ii-principio-de-funcionamiento/

[12]

G. Marin, F. Dominio, P. Zanuttigh (October 2014). Hand gesture recognition with leap motion and kinect devices. Image Processing (ICIP), 2014 IEEE International Conference on.

[13]

A. Manolova, System for touchless interaction with medical images in surgery using Leap Motion. Radiocommunications and Videotechnologies Department Faculty of Telecommunications, Technical University of Sofia. Communications, Electromagnetics and Medical Applications (CEMA'14).

[14]

Dr. Mike (July 2015). 3D Printing in Medicine. "How to Create 3D Printable Models from Medical Scans in 30 Minutes Using Free Software: Osirix, Blender, and Meshmixer". Recuperado de https://www.embodi3d.com/blogs/entry/193-how-to-create-3d-printable-models-from-medical-scans-in-30-minutes-using-free-software-osirix-blender-and-meshmixer/

[15]

F. Andriy et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magnetic Resonance Imaging, Volume 30, Issue 9, 1323--1341

[16]

C. De Alfonso, I. Blanquer, D. Segrelles, V. Hernández. VRSUR: Simulación quirúrgica sobre escenarios realistas. IX Congreso Nacional de Informática Médica.

[17]

C. M. Müller-Karger, M. Cerrolaza (Nov 2001). Un nuevo método para la simulación de la estructura ósea mediante la versión P de elementos finitos. Scielo. IMME, Caracas, v. 39, n. 3, p. 23--54.

[18]

E. Sierra Martínez, R. Cienfuegos Monroy, G. Fernández Sobrino. OsiriX, visor DICOM útil para procesar imágenes tomográficas de fracturas faciales. Medigraphic Artemisa.

[19]

F. J. García-Peñalvo, M. S. Ramírez-Montoya, and A. García-Holgado. 2017. TEEM 2017 Doctoral Consortium Track. In Fifth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'17) (Cádiz, Spain, October 18-20, 2017) J.M. Dodero, M.S. Ibarra Sáiz and I. Ruiz Rube Eds. ACM, New York, NY, USA, Article 93.

Digital Library

[20]

S. González Izard, J. A. Juanes, F. J. García-Peñalvo, J. M. Gonçalvez Estella, M. J. Sánchez Ledesma, and P. Ruisoto. 2018. Virtual Reality as an Educational and Training Tool for Medicine. Journal of Medical Systems 42(February 01).

Digital Library

[21]

F. J. García-Peñalvo. 2014. Formación en la sociedad del conocimiento, un programa de doctorado con una perspectiva interdisciplinar. Education in the Knowledge Society 15, 1, 4--9

[22]

F. J. García-Peñalvo. 2017. Education in the Knowledge Society PhD Programme. 2017 Kick-off Meeting. In Proceedings of the Seminarios del Programa de Doctorado en Formación en la Sociedad del Conocimiento (16 de noviembre de 2017) (Salamanca, España2017). Instituto Universitario de Ciencias de la Educación

[23]

F. J. García-Peñalvo. 2013. Education in knowledge society: A new PhD programme approach. In Proceedings of the First International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'13) (Salamanca, Spain, November 14-15, 2013), F.J. García-Peñalvo Ed. ACM, New York, NY, USA, 575--577.

Digital Library

Cited By

Trévia RTeixeira VPinho M(2024)Investigating Radiological Diagnosis Through Smartphone-Based Virtual Reality Applications: A User Study2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC61105.2024.00339(2119-2124)Online publication date: 2-Jul-2024
https://doi.org/10.1109/COMPSAC61105.2024.00339
Bhat SHareesha KKamath AKudva AVineetha RNair A(2024)A Framework to Enhance the Experience of CBCT Data in Real-Time Using Immersive Virtual Reality: Impacting Dental Pre-Surgical PlanningIEEE Access10.1109/ACCESS.2024.337577012(45442-45455)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3375770
Mantri MTaran SSunder G(2022)DICOM Integration Libraries for Medical Image Interoperability: A Technical ReviewIEEE Reviews in Biomedical Engineering10.1109/RBME.2020.304264215(247-259)Online publication date: 2022
https://doi.org/10.1109/RBME.2020.3042642
Show More Cited By

Index Terms

NextMed: How to enhance 3D radiological images with Augmented and Virtual Reality

Recommendations

NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization: Explanation of the software platform developed for 3D models visualization related with medical images using Augmented and Virtual Reality technology
TEEM'19: Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality

The visualization of the radiological results with more advanced techniques than the current ones, such as Augmented Reality and Virtual Reality technologies, represent a great advance for medical professionals, by eliminating their imagination capacity ...
Garden: A Mixed Reality Experience Combining Virtual Reality and 3D Reconstruction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Garden is a Mixed Reality (MR) experience that combines both Virtual Reality (VR) and Augmented Reality (AR), and lets players transform their environment into a virtual garden they can play in. This is done by doing both stereoscopic rendering and 3D ...
Hybrid avatars: enabling co-presence in multiple realities
Web3D '16: Proceedings of the 21st International Conference on Web3D Technology

Virtual reality (VR) and augmented reality (AR) technologies are quickly making their way into people's everyday lives. Typically, these technologies are used separately to create either plain VR or AR applications rather than harnessing the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

October 2018

1072 pages

ISBN:9781450365185

DOI:10.1145/3284179

Editor:
Francisco José García-Peñalvo
University of Salamanca

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

University of Salamanca: University of Salamanca

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

TEEM'18

TEEM'18: Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

October 24 - 26, 2018

Salamanca, Spain

Acceptance Rates

TEEM'18 Paper Acceptance Rate 151 of 243 submissions, 62%;

Overall Acceptance Rate 496 of 705 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
180
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Trévia RTeixeira VPinho M(2024)Investigating Radiological Diagnosis Through Smartphone-Based Virtual Reality Applications: A User Study2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC61105.2024.00339(2119-2124)Online publication date: 2-Jul-2024
https://doi.org/10.1109/COMPSAC61105.2024.00339
Bhat SHareesha KKamath AKudva AVineetha RNair A(2024)A Framework to Enhance the Experience of CBCT Data in Real-Time Using Immersive Virtual Reality: Impacting Dental Pre-Surgical PlanningIEEE Access10.1109/ACCESS.2024.337577012(45442-45455)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3375770
Mantri MTaran SSunder G(2022)DICOM Integration Libraries for Medical Image Interoperability: A Technical ReviewIEEE Reviews in Biomedical Engineering10.1109/RBME.2020.304264215(247-259)Online publication date: 2022
https://doi.org/10.1109/RBME.2020.3042642
Trevia RPinho M(2021)Virtual Reality in Radiology: A Systematic Mapping StudyProceedings of the 23rd Symposium on Virtual and Augmented Reality10.1145/3488162.3488224(177-181)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3488162.3488224
González Izard SSánchez Torres RAlonso Plaza ÓJuanes Méndez JGarcía-Peñalvo F(2020)Nextmed: Automatic Imaging Segmentation, 3D Reconstruction, and 3D Model Visualization Platform Using Augmented and Virtual RealitySensors10.3390/s2010296220:10(2962)Online publication date: 23-May-2020
https://doi.org/10.3390/s20102962
Ameur SBen Khalifa ABouhlel M(2020)Chronological pattern indexing: An efficient feature extraction method for hand gesture recognition with Leap MotionJournal of Visual Communication and Image Representation10.1016/j.jvcir.2020.10284270(102842)Online publication date: Jul-2020
https://doi.org/10.1016/j.jvcir.2020.102842
Izard SPlaza ÓTorres RMéndez JGarcía-Peñalvo F(2019)NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualizationProceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality10.1145/3362789.3362936(459-467)Online publication date: 16-Oct-2019
https://dl.acm.org/doi/10.1145/3362789.3362936

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents