More Web Proxy on the site http://driver.im/

research-article

NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization: Explanation of the software platform developed for 3D models visualization related with medical images using Augmented and Virtual Reality technology

Authors:

Santiago González Izard,

Óscar Alonso Plaza,

Ramiro Sánchez Torres,

Juan Antonio Juanes Méndez,

Francisco José García-PeñalvoAuthors Info & Claims

TEEM'19: Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality

Pages 459 - 467

https://doi.org/10.1145/3362789.3362936

Published: 16 October 2019 Publication History

Abstract

The visualization of the radiological results with more advanced techniques than the current ones, such as Augmented Reality and Virtual Reality technologies, represent a great advance for medical professionals, by eliminating their imagination capacity as an indispensable requirement for the understanding of medical images. The problem is that for its application it is necessary to segment the anatomical areas of interest, and this currently involves the intervention of the human being. The Nextmed project is presented as a complete solution that includes DICOM images import, automatic segmentation of certain anatomical structures, 3D mesh generation of the segmented area, visualization engine with Augmented Reality and Virtual Reality, all thanks to different software platforms that have been implemented and detailed, including results obtained from real patients. We will focus on the visualization platform using both Augmented and Virtual Reality technologies to allow medical professionals to work with 3d model representation of medical images in a different way taking advantage of new technologies.

References

[1]

Kido T, Kurata A, Higashino H, Sugawara Y, Okayama H, Higaki J, Anno H, Katada K, Mori S, Tanada S, Endo M, Mochizuki T (2007) Cardiac imaging using 256-detector row four-dimensional CT: preliminary clinical report. Radiat Med 25: 38--44

[2]

Meaney J, Goyen M (2007) Recent advances in contrast-enhanced magnetic resonance angiography. Eur Radiol 17(Suppl 2): B2--B6.

[3]

Osman Ratib, Antoine Rosset (2006). Open-source software in medical imaging: development of OsiriX. DOI 10.1007/s11548-006-0056-2

[4]

Adriaan, Germain (2011-08-16). 3dslicer. Brev Publishing. ISBN 9786136666464.

[5]

Doi K (2006) Diagnostic imaging over the last 50 years: research and development in medical imaging science and technology. Phys Med Biol 51: R5--R27

[6]

Kirchgeorg M, Prokop M (1998) Increasing spiral CT benefits with postprocessing applications. Eur J Radiol 28: 39--54

[7]

A. Hill, A. Thornham and C. J. Taylor (1997). Model-Based Interpretation of 3D Medical Images

[8]

Neeraj Sharma and Lalit M. Aggarwal (2010) Automated medical image segmentation techniques

[9]

Jeffrey H. Schuhaiber (2004) Augmented Reality in Surgery

[10]

BMJ 2001;323:912

[11]

Santiago González Izard., Juan Antonio Juanes Méndez, Pablo Ruisoto Palomera. Virtual Reality Educational Tool for Human Anatomy. J Med Syst (2017) 41: 76. https://doi.org/10.1007/s10916-017-0723-6

[12]

Santiago González Izard, Juan Antonio Juanes Méndez, Francisco José García Peñalvo, Jesús Mª Gonçalvez Estella, Mª José Sánchez Ledesma, Pablo Ruisoto Palomera. Virtual Reality as an Educational and Training Tool for Medicine. J Med Syst (2018) 42: 50. https://doi.org/10.1007/s10916-018-0900-2

[13]

Santiago González Izard and Juan Antonio Juanes Méndez. 2016. Virtual reality medical training system. In Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM '16), Francisco José García-Peñalvo (Ed.). ACM, New York, NY, USA, 479--485.

Digital Library

[14]

Santiago González Izard, Juan A. Juanes Méndez, Francisco J. García-Peñalvo, Marcelo Jiménez López, Francisco Pastor Vázquez, and Pablo Ruisoto. 2017. 360° vision applications for medical training. In Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2017), Juan Manuel Dodero, María Soledad Ibarra Sáiz, and Iván Ruiz Rube (Eds.). ACM, New York, NY, USA, Article 55, 7 pages.

Digital Library

[15]

Santiago González Izard, Juan Antonio Juanes Méndez, Jesús Mª Gonçalvez Estella, Mª José Sánchez Ledesma, Francisco J. García-Peñalvo, and Pablo Ruisoto. 2017. Virtual Simulation for Scoliosis Surgery. In Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2017), Juan Manuel Dodero, María Soledad Ibarra Sáiz, and Iván Ruiz Rube (Eds.). ACM, New York, NY, USA, Article 54, 8 pages.

Digital Library

[16]

Larobina, M., & Murino, L. (2014). Medical image file formats. Journal of digital imaging, 27(2), 200--206.

[17]

http://dicom.nema.org/medical/dicom/current/output/html/part05.html

[18]

Wheeler, G., Deng, S., Toussaint, N., Pushparajah, K., Schnabel, J., Simpson, J., Gomez, A. 2018. Virtual Interaction and Visualisation of 3D Medical Imaging Data with VTK and Unity, Healthcare Technology Letters.

[19]

Schroeder, W. J., Avila, L. S., & Hoffman, W. (2000). Visualizing with VTK: a tutorial. IEEE Computer graphics and applications, 20(5), 20--27.

[20]

Geveci, B., Schroeder, W., Brown, A., & Wilson, G. (2012). VTK. The Architecture of Open Source Applications, 1, 387--402.

[21]

Schroeder, W., Ng, L., & Cates, J. (2003). The ITK software guide.

[22]

Yoo, T. S., Ackerman, M. J., Lorensen, W. E., Schroeder, W., Chalana, V., Aylward, S., ... & Whitaker, R. (2002). Engineering and algorithm design for an image processing API: a technical report on ITK-the insight toolkit. Studies in health technology and informatics, 586--592.

[23]

Santiago González Izard, Juan Antonio Juanes Méndez, Pablo Ruisoto Palomera, Francisco J. García-Peñalvo. Applications of Virtual and Augmented Reality in Biomedical Imaging. J Med Syst (2019) 43: 102. https://doi.org/10.1007/s10916-019-1239-z

[24]

Santiago González Izard, Juan A. Juanes Méndez, Pablo Ruisoto, and Francisco José García-Peñalvo. 2018. NextMed: How to enhance 3D radiological images with Augmented and Virtual Reality. In Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'18), Francisco José García-Peñalvo (Ed.). ACM, New York, NY, USA, 397--404.

Digital Library

[25]

RH Creighton (2010). Unity 3D game development by example: A Seat-of-your-pants manual for building fun, groovy Little games quickly

[26]

S. L. Kim, H. J. Suk, J. H. Kang, J. M. Jung, T. H. Laine and J. Westlin, "Using Unity 3D to facilitate mobile augmented reality game development," 2014 IEEE World Forum on Internet of Things (WF-IoT), Seoul, 2014, pp. 21--26.

[27]

J. Xie, "Research on key technologies base Unity3D game engine," 2012 7th International Conference on Computer Science & Education (ICCSE), Melbourne, VIC, 2012, pp. 695--699.

[28]

S. Wang, Z. Mao, C. Zeng, H. Gong, S. Li and B. Chen, "A new method of virtual reality based on Unity3D," 2010 18th International Conference on Geoinformatics, Beijing, 2010, pp. 1--5.

[29]

F. Messaoudi, G. Simon and A. Ksentini, "Dissecting games engines: The case of Unity3D," 2015 International Workshop on Network and Systems Support for Games (NetGames), Zagreb, 2015, pp. 1--6.

[30]

Armato III, Samuel G., McLennan, Geoffrey, Bidaut, Luc, McNitt-Gray, Michael F., Meyer, Charles R., Reeves, Anthony P., ... Clarke, Laurence P. (2015). Data From LIDC-IDRI. The Cancer Imaging Archive. http://doi.org/10.7937/K9/TCIA.2015.LO9QL9SX

[31]

Vuforia. 2019. PTC augmented-reality. [ONLINE] Available at: https://www.ptc.com/en/products/augmented-reality. [Accessed 9 May 2019].

[32]

Alexandro Simonetti Ibañez, Josep Paredes Figueras (2013). Vuforia v1.5 SDK: Analysis and evaluation of capabilities

[33]

Parth Rajesh Desai, Pooja Nikhil Desai, Komal Deepak Ajmera, Khushbu Mehta (2014). A review Paper on Oculus Rift-A Virtual Reality Headset

[34]

Diederick C. Niehorster, Li Li, Markus Lappe (2017) The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research.

[35]

F. J. García-Peñalvo. 2014. Formación en la sociedad del conocimiento, un programa de doctorado con una perspectiva interdisciplinar. Education in the Knowledge Society 15, 1, 4--9

[36]

F. J. García-Peñalvo. 2015. Engineering contributions to a Knowledge Society multicultural perspective. IEEE Revista Iberoamericana de Tecnologías del Aprendizaje (IEEE RITA) 10, 1, 17--18.

Cited By

Santos BTrevisan D(2023)Overview and Tendencies of Augmented Reality Applications in MedicineProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625013(26-37)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625013
Minopoulos GMemos VStergiou CStergiou KPlageras AKoidou MPsannis K(2022)Exploitation of Emerging Technologies and Advanced Networks for a Smart Healthcare SystemApplied Sciences10.3390/app1212585912:12(5859)Online publication date: 9-Jun-2022
https://doi.org/10.3390/app12125859
Pires FCosta CDias P(2021)On the Use of Virtual Reality for Medical Imaging VisualizationJournal of Digital Imaging10.1007/s10278-021-00480-zOnline publication date: 29-Jul-2021
https://doi.org/10.1007/s10278-021-00480-z
Show More Cited By

Index Terms

NextMed, Augmented and Virtual Reality platform for 3D medical imaging visualization: Explanation of the software platform developed for 3D models visualization related with medical images using Augmented and Virtual Reality technology
1. Applied computing
  1. Life and medical sciences
    1. Health informatics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

SelectVisAR: Selective Visualisation of Virtual Environments in Augmented Reality
DIS '21: Proceedings of the 2021 ACM Designing Interactive Systems Conference

When establishing a visual connection between a virtual reality user and an augmented reality user, it is important to consider whether the augmented reality user faces a surplus of information. Augmented reality, compared to virtual reality, involves ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Interactive Augmented Live Virtual Reality Streaming: A Health Care Application
ICMHI '18: Proceedings of the 2nd International Conference on Medical and Health Informatics

Virtual Reality (VR) technology has been around for decades; however, we have probably only begun to realize the practical applications until recent years. With increase of computing power, decrease of cost and physical dimension, a new class of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEEM'19: Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality

October 2019

1085 pages

ISBN:9781450371919

DOI:10.1145/3362789

Editors:
Miguel Ángel Conde González
Universidad de León
,
Francisco Jesús Rodríguez Sedano
Universidad de León
,
Camino Fernández Llamas
Universidad de León
,
Francisco José García-Peñalvo
Universidad de Salamanca

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

University of Salamanca: University of Salamanca

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Agencia Estatal de Investigación

Conference

TEEM'19

TEEM'19: Technological Ecosystems for Enhancing Multiculturality

October 16 - 18, 2019

León, Spain

Acceptance Rates

Overall Acceptance Rate 496 of 705 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
324
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)3

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Santos BTrevisan D(2023)Overview and Tendencies of Augmented Reality Applications in MedicineProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625013(26-37)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625013
Minopoulos GMemos VStergiou CStergiou KPlageras AKoidou MPsannis K(2022)Exploitation of Emerging Technologies and Advanced Networks for a Smart Healthcare SystemApplied Sciences10.3390/app1212585912:12(5859)Online publication date: 9-Jun-2022
https://doi.org/10.3390/app12125859
Pires FCosta CDias P(2021)On the Use of Virtual Reality for Medical Imaging VisualizationJournal of Digital Imaging10.1007/s10278-021-00480-zOnline publication date: 29-Jul-2021
https://doi.org/10.1007/s10278-021-00480-z
González Izard SSánchez Torres RAlonso Plaza ÓJuanes Méndez JGarcía-Peñalvo F(2020)Nextmed: Automatic Imaging Segmentation, 3D Reconstruction, and 3D Model Visualization Platform Using Augmented and Virtual RealitySensors10.3390/s2010296220:10(2962)Online publication date: 23-May-2020
https://doi.org/10.3390/s20102962
Pamparău CVatavu R(2020)A Research Agenda Is Needed for Designing for the User Experience of Augmented and Mixed Reality: A Position PaperProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3432088(323-325)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3432088

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents