Abstract
Despite considerable technical and algorithmic developments related to the fields of medical image acquisition and processing in the past decade, the devices used for visualization of medical images have undergone rather minor changes. As anatomical information is typically shown on monitors provided by a radiological work station, the physician has to mentally transfer internal structures shown on the screen to the patient. In this work, we present a new approach to on-patient visualization of 3D medical images, which combines the concept of augmented reality (AR) with an intuitive interaction scheme. The method requires mounting a Time-of-Flight (ToF) camera to a portable display (e.g., a tablet PC). During the visualization process, the pose of the camera and thus the viewing direction of the user is continuously determined with a surface matching algorithm. By moving the device along the body of the patient, the physician gets the impression of being able to look directly into the human body. The concept can be used for intervention planning, anatomy teaching and various other applications that require intuitive visualization of 3D data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Navab N, et al. Action- and workflow-driven augmented reality for computer-aided medical procedures. IEEE Comput Graph Appl. 2007;27(5):10–4.
Sugimoto M, et al. Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery. J Hepatobiliary Pancreat Sci. 2010;17(5):629–36.
Kolb A, et al. Time-of-Flight Sensors in Computer Graphics. In: Proc Eurographics; 2009. p. 119–34.
Seitel A, et al. Adaptive bilateral filter for image denoising and its application to in-vitro Time-of-Flight data. Proc SPIE. 2011;(in press).
dos Santos TR, et al. Correspondences search for surface-based intra-operative registration. Lect Notes Computer Sci. 2010;6362:660–7.
Maier-Hein L, et al. Accounting for anisotropic noise in fine registration of Timeof-Flight range data with high-resolution surface data. Lect Notes Computer Sci. 2010;6361:251–8.
Tietjen C, et al. GPU-basierte Smart Visibility Techniken für die Planung von Tumor-Operationen. Proc BVM. 2009; p. 272–276.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Maier-Hein, L. et al. (2011). Towards Mobile Augmented Reality for On-Patient Visualization of Medical Images. In: Handels, H., Ehrhardt, J., Deserno, T., Meinzer, HP., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2011. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19335-4_80
Download citation
DOI: https://doi.org/10.1007/978-3-642-19335-4_80
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19334-7
Online ISBN: 978-3-642-19335-4
eBook Packages: Computer Science and Engineering (German Language)