Estimating mechanical properties of soft objects using surface measurements from AR headsets
Authors: 
Max Dang Vu, Gonzalo Daniel Maso Talou, Huidong Bai, Mark Billinghurst, Poul Michael FøNss Nielsen, Martyn Peter Nash, Thiranja Prasad Babarenda GamageAuthors Info & Claims
Article No.: 60, Pages 1 - 2
Abstract
Physics-driven predictions of soft tissue mechanics are vital for various medical interventions. Insights on the mechanical properties of soft tissues are essential for obtaining personalised predictions from these models. This study aims to provide a workflow to identify the material parameters of soft homogeneous materials under gravity loading using 3D surface geometrical measurements acquired from a wearable augmented reality (AR) headset’s depth camera. Preliminary results show that the parameter estimation procedure can successfully recover the ground truth material parameter C1 of a cantilever beam using synthetic surface data. This workflow could be used for real-time navigational guidance during soft tissue treatment procedures.
References
[1]
T.P. Babarenda Gamage, D.T.K. Malcolm, G.D. Maso Talou, A. Mîra, A. Doyle, P.M.F. Nielsen, and M.P. Nash. 2019. An automated computational biomechanics workflow for improving breast cancer diagnosis and treatment. Interface Focus 9, 4 (2019). https://doi.org/10.1098/rsfs.2019.0034
[2]
T.P. Babarenda Gamage, V. Rajagopal, M. Ehrgott, M.P. Nash, and P.M.F. Nielsen. 2011. Identification of mechanical properties of heterogeneous soft bodies using gravity loading. International Journal for Numerical Methods in Biomedical Engineering 27, 4 (2011), 391–407. https://doi.org/10.1002/cnm.1429
[3]
J.C. Dibene and E. Dunn. 2022. HoloLens 2 Sensor Streaming. http://arxiv.org/abs/2211.02648
[4]
S.L. Perkins, M.A. Lin, S. Srinivasan, A.J. Wheeler, B.A. Hargreaves, and B.L. Daniel. 2017. A Mixed-Reality System for Breast Surgical Planning. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). 269–274. https://doi.org/10.1109/ISMAR-Adjunct.2017.92
[5]
romaset. 2018. Doctor in a surgical room with virtual reality glasses on the background of the real operation. Stock Photo — stock.adobe.com. https://stock.adobe.com/nz/images/doctor-in-a-surgical-room-with-virtual-reality-glasses-on-the-background-of-the-real-operation/243078687. [Accessed 21-08-2023].
[6]
D. Ungureanu, F. Bogo, S. Galliani, P. Sama, X. Duan, C. Meekhof, J. Stühmer, T.J. Cashman, B. Tekin, J.L. Schönberger, P. Olszta, and M. Pollefeys. 2020. HoloLens 2 Research Mode as a Tool for Computer Vision Research. https://doi.org/10.48550/arXiv.2008.11239
Index Terms
- Estimating mechanical properties of soft objects using surface measurements from AR headsets
Index terms have been assigned to the content through auto-classification.
Recommendations
Simulation of the Field of View in AR and VR Headsets
Virtual, Augmented and Mixed RealityAbstractTechnical parameters of today’s Optical See-Through Head Mounted Displays (OST-HMDs) do not fully match the industrial requirements yet: Especially the small field of view (FoV) of current OST-HMDs is a hindrance for industrial use. The FoV is a ...
Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive ApplicationsThis demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...
Designing AR Game Enhancing Interactivity between Virtual Objects and Hand for Overcoming Space Limit
Proceedings of the 6th International Conference on Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality - Volume 8526We propose real-time interactive game that is based on Augmented Reality AR. It is composed of AR marker, Head Mounted Display and depth camera. By using marker, the proposed system augments game space, fishing place. And player can interact virtual ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2023
542 pages
ISBN:9798400703287
DOI:10.1145/3611659
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 October 2023
Check for updates
Author Tags
Qualifiers
- Abstract
- Research
- Refereed limited
Funding Sources
- Ministry for Business, Innovation and Employment New Zealand
- New Zealand Breast Cancer Foundation
- University of Auckland Foundation
Conference
VRST 2023: 29th ACM Symposium on Virtual Reality Software and Technology
October 9 - 11, 2023
Christchurch, New Zealand
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 80Total Downloads
- Downloads (Last 12 months)37
- Downloads (Last 6 weeks)4
Reflects downloads up to 13 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format