Abstract
The evolution of augmented reality (AR), with an improvement in its usability, allows more users to interact with this type of devices such as the HoloLens 2. One of the main fields benefiting greatly of these advances is healthcare, particularly for rehabilitation and well being. In AR, users are able to see the real world, reducing potential dizziness caused by other devices. In this paper we present HoloDemTect, an AR application to stimulate the interaction of patients with objects while performing different tasks. They are asked to perform tasks in which their motor and cognitive abilities are stimulated, while the system collects relevant information (e.g. eye tracking, hand positions and head movements) to reconstruct their actions. Our system creates a realistic experience with high immersion that we evaluated with a set of exercises performed by volunteers by a qualitative and quantitative analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aruanno, B., Garzotto, F.: MemHolo: mixed reality experiences for subjects with Alzheimer’s disease. MTAP 78(10), 13517–13537 (2019)
Tsai, C.-F., et al.: A machine-learning-based assessment method for early-stage neurocognitive impairment by an immersive virtual supermarket. IEEE Trans. Neural Syst. Rehabil. Eng. 29, 2124–2132 (2021)
Montenegro, J.M.F., Argyriou, V.: Cognitive evaluation for the diagnosis of Alzheimer’s disease based on turing test and virtual environments. Physiol. Behav. 173, 42–51 (2017)
Montenegro, J.M.F., Villarini, B., Angelopoulou, A., Kapetanios, E., Garcia-Rodriguez, J., Argyriou, V.: A survey of alzheimer’s disease early diagnosis methods for cognitive assessment. Sensors 20(24), 7292 (2020)
Gomez-Donoso, F., et al.: A robotic platform for customized and interactive rehabilitation of persons with disabilities. Pattern Recognit. Lett. 99, 105–113 (2017)
Gonzalez-Franco, M., Peck, T.C.: Avatar embodiment. Towards a standardized questionnaire. Front. Robot. AI 5, 74 (2018)
Kitagawa, M., et al.: Intraoperative holography navigation using a mixed-reality wearable computer during laparoscopic cholecystectomy. Surgery 171(4), 1006–1013 (2022)
Kurazume, R., et al.: Development of AR training systems for humanitude dementia care. Adv. Robot. 36(7), 344–358 (2022)
Levy, J.B., et al.: The mixed reality medical ward round with the MS HoloLens 2: innovation in reducing COVID-19 transmission and PPE usage. Future Healthc. J. 8(1), e127–e130 (2021)
Martinez-Gonzalez, P., Mulero-Perez, D., Oprea, S., Benavent-Lledo, M., Orts-Escolano, S., Garcia-Rodriguez, J.: Synthetic contact maps to predict grasp regions on objects. In: International Joint Conference on Neural Networks (IJCNN), pp. 1–6 (2022)
Merlo, E.M., et al.: The VESPA project: virtual reality interventions for neurocognitive and developmental disorders. J. Mind Med. Sci. 9(1), 16–27 (2022)
Montenegro, J.M.F.: Alzheimer’s disease diagnosis based on cognitive methods in virtual environments and emotions analysis (2018)
García-Sevilla, M., et al.: Augmented reality as a tool to guide PSI placement in pelvic tumor resections. Sensors 21(23), 7824 (2021)
Palumbo, A.: Microsoft HoloLens 2 in medical and healthcare context: state of the art and future prospects. Sensors 22(20), 7709 (2022)
Flórez-Revuelta, F., García Chamizo, J.M., Garcia-Rodrguez, J., Hernández-Sáez, A.: Representation of 2D objects with a topology preserving network. In: Pattern Recognition in Information Systems, Proceedings of the 2nd International Workshop on Pattern Recognition in Information Systems, pp. 267–276. ICEIS Press (2002)
Rohrbach, N., et al.: An augmented reality approach for ADL support in Alzheimer’s disease: a crossover trial. J. Neuroeng. Rehabil. 16(1), 1–11 (2019)
Wang, L., et al.: Application of a three-dimensional visualization model in intraoperative guidance of percutaneous nephrolithotomy. Int. J. Urol. 29(8), 838–844 (2022)
Wolf, J., et al.: Comparing the effectiveness of augmented reality-based and conventional instructions during single ECMO cannulation training. Int. J. Comput. Assist. Radiol. Surg. 16, 1171–1180 (2021)
Wolf, J., et al.: Gaze comes in handy: Predicting and preventing erroneous hand actions in AR-supported manual tasks. In: 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 166–175 (2021)
Zygouris, S., et al.: Detection of mild cognitive impairment in an at-risk group of older adults: can a novel self-administered serious game-based screening test improve diagnostic accuracy? J. Alzheimers Dis. 78(1), 405–412 (2020)
Acknowledgment
We would like to thank “A way of making Europe” European Regional Development Fund (ERDF) and MCIN/AEI/10.13039/501100011033 for supporting this work under the TED2021-130890B (CHAN-TWIN) research Project funded by MCIN/AEI /10.13039/501100011033 and European Union NextGenerationEU/ PRTR, and AICARE project (grant SPID202200X139779IV0). Also the HORIZON-MSCA-2021-SE-0 action number: 101086387, REMARKABLE, Rural Environmental Monitoring via ultra wide-ARea networKs And distriButed federated Learning. This work has also been supported by two Spanish national and regional grants for PhD studies, FPU21/00414, and CIACIF/2021/430.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mulero-Pérez, D., Benavent-Lledo, M., Garcia-Rodriguez, J., Azorin-Lopez, J., Vizcaya-Moreno, F. (2023). HoloDemtect: A Mixed Reality Framework for Cognitive Stimulation Through Interaction with Objects. In: García Bringas, P., et al. 18th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2023). SOCO 2023. Lecture Notes in Networks and Systems, vol 750. Springer, Cham. https://doi.org/10.1007/978-3-031-42536-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-031-42536-3_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42535-6
Online ISBN: 978-3-031-42536-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)