Abstract
Over one billion people in the world live with some form of disability. This is incessantly increasing due to aging population and chronic diseases. Among the emerging social needs, rehabilitation services are the most required. However, they are scarce and expensive what considerably limits access to them. In this paper, we propose EVA, an augmented reality platform to engage and supervise rehabilitation sessions at home using low-cost sensors. It also stores the user’s statistics and allows therapists to tailor the exercise programs according to their performance. This system has been evaluated in both qualitative and quantitative ways obtaining very promising results.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Al-Issa H, Regenbrecht H, Hale L (2013) Augmented reality applications in rehabilitation to improve physical outcomes. Phys Ther Rev 17(1):16–28. https://doi.org/10.1179/1743288X11Y.0000000051
Aung YM, Al-Jumaily A, Anam K (2014) A novel upper limb rehabilitation system with self-driven virtual arm illusion. In: 36th Annual international conference of the IEEE engineering in medicine and biology society, pp 3614–3617, Chicago, IL, USA
Aung YM, Al-Jumaily A (2014) Augmented reality-based rehabio system for shoulder rehabilitation. Int J Mechatron Autom 4(1):52–62
Bangor A, Kortum P, Miller J (2009) Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud 4(3):114–123
Barcala L, Grecco LAC, Colella F, Lucareli PRG, Salgado ASI, Oliveira CS (2013) Visual biofeedback balance training using wii fit after stroke: a randomized controlled trial. J Phys Ther Sci 25(8):1027–1032. https://doi.org/10.1589/jpts.25.1027
Berndt DJ, Clifford J (1994) Using dynamic time warping to find patterns in time series. In: KDD workshop, vol 10, pp 359–370. Seattle, WA
British National Health Security (NHS) (2018) https://www.nhs.uk/Tools/Documents/NHS_ExercisesForOlderPeople.pdf
Brooke J (1996) SUS-a quick and dirty usability scale. Usability Eval Ind 189(194):4–7
Cao Zhe, Simon Tomas, Wei Shih-En, Sheikh Yaser (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: Computer Vision and Pattern Regognition (CVPR)
Costa A, Martinez-Martin E, Cazorla M, Julian V (2018) Pharos-physical assistant robot system. Sensors 18:2633. https://doi.org/10.3390/s18082633
de Assis GA, Correa AGD, Martins MBR, Pedrozo WG, Lopes RDD (2014) An augmented reality system for upper-limb post-stroke motor rehabilitation: a feasibility study. Disabil Rehabil: Assist Technol 11(16):521–526
Desai K, Bahirat K, Ramalingam S, Prabhakaran B, Annaswamy T, Makris UE (2016) Augmented reality-based exergames for rehabilitation. In: 7th International conference on multimedia systems. Klagenfurt, Austria
dos Santos Mendesa FA, Pompeua JE, Loboa AM, da Silva KG, de Paula OT, Zomignani AP, Piemonte MEP (2012) Motor learning, retention and transfer after virtual-reality-based training in parkinson’s disease-effect of motor and cognitive demands of games: a longitudinal, controlled clinical study. Physiotherapy 98:217–223
Fung V, Ho A, Shaffer J, Chung E, Gomez M (2012) Use of nintendo wii fit in the rehabilitation of outpatients following total knee replacement: a preliminary randomised controlled trial. Physiotherapy 98:183–188
Gaglio S, Re GL, Morana M (2015) Human activity recognition process using 3-D posture data. IEEE Trans Hum-Mach Syst 45(5):586–597. https://doi.org/10.1109/THMS.2014.2377111 ISSN 2168-2291
Gazzoni M, Cerone GL (2018) Augmented reality system for muscle activity biofeedback. Ann Phys Rehabil Med 61:e483–e484
Gomez-Donoso F, Orts-Escolano S, Garcia-Garcia A, Garcia-Rodriguez J, Castro-Vargas JA, Ovidiu-Oprea S, Cazorla M (2017) A robotic platform for customized and interactive rehabilitation of persons with disabilities. Pattern Recognit Lett 99:105–113. https://doi.org/10.1016/j.patrec.2017.05.027 ISSN 0167-8655
Hocoma. Lokomat. https://esa.un.org/unpd/wpp/, 2018
Indra (2019) Toyra. https://www.tecnologiasaccesibles.com/es/proyectos/toyra
Jack D, Boian R, Merians AS, Tremaine M, Burdea GC, Adamovich SV, Recce M, Poizner H (2001) Virtual reality-enhanced stroke rehabilitation. IEEE Trans Neural Syst Rehabil Eng 9(3):308–318. https://doi.org/10.1109/7333.948460 ISSN 1534-4320
Kanazawa A, Black MJ, Jacobs DW, Malik J (2018) End-to-end recovery of human shape and pose. In: Computer vision and pattern recognition (CVPR)
Levy-Tzedek S, Berman S, Stiefel Y, Sharlin E, Young J, Rea D (2017) Robotic mirror game for movement rehabilitation. In: 2017 International conference on virtual rehabilitation (ICVR), pp 1–2. https://doi.org/10.1109/ICVR.2017.8007494
Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollár P, Zitnick CL (2014) Microsoft coco: common objects in context. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) European conference on computer vision (ECCV), pp 740–755, Cham. Springer. ISBN 978-3-319-10602-1
Martinez-Martin E, del Pobil AP (2017) Personal robot assistants for elderly care: an overview. In: Costa A, Julian V, Novais P (eds), Personal assistants: emerging computational technologies, pp 77–91. Springer, Berlin. https://doi.org/10.1007/978-3-319-62530-0_5
Meldrum D, Glennon A, Herdman S, Murray D, McConn-Walsh R (2012) Virtual reality rehabilitation of balance: assessment of the usability of the nintendo Wii®fit plus. Disabil Rehabil: Assist Technol 7(3):205–210. https://doi.org/10.3109/17483107.2011.616922
Monge J, Postolache O (2018) Augmented reality and smart sensors for physical rehabilitation. In: 10th International conference and exposition on electrical and power engineering (EPE2018), pp 1010–1014
Mur-Artal R, Tardos JD (2017) ORB-SLAM2: an open-source SLAM system for monocular, stereo and RGB-D cameras. IEEE Trans Robot 33:1255–1262. https://doi.org/10.1109/TRO.2017.2705103
Nintendo (2008) Wii fit. https://www.nintendo.es/Juegos/Wii/Wii-Fit-283894.html
PTC Inc (2019) Vuforia. https://developer.vuforia.com/
Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. ArXiv e-prints
Salvador S, Chan P (2007) Toward accurate dynamic time warping in linear time and space. Intell Data Anal 11(5):561–580
SilverFit (2019) Silverfit 3d. https://silverfit.com/
Sousa M, Vieira J, Medeiros D, Arsenio A, Jorge J (2016) Sleevear: augmented reality for rehabilitation using realtime feedback. In: Proceedings of the 21st international conference on intelligent user interfaces, pp 175–185, Sonoma, California, USA. https://doi.org/10.1145/2856767.2856773
Stefano M, Patrizia P, Mario A, Ferlini G, Rizzello R, Rosati G (2014) Robotic upper limb rehabilitation after acute stroke by NeReBot: evaluation of treatment costs. BioMed Res Int. https://doi.org/10.1155/2014/265634
Steffen D, Bleser G, Weber M, Stricker D, Fradet L, Marin F (2013) A personalized exercise trainer for the elderly. J Ambient Intell Smart Environ 5:547–562
Tyromotion (2018) Amadeo. https://tyromotion.com/en/produkte/amadeo/
World Health Organization (2010) Community-based rehabilitation: CBR guidelines. Technical report, Geneva
World Health Organization (2015) Who global disability action plan 2014–2021: better health for all people with disability. Technical report
Yang Shichao, Maturana Daniel, Scherer Sebastian (May 2016) Real-time 3d scene layout from a single image using convolutional neural networks. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pages 2183–2189. https://doi.org/10.1109/ICRA.2016.7487368
Acknowledgements
This work has been supported by the Spanish Government TIN2016-76515R Grant, supported with Feder funds. Edmanuel Cruz is funded by a Panamenian grant for Ph.D. studies IFARHU and SENACYT 270-2016-207. This work has also been supported by a Spanish grant for PhD studies ACIF/2017/243 and FPU16/00887. Thanks also to Nvidia for the generous donation of a Titan Xp and a Quadro P6000.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Escalona, F., Martinez-Martin, E., Cruz, E. et al. EVA: EVAluating at-home rehabilitation exercises using augmented reality and low-cost sensors. Virtual Reality 24, 567–581 (2020). https://doi.org/10.1007/s10055-019-00419-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-019-00419-4