[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3568294.3580153acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
short-paper

Evaluating Kinect, OpenPose and BlazePose for Human Body Movement Analysis on a Low Back Pain Physical Rehabilitation Dataset

Published: 13 March 2023 Publication History

Abstract

Analyzing human motion is an active research area, with various applications. In this work, we focus on human motion analysis in the context of physical rehabilitation using a robot coach system. Computer-aided assessment of physical rehabilitation entails evaluation of patient performance in completing prescribed rehabilitation exercises, based on processing movement data captured with a sensory system, such as RGB and RGB-D cameras. As 2D and 3D human pose estimation from RGB images had made impressive improvements, we aim to compare the assessment of physical rehabilitation exercises using movement data obtained from both RGB-D camera (Microsoft Kinect) and estimation from RGB videos (OpenPose and BlazePose algorithms). A Gaussian Mixture Model (GMM) is employed from position (and orientation) features, with performance metrics defined based on the log-likelihood values from GMM. The evaluation is performed on a medical database of clinical patients carrying out low back-pain rehabilitation exercises, previously coached by robot Poppy.

Supplementary Material

MP4 File (HRI2023-lbr1207.mp4)
This video describes research work done at Autonomous Systems and Robotics Laboratory at ENSTA Paris (IP Paris). Here, we focus on human motion analysis in the context of physical rehabilitation using a robot coach system. 2D and 3D human pose estimation from RGB images had made impressive improvements, and we aim to compare the assessment of physical rehabilitation exercises using movement data obtained from both depth camera (Microsoft Kinect) and estimation from RGB videos (OpenPose and BlazePose algorithms). A Gaussian Mixture Model (GMM) is used for the assessment (as it is a probabilistic model that does not need a lot of data to be trained on). The evaluation is performed on a medical database of clinical patients carrying out low back-pain rehabilitation exercises, previously coached by robot Poppy. We can see that correctly assessing performed exercises remains a problem to solve, but we also proved that simple RGB cameras can be used instead of depth cameras, as they have quite comparable results.

References

[1]
Blanchard A, Nguyen S M, Devanne M, Simonnet M, Le Goff-Pronost M, and Rémy-Néris O. 2022. Technical Feasibility of Supervision of Stretching Exercises by a Humanoid Robot Coach for Chronic Low Back Pain: The R-COOL Randomized Trial. BioMed Research International 2022 (mar 2022), 1--10.
[2]
Miron A, Sadawi N, Waidah I, Hussain H, and Grosan C. 2021. IntelliRehabDS (IRDS)-A Dataset of Physical Rehabilitation Movements. Data 6, 5 (2021). https: //doi.org/10.3390/data6050046
[3]
Tapus A., Bandera A., Vazquez-Martin R., and Calderita L. V. 2018. Perceiving the person and their interactions with the others for social robotics - A review. Pattern Recognition Letters (2018). https://doi.org/10.1016/j.patrec.2018.03.006
[4]
Wu A, March L, Zheng X, Huang J,Wang X, Zhao J, Blyth FM, Smith E, Buchbinder R, and Hoy D. 2020. Global low back pain prevalence and years lived with disability from 1990 to 2017: estimates from the Global Burden of Disease Study 2017. Ann Transl Med. 8, 6 (Jan. 2020), 299. https://doi.org/10.21037/atm.2020.02. 175
[5]
Glowinski D, Dael N, Camurri A, Volpe G, Mortillaro M, and Scherer K. 2011. Toward a Minimal Representation of Affective Gestures. IEEE Transactions on Affective Computing 2, 2 (2011), 106--118. https://doi.org/10.1109/T-AFFC.2011.7
[6]
Kulić D, Venture G, and Nakamura Y. 2009. Detecting changes in motion characteristics during sports training. 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (2009), 4011--4014.
[7]
Maxime Devanne and Sao Mai Nguyen. 2017. Multi-level motion analysis for physical exercises assessment in kinaesthetic rehabilitation. In 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids). 529--534. https: //doi.org/10.1109/HUMANOIDS.2017.8246923
[8]
Maxime Devanne, Sao Mai Nguyen, Olivier Remy-Neris, Béatrice Le Gales- Garnett, Gilles Kermarrec, and André Thepaut. 2018. A Co-design Approach for a Rehabilitation Robot Coach for Physical Rehabilitation Based on the Error Classification of Motion Errors. In IEEE International Conference on Robotic Computing (IRC). 352--357.
[9]
Aggarwal J.K. and Ryoo M.S. 2011. Human Activity Analysis: A Review. ACM Comput. Surv. 43, 3, Article 16 (apr 2011), 43 pages. https://doi.org/10.1145/ 1922649.1922653
[10]
Matthieu L. 2014. Poppy: open-source, 3D printed and fully-modular robotic platform for science, art and education. Theses. Université de Bordeaux.
[11]
Nguyen S M and Tanguy P. 2016. Cognitive architecture of a humanoid robot for coaching physical exercises in kinaesthetic rehabilitation. In International Workshop on Cognitive Robotics.
[12]
Bazarevsky V, Grishchenko I, Raveendran K, Zhu T, Zhang F, and Grundmann M. 2020. BlazePose: On-device Real-time Body Pose tracking. CoRR abs/2006.10204 (2020).
[13]
Liao Y, Vakanski A, Xian M, Paul D, and Baker R. 2020. A review of computational approaches for evaluation of rehabilitation exercises. Computers in Biology and Medicine 119 (2020), 103687.
[14]
Cao Z, Hidalgo Martinez G, Simon T, Wei S, and Sheikh Y. A. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).

Cited By

View all
  • (2025)A Novel Telerehabilitation System for Physical Exercise Monitoring in Elderly HealthcareIEEE Access10.1109/ACCESS.2025.352671013(9120-9133)Online publication date: 2025
  • (2024)MMD-MSD: A Multimodal Multisensory Dataset in Support of Research and Technology Development for Musculoskeletal DisordersAlgorithms10.3390/a1705018717:5(187)Online publication date: 29-Apr-2024
  • (2024)Unsupervised Motion Retargeting for Human-Robot ImitationCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640588(204-208)Online publication date: 11-Mar-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction
March 2023
612 pages
ISBN:9781450399708
DOI:10.1145/3568294
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. human body movement analysis
  2. human skeleton representation
  3. humanoid robot
  4. motion assessment
  5. physical rehabilitation
  6. robot coach

Qualifiers

  • Short-paper

Conference

HRI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)115
  • Downloads (Last 6 weeks)11
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)A Novel Telerehabilitation System for Physical Exercise Monitoring in Elderly HealthcareIEEE Access10.1109/ACCESS.2025.352671013(9120-9133)Online publication date: 2025
  • (2024)MMD-MSD: A Multimodal Multisensory Dataset in Support of Research and Technology Development for Musculoskeletal DisordersAlgorithms10.3390/a1705018717:5(187)Online publication date: 29-Apr-2024
  • (2024)Unsupervised Motion Retargeting for Human-Robot ImitationCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640588(204-208)Online publication date: 11-Mar-2024
  • (2024)Image Analysis Technology of the Human Standing Posture Photos and Cupping Therapy with Light Therapy Applied on Local Muscle Tissue2024 9th Optoelectronics Global Conference (OGC)10.1109/OGC62429.2024.10738737(17-22)Online publication date: 10-Sep-2024
  • (2024)A Medical Low-Back Pain Physical Rehabilitation Database for Human Body Movement Analysis2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650036(1-8)Online publication date: 30-Jun-2024
  • (2024)Image-based security techniques for water critical infrastructure surveillanceApplied Soft Computing10.1016/j.asoc.2024.111730161(111730)Online publication date: Aug-2024
  • (2023)Feasibility of 3D Body Tracking from Monocular 2D Video Feeds in Musculoskeletal TelerehabilitationSensors10.3390/s2401020624:1(206)Online publication date: 29-Dec-2023
  • (2023)Posturography Approaches: An Insightful Window to Explore the Role of the Brain in Socio-Affective ProcessesBrain Sciences10.3390/brainsci1311158513:11(1585)Online publication date: 12-Nov-2023
  • (2023)Improving Knee Osteoarthritis Classification with Markerless Pose Estimation and STGCN Model2023 IEEE 25th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP59012.2023.10337688(1-7)Online publication date: 27-Sep-2023
  • (2023)Shoulder and Knee Abnormality Examination Based on Artificial Landmark Estimation2023 Sixth International Symposium on Computer, Consumer and Control (IS3C)10.1109/IS3C57901.2023.00018(36-39)Online publication date: Jun-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media