Abstract
Early detection of cerebral palsy is crucial, yet existing methods face limitations due to restricted datasets and the inherent complexity of the condition. This study addresses these challenges by enhancing a pose-based feature fusion framework with body part-based analysis, aiming to improve the accuracy and robustness of cerebral palsy detection in infants. Current literature predominantly focuses on either body-part information or frequency and motion data, neglecting the potential benefits of combining both. To bridge this gap, this research integrates a body part-based ensemble framework with the existing pose-based model. This approach involves a comprehensive analysis of body part-based features in both the time and frequency domains, capturing subtle nuances in movement patterns that may be indicative of cerebral palsy. The proposed integrated framework achieves an impressive accuracy of 98.94%, demonstrating its potential to significantly enhance early diagnosis and intervention efforts for cerebral palsy. By providing clinicians with a more accurate and reliable tool for early detection, this research can ultimately improve the quality of life for children with cerebral palsy.
Similar content being viewed by others
Data availibility
All datasets are publicly accessible.
References
Eroglu Y, Yildirim M, Cinar A (2023) Diagnosis of periventricular leukomalacia in children with artificial intelligence-based models developed using brain magnetic resonance images. SIViP 17(8):4543–4550
McCay KD, Hu P, Shum HPH, Woo WL, Marcroft C, Embleton ND, Munteanu A, Ho ESL (2022) A pose-based feature fusion and classification framework for the early prediction of cerebral palsy in infants. IEEE Trans Neural Syst Rehabil Eng 30:8–19. https://doi.org/10.1109/TNSRE.2021.3138185
Zhuang Y, Zhou H, Zhang H, Chen Y, Wang L (2023) A review of state-of-the-arts sensing techniques for the ultra-early screening of cerebral palsy. In: 2023 IEEE International Conference on Real-time Computing and Robotics (RCAR), pp 977–982 . https://doi.org/10.1109/RCAR58764.2023.10249270
Oskoui M, Coutinho F, Dykeman J, Jetté N, Pringsheim T (2013) An update on the prevalence of cerebral palsy: a systematic review and meta-analysis. Dev Med Child Neurol 55(6):509–519
Draper E, Kurinczuk J, Kenyon S (2017) MBRRACE-UK perinatal confidential enquiry: term, singleton, intrapartum stillbirth and intrapartum-related neonatal death
Wachepele DM, Muchina SK, Theuri PM, Musumba G, Gikunda P (2022) Towards a deep learning based approach for an infant medical analysis-a review. In: 2022 International Conference on Information and Communication Technology for Development for Africa (ICT4DA), pp 1–6. https://doi.org/10.1109/ICT4DA56482.2022.9971227
Ramadhan HH, Hussein QM, Ahmed MA (2022) Cerebral palsy prediction using CNN depending on MRI images of the brain. J Optoelectron Laser 41(8):724–733
Gong X, Li X, Ma L, Tong W, Shi F, Hu M, Zhang X-P, Yu G, Yang C (2022) Preterm infant general movements assessment via representation learning. Displays 75:102308
Ningrum ES, Yuniarno EM, Purnomo MH (2023) Early detection of infant cerebral palsy risk based on pose estimation using openpose and advanced algorithms from limited and imbalance dataset. In: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp 1–6. https://doi.org/10.1109/MeMeA57477.2023.10171951
Passmore E, Kwong AL, Greenstein S, Olsen JE, Eeles AL, Cheong JL, Spittle AJ, Ball G (2023) Automated identification of abnormal infant movements from smart phone videos. medRxiv, 2023–04
Airaksinen M, Räsänen O, Ilén E, Häyrinen T, Kivi A, Marchi V, Gallen A, Blom S, Varhe A, Kaartinen N (2020) Automatic posture and movement tracking of infants with wearable movement sensors. Sci Rep 10(1):169
Topham LK, Khan W, Al-Jumeily D, Waraich A, Hussain AJ (2022) Gait identification using limb joint movement and deep machine learning. IEEE Access 10:100113–100127
Xu D, Zhou H, Quan W, Jiang X (2024) A new method proposed for realizing human gait pattern recognition: inspirations for the application of sports and clinical gait analysis. Gait Posture 107:293–305
Kolaghassi R, Marcelli G, Sirlantzis K (2023) Deep learning models for stable gait prediction applied to exoskeleton reference trajectories for children with cerebral palsy. IEEE Access 11:31962–31976. https://doi.org/10.1109/ACCESS.2023.3252916
Groos D, Adde L, Aubert S, Boswell L, De Regnier R-A, Fjørtoft T, Gaebler-Spira D, Haukeland A, Loennecken M, Msall M (2022) Development and validation of a deep learning method to predict cerebral palsy from spontaneous movements in infants at high risk. JAMA Netw Open 5(7):2221325–2221325
Zhu M, Men Q, Ho ES, Leung H, Shum HP (2021) Interpreting deep learning based cerebral palsy prediction with channel attention. In: 2021 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), IEEE, pp 1–4
Sakkos D, Mccay KD, Marcroft C, Embleton ND, Chattopadhyay S, Ho ES (2021) Identification of abnormal movements in infants: a deep neural network for body part-based prediction of cerebral palsy. IEEE Access 9:94281–94292
Zhang H, Shum HP, Ho ES (2022) Cerebral palsy prediction with frequency attention informed graph convolutional networks. In: 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), IEEE, pp 1619–1625
Muhoza AC, Bergeret E, Brdys C, Gary F (2023) Multi-position human activity recognition using a multi-modal deep convolutional neural network. In: 2023 8th International Conference on Smart and Sustainable Technologies (SpliTech), pp 1–5. https://doi.org/10.23919/SpliTech58164.2023.10193600
Wu Q, Qin P, Kuang J, Wei F, Li Z, Bian R, Han C, Xu G (2023) A training-free infant spontaneous movement assessment method for cerebral palsy prediction based on videos. IEEE Trans Neural Syst Rehabil Eng 31:1670–1679
McCay KD, Ho ES, Marcroft C, Embleton ND (2019) Establishing pose based features using histograms for the detection of abnormal infant movements. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, pp 5469–5472
Maurya R, Teo TH, Chua SH, Chow HC, Wey IC (2022) Complex human activities recognition based on high performance 1D CNN model. In: 2022 IEEE 15th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC), pp 330–336. https://doi.org/10.1109/MCSoC57363.2022.00059
Gupta D, Singh AK, Gupta N, Vishwakarma DK (2023) SDL-net: a combined CNN RNN human activity recognition model. In: 2023 International Conference in Advances in Power, Signal, and Information Technology (APSIT), pp 1–5. https://doi.org/10.1109/APSIT58554.2023.10201657
Ningrum ES, Yuniarno EM, Purnomo MH (2023) Early detection of infant cerebral palsy risk based on pose estimation using openpose and advanced algorithms from limited and imbalance dataset. In: 2023 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp 1–6. https://doi.org/10.1109/MeMeA57477.2023.10171951
Liao X, Han Y, Cheng S (2023) OpenPose-based model for infant cerebral palsy auxiliary detection. In: Third International Conference on Computer Vision and Pattern Analysis (ICCPA 2023), vol. 12754, pp 264–270. SPIE
Nguyen-Thai B, Le V, Morgan C, Badawi N, Tran T, Venkatesh S (2021) A spatio-temporal attention-based model for infant movement assessment from videos. IEEE J Biomed Health Inform 25(10):3911–3920. https://doi.org/10.1109/JBHI.2021.3077957
Hesse N, Bodensteiner C, Arens M, Hofmann UG, Weinberger R, Sebastian Schroeder A (2018) Computer vision for medical infant motion analysis: state of the art and RGB-D data set. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops
Embleton ND, Munteanu A, Ho E (2022) Northumbria research link. IEEE Trans Neural Syst Rehabil Eng 30:8–19
Topham LK, Khan W, Al-Jumeily D, Waraich A, Hussain AJ (2023) A diverse and multi-modal gait dataset of indoor and outdoor walks acquired using multiple cameras and sensors. Sci Data 10(1):320
Song C, Huang Y, Wang W, Wang L (2022) CASIA-E: a large comprehensive dataset for gait recognition. IEEE Trans Pattern Anal Mach Intell 45(3):2801–2815
Kay W, Carreira J, Simonyan K, Zhang B, Hillier C, Vijayanarasimhan S, Viola F, Green T, Back T, Natsev P, et al (2017) The kinetics human action video dataset. arXiv preprint arXiv:1705.06950
Funding
No external funding support.
Author information
Authors and Affiliations
Contributions
All authors contributed equally in conceptualizing the research problem and preparation of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to declare.
Ethical approval
Not applicable.
Consent for publication
Not applicable.
Human and animal rights
This article does not contain any studies with human or animal subjects performed by any of the authors
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Rajpopat, S., Kumar, S. & Punn, N.S. Cerebral palsy detection from infant using movements of their salient body parts and a feature fusion model. J Supercomput 81, 106 (2025). https://doi.org/10.1007/s11227-024-06520-z
Accepted:
Published:
DOI: https://doi.org/10.1007/s11227-024-06520-z