[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3632410.3632441acmotherconferencesArticle/Chapter ViewAbstractPublication PagescomadConference Proceedingsconference-collections
short-paper
Open access

Enhancing Motor Imagery based Brain Computer Interfaces for Stroke Rehabilitation

Published: 04 January 2024 Publication History

Abstract

Globally, the prevalence of disabilities among stroke survivors exceeds 80%, with upper-limb movement impairments affecting over 85% of individuals. To address this challenge, motor imagery (MI) based brain-computer interface (BCI) has emerged as a promising approach for translating the imagined motor intentions of individuals into control signals for external devices. Electroencephalography (EEG) signals are commonly used in MI-BCIs due to their non-invasiveness, portability, high temporal resolution, and affordability. The present study utilized the publicly available Electroencephalography Motor Movement/Imagery Dataset (EEGMMIDB), comprising 64-channel EEG recordings from 109 participants sampled at 160 Hz. The aim was to classify between the opening/closing of palms and feet using the Long Short Term Memory (LSTM) network directly on cleaned EEG signals, bypassing traditional feature-extraction methods that are computationally intensive and time-consuming. We achieved an average classification accuracy of 71.2% across subjects by tuning the hyperparameters related to epochs and segment length. This research emphasizes the efficacy of deep learning approaches in generating robust control signals for predicting motor intentions using EEG signals, eliminating the necessity of laborious feature extraction methods. By leveraging deep learning models, MI-BCI devices can advance neuro-rehabilitation, especially in stroke, by providing motor assistance, enabling patients to execute movements solely through the power of imagination.

References

[1]
David Achanccaray, Shin-Ichi Izumi, and Mitsuhiro Hayashibe. 2021. Visual-electrotactile stimulation feedback to improve immersive brain-computer interface based on hand motor imagery. Computational Intelligence and Neuroscience 2021 (2021), 1–13.
[2]
Hamdi Altaheri, Ghulam Muhammad, Mansour Alsulaiman, Syed Umar Amin, Ghadir Ali Altuwaijri, Wadood Abdul, Mohamed A Bencherif, and Mohammed Faisal. 2021. Deep learning techniques for classification of electroencephalogram (EEG) motor imagery (MI) signals: A review. Neural Computing and Applications (2021), 1–42.
[3]
Mohamed Athif and Hongliang Ren. 2019. WaveCSP: a robust motor imagery classifier for consumer EEG devices. Australasian physical & engineering sciences in medicine 42 (2019), 159–168.
[4]
Suresh Balakrishnama and Aravind Ganapathiraju. 1998. Linear discriminant analysis-a brief tutorial. Institute for Signal and information Processing 18, 1998 (1998), 1–8.
[5]
VK Benzy, AP Vinod, R Subasree, Suvarna Alladi, and K Raghavendra. 2020. Motor imagery hand movement direction decoding using brain computer interface to aid stroke recovery and rehabilitation. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28, 12 (2020), 3051–3062.
[6]
Amy A Blank, James A French, Ali Utku Pehlivan, and Marcia K O’Malley. 2014. Current trends in robot-assisted upper-limb stroke rehabilitation: promoting patient engagement in therapy. Current physical medicine and rehabilitation reports 2 (2014), 184–195.
[7]
Leo Breiman. 2001. Random forests. Machine learning 45 (2001), 5–32.
[8]
Shivam Chaudhary, Pankaj Pandey, Krishna Prasad Miyapuram, and Derek Lomas. 2022. Classifying EEG signals of mind-wandering across different styles of meditation. In Brain Informatics: 15th International Conference, BI 2022, Padua, Italy, July 15–17, 2022, Proceedings. Springer, 152–163.
[9]
Shivam Chaudhary, Krishna Prasad Miyapuram, and Derek Lomas. 2023. Predicting drum beats from high-density Brain Rhythms. In Proceedings of the 6th Joint International Conference on Data Science & Management of Data (10th ACM IKDD CODS and 28th COMAD). 291–292.
[10]
Sjoerd De Vries and Theo Mulder. 2007. Motor imagery and stroke rehabilitation: a critical discussion. Journal of rehabilitation medicine 39, 1 (2007), 5–13.
[11]
Eric S Donkor 2018. Stroke in the century: a snapshot of the burden, epidemiology, and quality of life. Stroke research and treatment 2018 (2018).
[12]
Edzard Ernst. 1990. A review of stroke rehabilitation and physiotherapy.Stroke 21, 7 (1990), 1081–1085.
[13]
Valery L Feigin, Benjamin A Stark, Catherine Owens Johnson, Gregory A Roth, Catherine Bisignano, Gdiom Gebreheat Abady, Mitra Abbasifard, Mohsen Abbasi-Kangevari, Foad Abd-Allah, Vida Abedi, 2021. Global, regional, and national burden of stroke and its risk factors, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. The Lancet Neurology 20, 10 (2021), 795–820.
[14]
Ary L Goldberger, Luis AN Amaral, Leon Glass, Jeffrey M Hausdorff, Plamen Ch Ivanov, Roger G Mark, Joseph E Mietus, George B Moody, Chung-Kang Peng, and H Eugene Stanley. 2000. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. circulation 101, 23 (2000), e215–e220.
[15]
Hojjat Allah Haghgoo, Elmira Saed Pazuki, Ali S Hosseini, and Mehdi Rassafiani. 2013. Depression, activities of daily living and quality of life in patients with stroke. Journal of the neurological sciences 328, 1-2 (2013), 87–91.
[16]
Samar M Hatem, Geoffroy Saussez, Margaux Della Faille, Vincent Prist, Xue Zhang, Delphine Dispa, and Yannick Bleyenheuft. 2016. Rehabilitation of motor function after stroke: a multiple systematic review focused on techniques to stimulate upper extremity recovery. Frontiers in human neuroscience 10 (2016), 442.
[17]
Marti A. Hearst, Susan T Dumais, Edgar Osuna, John Platt, and Bernhard Scholkopf. 1998. Support vector machines. IEEE Intelligent Systems and their applications 13, 4 (1998), 18–28.
[18]
Henk T Hendricks, Jacques Van Limbeek, Alexander C Geurts, and Machiel J Zwarts. 2002. Motor recovery after stroke: a systematic review of the literature. Archives of physical medicine and rehabilitation 83, 11 (2002), 1629–1637.
[19]
Han-Jeong Hwang, Soyoun Kim, Soobeom Choi, and Chang-Hwan Im. 2013. EEG-based brain-computer interfaces: a thorough literature survey. International Journal of Human-Computer Interaction 29, 12 (2013), 814–826.
[20]
S Bermudez i Badia, A Garcia Morgade, H Samaha, and PFMJ Verschure. 2012. Using a hybrid brain computer interface and virtual reality system to monitor and promote cortical reorganization through motor activity and motor imagery training. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21, 2 (2012), 174–181.
[21]
Camille Jeunet, Bertrand Glize, Aileen McGonigal, Jean-Marie Batail, and Jean-Arthur Micoulaud-Franchi. 2019. Using EEG-based brain computer interface and neurofeedback targeting sensorimotor rhythms to improve motor skills: Theoretical background, applications and prospects. Neurophysiologie Clinique 49, 2 (2019), 125–136.
[22]
Hiroshi Koshimizu, Ryosuke Kojima, Kazuomi Kario, and Yasushi Okuno. 2020. Prediction of blood pressure variability using deep neural networks. International Journal of Medical Informatics 136 (2020), 104067.
[23]
Ayse A Küçükdeveci, Günes Yavuzer, Atilla H Elhan, Birkan Sonel, and Alan Tennant. 2001. Adaptation of the Functional Independence Measure for use in Turkey. Clinical rehabilitation 15, 3 (2001), 311–319.
[24]
Gert Kwakkel, Janne M Veerbeek, Erwin EH van Wegen, and Steven L Wolf. 2015. Constraint-induced movement therapy after stroke. The Lancet Neurology 14, 2 (2015), 224–234.
[25]
Peter Langhorne, Robert Wagenaar, and Cecily Partridge. 1996. Physiotherapy after stroke: more is better?Physiotherapy Research International 1, 2 (1996), 75–88.
[26]
Hongli Li, Man Ding, Ronghua Zhang, and Chunbo Xiu. 2022. Motor imagery EEG classification algorithm based on CNN-LSTM feature fusion network. Biomedical signal processing and control 72 (2022), 103342.
[27]
Xuelin Ma, Shuang Qiu, Changde Du, Jiezhen Xing, and Huiguang He. 2018. Improving EEG-based motor imagery classification via spatial and temporal recurrent neural networks. In 2018 40th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, 1903–1906.
[28]
Ravikiran Mane, Tushar Chouhan, and Cuntai Guan. 2020. BCI for stroke rehabilitation: motor and beyond. Journal of neural engineering 17, 4 (2020), 041001.
[29]
Silvia Marchesotti, Michela Bassolino, Andrea Serino, Hannes Bleuler, and Olaf Blanke. 2016. Quantifying the role of motor imagery in brain-machine interfaces. Scientific reports 6, 1 (2016), 1–12.
[30]
Pankaj Pandey, Pragati Gupta, Shivam Chaudhary, Krishna Prasad Miyapuram, and Derek Lomas. 2022. Real-time sensing and neurofeedback for practicing meditation using simultaneous EEG and eye tracking. In 2022 IEEE Region 10 Symposium (TENSYMP). IEEE, 1–6.
[31]
Yogesh Paul and Ram Avtar Jaswal. 2018. Classification of EEG for upper limb motor imagery: an approach for rehabilitation. In 2018 Fifth International Conference on Parallel, Distributed and Grid Computing (PDGC). IEEE, 346–350.
[32]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
[33]
Mamunur Rashid, Norizam Sulaiman, Anwar PP Abdul Majeed, Rabiu Muazu Musa, Bifta Sama Bari, Sabira Khatun, 2020. Current status, challenges, and possible solutions of EEG-based brain-computer interface: a comprehensive review. Frontiers in neurorobotics (2020), 25.
[34]
Vridhi Rohira, Shivam Chaudhary, Sudip Das, and Krishna Prasad Miyapuram. 2023. Automatic Epilepsy Detection from EEG signals. In Proceedings of the 6th Joint International Conference on Data Science & Management of Data (10th ACM IKDD CODS and 28th COMAD). 272–273.
[35]
Gerwin Schalk, Dennis J McFarland, Thilo Hinterberger, Niels Birbaumer, and Jonathan R Wolpaw. 2004. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Transactions on biomedical engineering 51, 6 (2004), 1034–1043.
[36]
Robin Tibor Schirrmeister, Jost Tobias Springenberg, Lukas Dominique Josef Fiederer, Martin Glasstetter, Katharina Eggensperger, Michael Tangermann, Frank Hutter, Wolfram Burgard, and Tonio Ball. 2017. Deep learning with convolutional neural networks for EEG decoding and visualization. Human brain mapping 38, 11 (2017), 5391–5420.
[37]
Stefano Silvoni, Ander Ramos-Murguialday, Marianna Cavinato, Chiara Volpato, Giulia Cisotto, Andrea Turolla, Francesco Piccione, and Niels Birbaumer. 2011. Brain-computer interface in stroke: a review of progress. Clinical EEG and neuroscience 42, 4 (2011), 245–252.
[38]
Filip Škola and Fotis Liarokapis. 2018. Embodied VR environment facilitates motor imagery brain–computer interface training. Computers & Graphics 75 (2018), 59–71.
[39]
Fan Su and Wendong Xu. 2020. Enhancing brain plasticity to promote stroke recovery. Frontiers in neurology 11 (2020), 554089.
[40]
Mirac Suzgun, Yonatan Belinkov, and Stuart M Shieber. 2018. On evaluating the generalization of LSTM models in formal languages. arXiv preprint arXiv:1811.01001 (2018).
[41]
Athanasios Vourvopoulos, Diego Andrés Blanco-Mora, Audrey Aldridge, Carolina Jorge, Patricia Figueiredo, and Sergi Bermudez i Badia. 2022. Enhancing Motor-Imagery Brain-Computer Interface Training With Embodied Virtual Reality: A Pilot Study With Older Adults. In 2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE). IEEE, 157–162.
[42]
Fangzhou Xu, Xiaoyan Xu, Yanan Sun, Jincheng Li, Gege Dong, Yuandong Wang, Han Li, Lei Wang, Yingchun Zhang, Shaopeng Pang, 2022. A framework for motor imagery with LSTM neural network. Computer Methods and Programs in Biomedicine 218 (2022), 106692.
[43]
Weibo Yi, Shuang Qiu, Hongzhi Qi, Lixin Zhang, Baikun Wan, and Dong Ming. 2013. EEG feature comparison and classification of simple and compound limb motor imagery. Journal of neuroengineering and rehabilitation 10, 1 (2013), 1–12.
[44]
Yong Yu, Xiaosheng Si, Changhua Hu, and Jianxun Zhang. 2019. A review of recurrent neural networks: LSTM cells and network architectures. Neural computation 31, 7 (2019), 1235–1270.

Cited By

View all

Index Terms

  1. Enhancing Motor Imagery based Brain Computer Interfaces for Stroke Rehabilitation
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        CODS-COMAD '24: Proceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD)
        January 2024
        627 pages
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 04 January 2024

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. LSTM
        2. brain-computer interface
        3. deep learning
        4. electroencephalography
        5. motor imagery
        6. stroke

        Qualifiers

        • Short-paper
        • Research
        • Refereed limited

        Conference

        CODS-COMAD 2024

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 366
          Total Downloads
        • Downloads (Last 12 months)366
        • Downloads (Last 6 weeks)82
        Reflects downloads up to 05 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media