[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content

Advertisement

Springer Nature Link
Log in

Decoding Premovement Patterns with Task-Related Component Analysis

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Noninvasive brain–computer interface (BCI)-based electroencephalograms (EEGs) have made great progress in cognitive activities detection. However, the decoding of premovements from EEG signals remains a challenge for noninvasive BCI. This work aims to decode human intention (movement or rest) before movement onset from EEG signals. We propose to decode premovement patterns from movement-related cortical potential activities with task-related component analysis and canonical correlation patterns (TRCA+CCPs). Specifically, we first optimize the MRCP data with the spatial filter TRCA. CCPs are then extracted from the optimized signals. The extracted CCPs are classified with the linear discriminated analysis classifier. We applied the classification in a sliding window, which changes from readiness potential (RP section) to movement-monitoring potential (MMP section). The classification result on event-related desynchronization (ERD) indicates that the motor cortex becomes active as the limbs move. When applying classification between elbow flexion and rest, the proposed TRCA+CCP method achieves an accuracy of 0.9001±0.0997 in the RP section. The previous methods, discriminative canonical pattern matching + common spatial pattern (DCPM+CSP) and the optimized DCPM+CSP method, exhibit accuracy values of 0.7827± 0.1276 and 0.8141±0.1295 for the RP section, respectively. Compared with these methods, the proposed TRCA+CCP method achieves higher average accuracy in the RP section. The proposed TRCA+CCP method can decode the patterns in the RP section efficiently, which indicates that the premovement patterns in EEG signals can be decoded before execution of the movement. The system is expected to assist movement detection in ERD analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Ofner P, Schwarz A, Pereira J, Wyss D, Wildburger R, Müller-Putz GR. Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury. Sci Rep. 2019;9(1):1–15. https://doi.org/10.1038/s41598-019-43594-9.

    Article  Google Scholar 

  2. Lazarou I, Nikolopoulos S, Petrantonakis PC, Kompatsiaris I, Tsolaki M. EEG-based brain computer interfaces for communication and rehabilitation of people with motor impairment: A novel approach of the 21st century. Front Hum Neurosci. 2018;12(January):1–18. https://doi.org/10.3389/fnhum.2018.00014.

    Article  Google Scholar 

  3. Ramadan RA, Vasilakos AV. Brain computer interface: control signals review. Neurocomputing. 2016;223:26–44.

    Article  Google Scholar 

  4. Sakhavi S. Application of deep learning methods in brain-computer interface systems. PhD thesis, National University of Singapore (Singapore). 2017.

  5. Caldara R, Deiber MP, Andrey C, Michel CM, Thut G, Hauert CA. Actual and mental motor preparation and execution: A spatiotemporal ERP study. Exp Brain Res. 2004;159(3):389–99. https://doi.org/10.1007/s00221-004-2101-0.

    Article  Google Scholar 

  6. Nakano H, Osumi M, Ueta K, Kodama T, Morioka S. Changes in electroencephalographic activity during observation, preparation, and execution of a motor learning task. Int J Neurosci. 2013;123(12):866–75. https://doi.org/10.3109/00207454.2013.813509.

    Article  Google Scholar 

  7. Sakhavi S. Application of deep learning methods in brain-computer interface application of deep learning methods in braincomputer interface systems. PhD thesis, National University of Singapore. 2018. https://doi.org/10.13140/RG.2.2.32800.28166.

  8. Neuper C, Wartz M, Pfurtscheller G. ERD/ERS patterns reflecting sensorimotor activation and deactivation. Prog Brain Res. 2006;159(1):211–22.

    Article  Google Scholar 

  9. Spüler M, López-Larraz E, Ramos-Murguialday A. On the design of EEG-based movement decoders for completely paralyzed stroke patients. J Neuroeng Rehabil. 2018;15(1):1–12. https://doi.org/10.1186/s12984-018-0438-z.

    Article  Google Scholar 

  10. Lisi G, Rivela D, Takai A, Morimoto J. Markov switching model for quick detection of event related desynchronization in EEG. Front Neurosci. 2018;12(FEB). https://doi.org/10.3389/fnins.2018.00024.

  11. Wu D, King JT, Chuang CH, Lin CT, Jung TP. Spatial filtering for EEG-based regression problems in brain computer interface (BCI). IEEE Transactions on Fuzzy Systems. 2017.

  12. Ofner P, Schwarz A, Pereira J, Müller-Putz GR. Upper limb movements can be decoded from the time-domain of low-frequency EEG. PLoS ONE. 2017;12(8). https://doi.org/10.1371/journal.pone.0182578.

  13. Jeong JH, Kwak NS, Guan C, Lee SW. Decoding Movement-Related Cortical Potentials Based on Subject-Dependent and Section-Wise Spectral Filtering. IEEE Trans Neural Syst Rehabil Eng. 2020;28(3):687–98. https://doi.org/10.1109/TNSRE.2020.2966826.

    Article  Google Scholar 

  14. Wang K, Xu M, Wang Y, Zhang S, Chen L, Ming D. Enhance decoding of pre-movement EEG patterns for brain-computer interfaces. J Neur Eng. 2020;17(1):016,033.

  15. Mammone N, Ieracitano C, Morabito FC. A deep CNN approach to decode motor preparation of upper limbs from time-frequency maps of EEG signals at source level. Neural Netw. 2020;124:357–72. https://doi.org/10.1016/j.neunet.2020.01.027.

    Article  Google Scholar 

  16. Jochumsen M, Khan Niazi I, Taylor D, Farina D, Dremstrup K (2015) Detecting and classifying movement-related cortical potentials associated with hand movements in healthy subjects and stroke patients from single-electrode, single-trial EEG. J Neur Eng 12(5):56,013. https://doi.org/10.1088/1741-2560/12/5/056013

  17. Liu D, Chen W, Lee K, Chavarriaga R, Iwane F, Bouri M, Pei Z, Millán JdR. EEG-based lower-limb movement onset decoding: Continuous classification and asynchronous detection. IEEE Trans Neural Syst Rehabil Eng. 2018;26(8):1626–35.

    Article  Google Scholar 

  18. Sburlea AI, Montesano L, de la Cuerda RC, Diego IMA, Miangolarra-Page JC, Minguez J. Detecting intention to walk in stroke patients from pre-movement eeg correlates. J Neuroeng Rehabil. 2015;12(1):1–12.

    Article  Google Scholar 

  19. Gordon R, Rzempoluck EJ. Introduction to Laplacian montages Neurodiagnostic Journal. 2004;44(2):98–102. https://doi.org/10.1080/1086508x.2004.11079469.

    Article  Google Scholar 

  20. Niazi IK, Jiang N, Tiberghien O, Nielsen JF, Dremstrup K, Farina D. Detection of movement intention from single-trial movement-related cortical potentials. J Neur Eng 2011;8(6). https://doi.org/10.1088/1741-2560/8/6/066009.

  21. Pereira J, Sburlea AI, Müller-Putz GR. EEG patterns of self-paced movement imaginations towards externally-cued and internally-selected targets. Sci Rep. 2018;8(1):1–15. https://doi.org/10.1038/s41598-018-31673-2.

    Article  Google Scholar 

  22. Nakanishi M, Wang Y, Chen X, Wang Y, Gao X, Jung T. Enhancing detection of SSVEPs for a high-speed brain speller using task-related component analysis. IEEE Trans Biomed Eng. 2018;65(1):104–12.

    Article  Google Scholar 

  23. Zhang Y, Zhou G, Jin J, Wang X, Cichocki A. Frequency recognition in ssvep-based BCI using multiset canonical correlation analysis. Int J Neur Syst. 2014;24(4). https://doi.org/10.1142/S0129065714500130.

  24. Ibáñez J, Serrano JI, Del Castillo MD, Gallego JA, Rocon E. Online detector of movement intention based on EEG-application in tremor patients. Biomed Signal Process Control. 2013;8(6):822–9. https://doi.org/10.1016/j.bspc.2013.07.006.

    Article  Google Scholar 

  25. Ibáñez J, Serrano JI, Del Castillo MD, Monge-Pereira E, Molina- Rueda F, Alguacil-Diego I, Pons JL. Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials. J Neur Eng. 2014;11(5). https://doi.org/10.1088/1741-2560/11/5/056009.

  26. Kai KA, Zheng YC, Haihong Z, Cuntai G. Filter bank common spatial pattern (FBCSP) in brain-computer interface. In: 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). 2008. pp 2390–2397. https://doi.org/10.1109/IJCNN.2008.4634130.

  27. Zhang Y, Nam CS, Zhou G, Jin J, Wang X, Cichocki A. Temporally constrained sparse group spatial patterns for motor imagery BCI. IEEE Transactions on Cybernetics. 2019;49(9):3322–32. https://doi.org/10.1109/TCYB.2018.2841847.

    Article  Google Scholar 

  28. Zhou J, Chen J, Ye J. MALSAR: Multi-task learning via structural regularization. Arizona State University. 2011.

  29. Xiao X, Xu M, Jin J, Wang Y, Jung TP, Ming D. Discriminative canonical pattern matching for single-trial classification of ERP components. IEEE Trans Biomed Eng. 2020;67(8):2266–75. https://doi.org/10.1109/TBME.2019.2958641.

    Article  Google Scholar 

  30. Xu M, Xiao X, Wang Y, Qi H, Jung TP, Ming D. A Brain-Computer Interface Based on Miniature-Event-Related Potentials Induced by Very Small Lateral Visual Stimuli. IEEE Trans Biomed Eng. 2018;65(5):1166–75. https://doi.org/10.1109/TBME.2018.2799661.

    Article  Google Scholar 

Download references

Acknowledgements

Hao Jia and Feng Duan have contributed equally to this work. This study was funded by the National Key R&D Program of China (No. 2017YFE0129700), the National Natural Science Foundation of China (Key Program) (No. 11932013) and the Tianjin Natural Science Foundation for Distinguished Young Scholars (No. 18JCJQJC46100).

Author information

Authors and Affiliations

  1. College of Artificial Intelligence, Nankai University, Jinnan, No.38 Tongyan Road, Jinnan District, Tianjin, 300350, P. R. China

    Feng Duan, Hao Jia & Yangyang Dai

  2. Computational Engineering Applications Unit, Head Office for Information Systems and Cybersecurity, RIKEN, 2-1 Hirosawa, Wako, Saitama, 351-0198, Japan

    Zhe Sun

  3. Department of Surgery, First Teaching Hospital of Tianjin University of Traditional Chinese Medicine, No.88 Changling Road, Xiqing District, Tianjin, 300381, P. R. China

    Kai Zhang

  4. Department of Bioengineering, Lehigh University, Bethlehem, PA, 18015, USA

    Yu Zhang

Authors
  1. Feng Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hao Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhe Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kai Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yangyang Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yu Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Feng Duan or Zhe Sun.

Ethics declarations

Conflicts of interest

All authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Duan, F., Jia, H., Sun, Z. et al. Decoding Premovement Patterns with Task-Related Component Analysis. Cogn Comput 13, 1389–1405 (2021). https://doi.org/10.1007/s12559-021-09941-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-021-09941-7

Keywords

Search

Navigation