A Fuzzy Shell for Developing an Interpretable BCI Based on the Spatiotemporal Dynamics of the Evoked Oscillations
Authors: 
Anna Lekova, Ivan Chavdarov Academic Editor: Rodolfo E. HaberAuthors Info & Claims
Abstract
Researchers in neuroscience computing experience difficulties when they try to carry out neuroanalysis in practice or when they need to design an explainable brain-computer interface (BCI) with quick setup and minimal training phase. There is a need of interpretable computational intelligence techniques and new brain states decoding for more understandable interpretation of the sensory, cognitive, and motor brain processing. We propose a general-purpose fuzzy software system shell for developing a custom EEG BCI system. It relies on the bursts of the ongoing EEG frequency power synchronization/desynchronization at scalp level and supports quick BCI setup by linguistic features, ad hoc fuzzy membership construction, explainable IF-THEN rules, and the concept of the Internet of Things (IoT), which makes the BCI system device and service independent. It has a potential for designing both passive and event-related BCIs with options for visual representation at scalp-source level in response to time. The feasibility of the proposed system has been proven by real experiments and bursts for β and γ frequency power have been detected in real time in response to evoked visuospatial selective attention. The presence of the proposed new brain state decoding can be used as a feasible metric for interpretation of the spatiotemporal dynamics of the passive or evoked neural oscillations.
References
[1]
G. Vilone and L. Longo, “Explainable artificial intelligence: a systematic review,” CoRR, vol. 93, 2006.
[2]
C. Kothe and S. Makeig, “BCILAB: a platform for brain computer interface development,” Journal of Neural Engineering, vol. 10, no. 5, 2013.
[3]
A. Delorme and S. Makeig, “EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis,” Journal of Neuroscience Methods, vol. 134, no. 1, pp. 9–21, 2004.
[4]
Y. Renard, F. Lotte, G. Gibert et al., “OpenViBE: an open-source software platform to design, test, and use brain-computer interfaces in real and virtual environments,” Presence: Teleoperators and Virtual Environments, vol. 19, no. 1, pp. 35–53, 2010.
[5]
G. Congedo, D. J. McFarland, T. Hinterberger, N. Birbaumer, and J. R. Wolpaw, “BCI2000: a general-purpose brain-computer interface (BCI) system,” IEEE Transactions on Biomedical Engineering, vol. 51, no. 6, pp. 1034–1043, 2004.
[6]
Neuromore EEG streaming and processing studio.
[7]
A. Delorme, T. Mullen, C. Kothe et al., “EEGLAB, SIFT, NFT, BCILAB, ERICA-new tools for advanced EEG processing,” IEEE Transactions on Biomedical Engineering, vol. 23, 2011.
[8]
A. Stuart, J. Ord, and S. Arnold, “Kendall’s advanced theory of statistics,” Classical Inference and the Linear Model, vol. 2A, 1999.
[9]
C. Mencar, C. Castiello, R. Cannone, and A. M. Fanelli, “Interpretability assessment of fuzzy knowledge bases: a cointension based approach,” International Journal of Approximate Reasoning, vol. 52, no. 4, pp. 501–518, 2011.
[10]
X. Gu, Z. Cao, A. Jolfaei et al., “EEG-based brain-computer interfaces (BCIs): a survey of recent studies on signal sensing technologies and computational intelligence approaches and their applications,” 2020.
[11]
S. M. Alarcão and M. J. Fonseca, “Emotions recognition using EEG signals: a survey,” IEEE Transactions on Affective Computing, vol. 10, no. 3, pp. 374–393, 2019.
[12]
P. J. Bota, C. Wang, A. L. N. Fred, and H. Placido Da Silva, “A review, current challenges, and future possibilities on emotion recognition using machine learning and physiological signals,” IEEE Access, vol. 7, pp. 140990–141020, 2019.
[13]
D. Garrett, D. A. Peterson, C. W. Anderson, and M. H. Thaut, “Comparison of linear, nonlinear, and feature selection methods for EEG signal classification,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 11, no. 2, pp. 141–144, 2003.
[14]
M. Rashid, N. Sulaiman, A. Abdul Majeed et al., “Current status, challenges, and possible solutions of EEG-based brain-computer interface: a comprehensive review,” Frontiers in Neurorobotics, vol. 23, pp. 14–25, 2020.
[15]
S. Luck and J. Steven, An Introduction to the Event-Related Potential Technique, The MIT Press, London, UK, 2005.
[16]
S. Chiappa and S. Bengio, “HMM and IOHMM modeling of EEG rhythms for asynchronous BCI systems,” 2004.
[17]
G. Pfurtscheller, D. Flotzinger, and J. Kalcher, “Brain-Computer Interface-a new communication device for handicapped persons,” Journal of Microcomputer Applications, vol. 16, no. 3, pp. 293–299, 1993.
[18]
G. Pfurtscheller and F. Lopes da Silva, Functional Brain Imaging, Hans Huber Publishers, London, UK, 1988.
[19]
G. Pfurtscheller, A. Stancak, and C. Neuper, “Event-related synchronization (ERS) in the α band—an electrophysiological correlate of cortical idling: a review,” International Journal of Psychophysiology, vol. 24, no. 1-2, pp. 39–46, 1996.
[20]
G. Pfurtscheller, “Functional brain imaging based on ERD/ERS,” Vision Research, vol. 41, no. 10-11, pp. 1257–1260, 2001.
[21]
E. Başar, “Brain oscillations in neuropsychiatric disease,” Dialogues Clin Neuroscience, vol. 15, pp. 291–300, 2013.
[22]
W. Klimesch, M. Doppelmayr, H. Russegger, and T. Pachinger, “θ band power in the human scalp EEG and the encoding of new information,” Neuro Report, vol. 7, no. 7, pp. 1235–1240, 1996.
[23]
K. Stephan and K. Friston, “Functional connectivity,” Academic Press, vol. 2009, 2009.
[24]
S.-B. Lee, H.-J. Kim, H. Kim, J.-H. Jeong, S.-W. Lee, and D.-J. Kim, “Comparative analysis of features extracted from EEG spatial, spectral and temporal domains for binary and multiclass motor imagery classification,” Information Sciences, vol. 502, pp. 190–200, 2019.
[25]
T. Wen and Z. Zhang, “Effective and extensible feature extraction method using genetic algorithm-based frequency-domain feature search for epileptic EEG multi classification,” Medicine, vol. 96, no. 19, 2017.
[26]
C. Han, G. Xu, J. Xie et al., “Highly interactive brain-computer interface based on flicker-free steady-state motion visual evoked potential,” Scientific Reports, vol. 8, 2018.
[27]
R. Zerafa, T. Camillieri, O. Falzon et al., “To train or not to train? A survey on training of feature extraction methods for SSVEP-based BCIs,” Journal Neural Engineering, vol. 15, 2018.
[28]
J. Jin, S. Li, I. Daly et al., “The study of generic model set for reducing calibration time in P300-based brain-computer interface,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 28, no. 1, pp. 3–12, 2020.
[29]
K. Zhang, G. Xu, X. Zheng et al., “Application of transfer learning in EEG decoding based on brain-computer interfaces: a review,” Sensors, vol. 20, 2020.
[30]
B. Blankertz, G. Curio, and K. Müller, “Classifying single trial EEG: towards brain computer interfacing,” Advances in Neural Information Processing Systems, vol. 1, pp. 157–164, 2002.
[31]
C. Lytridis, A. Lekova, C. Bazinas, M. Manios, and V. G. Kaburlasos, “WINkNN: windowed intervals’ number kNN classifier for efficient time-series applications,” Mathematics, vol. 8, no. 3, p. 413, 2020.
[32]
B. Myroniv, C. Wu, Y. Reny et al., “Analyzing user emotions via physiology signals,” Data Science Pattern Recognition, vol. 1, no. 2, pp. 11–25, 2017.
[33]
F. Lee, R. Scherer, R. Leeb et al., “A comparative analysis of multi-class EEG classification for brain computer interface,” 2005.
[34]
N. Zhuang, Y. Zeng, L. Tong, C. Zhang, H. Zhang, and B. Yan, “Emotion recognition from EEG signals using multidimensional information in EMD domain,” BioMed Research International, vol. 2017, pp. 1–9, 2017.
[35]
C. He, Y.-J. Yao, and X.-S. Ye, “An emotion recognition system based on physiological signals obtained by wearable sensors,” Wearable Sensors and Robots, vol. 23, 2017.
[36]
F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B. Arnaldi, “A review of classification algorithms for EEG-based brain-computer interfaces,” Journal of Neural Engineering, vol. 4, no. 2, 2007.
[37]
R. Fu, Y. Tian, T. Bao et al., “Improvement motor imagery EEG classification based on regularized linear discriminant analysis,” Journ. Med Syst., vol. 43, no. 6, 2019.
[38]
M. Alom, T. Taha, C. Yakopcic et al., “A state-of-the-art survey on deep learning theory and architectures,” Electronics, vol. 8, 2019.
[39]
Q. Abbas, M. E. A. Ibrahim, and M. A. Jaffar, “A comprehensive review of recent advances on deep vision systems,” Artificial Intelligence Review, vol. 52, no. 1, pp. 39–76, 2019.
[40]
O. AlZoubi, I. Koprinska, and R. Calvo, “Classification of brain-computer interface data,” Australasian Data Mining Conference, vol. 87, pp. 123–131, 2008.
[41]
X. Gu and Z. Cao, “An interpretative fuzzy rule-based eeg classification system for discrimination of hand motor attempts in stroke patients,” Signal Processing, vol. 2020, 2020.
[42]
E. Vrochidou, C. Lytridis, C. Bazinas et al., “Fuzzy lattice reasoning for brain signal classification,” Journal of Universal Computer Science, vol. 26, no. 9, pp. 1175–1195, 2020.
[43]
S. Bhattacharyya, D. Basu, A. Konar, and D. N. Tibarewala, “Interval type-2 fuzzy logic based multiclass ANFIS algorithm for real-time EEG based movement control of a robot arm,” Robotics and Autonomous Systems, vol. 68, pp. 104–115, 2015.
[44]
T. Nguyen, I. Hettiarachchi, A. Khosravi et al., “Multiclass EEG data classification using fuzzy systems,” 2017.
[45]
A. Das, S. Suresh, and N. Sundararajan, “A fully tuned sequential interval type-2 fuzzy inference system for motorimagery task classification,” 2016.
[46]
R. Sutton and A. Barto, “Reinforcement learning: an introduction,” 1998.
[47]
P. Glimcher, “Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis,” Proceedings of the National Academy of Sciences of the United States of America, vol. 108, no. 3, pp. 15647–15654, 2011.
[48]
I. Iturrate, L. Montesano, and J. Minguez, “Robot reinforcement learning using EEG-based reward signals,” 2010.
[49]
Y. Ming, D. Wu, Y. Wang, Y. Shi, and C. Lin, “EEG-based drowsiness estimation for driving safety using deep Q-learning,” 2020.
[50]
L. Kuncheva, Fuzzy Classifier Design, Springer-Verlag, Heidelberg, China, 2000.
[51]
H. Ishibuchi and T. Nakashima, “Effect of rule weights in fuzzy rule-based classification systems,” IEEE Transactions on Fuzzy Systems, vol. 9, no. 4, pp. 506–515, 2001.
[52]
F. Lotte, “The use of fuzzy inference systems for classification in EEG-Based BCI,” 2006.
[53]
T. Tsai, L. Kau, and K. Chao, “A Takagi-Sugeno fuzzy neural network-based algorithm with single-channel EEG signal for the discrimination between light and deep sleep stages,” In IEEE Biomedical Circuits and Systems Conference, vol. 23, pp. 532–535, 2016.
[54]
A. Riid and J.-S. Preden, “Design of fuzzy rule-based classifiers through granulation and consolidation,” Journal of Artificial Intelligence and Soft Computing Research, vol. 7, no. 2, pp. 137–147, 2017.
[55]
T. Takagi and M. Sugeno, “Fuzzy identification of systems and its applications to modeling and control,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 15, no. 1, pp. 116–132, 1985.
[56]
C. Berka, “Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset,” International Journal of Human-Computer Interaction, vol. 17, 2020.
[57]
R. Ramirez and Z. Vamvakousis, “Detecting emotion from EEG signals using the emotive epoc device,” in Brain Informatics, Lecture Notes in Computer Science, vol. 7670, F. M. Zanzotto, S. Tsumoto, N. Taatgen, and Y. Yao, Eds., Springer, Berlin, Heidelberg, 2012.
[58]
IBM NodeRED Flow-based programming for the Internet of Things.
[59]
A. B. Chica, P. Bartolomeo, and J. Lupiáñez, “Two cognitive and neural systems for endogenous and exogenous spatial attention,” Behavioural Brain Research, vol. 237, pp. 107–123, 2013.
[60]
M. Corbetta and G. L. Shulman, “Control of goal-directed and stimulus-driven attention in the brain,” Nature Reviews Neuroscience, vol. 3, no. 3, pp. 201–215, 2002.
[61]
S. Banerjee, S. Grover, and D. Sridharan, “Unraveling causal mechanisms of top-down and bottom-up visuospatial attention with non-invasive brain stimulation,” Journal of the Indian Institute of Science, vol. 97, no. 4, pp. 451–475, 2017.
[62]
Y. Lee and S. Hsieh, “Classifying different emotional states by means of EEG-based functional connectivity patterns,” PLoS ONE, vol. 9, no. 4, 2014.
[63]
E. Niedermeyer and F. Lopes da Silva, Electroencephalography: Basic Principles, Clinical Applications, and Related Fields, Williams and Williams, Baltimore, MD, USA, 1993.
[64]
T. W. Picton, M. S. John, A. Dimitrijevic, and D. Purcell, “Human auditory steady-state responses: respuestas auditivas de estado estable en humanos,” International Journal of Audiology, vol. 42, no. 4, pp. 177–219, 2003.
[65]
E. Guzman-Martinez, M. Grabowecky, G. Palafox et al., “A unique role of endogenous visual-spatial attention in rapid processing of multiple targets,” J. of Experimental Psychology: Human Perception and Performance, vol. 27, no. 1, pp. 1–15, 2012.
[66]
T. J. Buschman and E. K. Miller, “Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices,” Science, vol. 315, no. 5820, pp. 1860–1862, 2007.
[67]
F. Katsuki and C. Constantinidis, “Bottom-up and top-down attention,” The Neuroscientist, vol. 20, no. 5, pp. 509–521, 2014.
[68]
J. Riddle, K. Hwang, D. Cellier, S. Dhanani, and M. D’Esposito, “Causal evidence for the role of neuronal oscillations in top-down and bottom-up attention,” Journal of Cognitive Neuroscience, vol. 31, no. 5, pp. 768–779, 2019.
[69]
X. Hong, J. Sun, and S. Tong, “Functional brain networks for sensory maintenance in top-down selective attention to audiovisual inputs,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 21, no. 5, 2013.
[70]
O. Jensen, J. Gelfand, J. Kounios et al., “Oscillations in the Alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task,” Cerebral Cortex, vol. 12, no. 8, pp. 877–882, 2002.
[71]
A. Gevins and M. E. Smith, “Neurophysiological measures of cognitive workload during human-computer interaction,” Theoretical Issues in Ergonomics Science, vol. 4, no. 1-2, pp. 113–131, 2003.
[72]
S. Raghavachari, J. E. Lisman, M. Tully, J. R. Madsen, E. B. Bromfield, and M. J. Kahana, “Theta oscillations in human cortex during a working-memory task: evidence for local generators,” Journal of Neurophysiology, vol. 95, no. 3, pp. 1630–1638, 2006.
[73]
P. Fries, J.-H. Schröder, P. R. Roelfsema, W. Singer, and A. K. Engel, “Oscillatory neuronal synchronization in primary visual cortex as a correlate of stimulus selection,” The Journal of Neuroscience, vol. 22, no. 9, pp. 3739–3754, 2002.
[74]
S. Sandkühler and J. Bhattacharya, “Deconstructing insight: EEG correlates of insightful problem solving,” PLoS ONE, vol. 3, no. 1, e1459.
[75]
E. C. Tolman, “Cognitive maps in rats and men,” Psychological Review, vol. 55, no. 4, pp. 189–208, 1948.
[76]
E. P. O. C. Emotiv, “The most credible and cost-effective mobile EEG Brainwear device,” 2020.
[77]
EmotivBCI Node-RED Toolbox.
[78]
Fuzzy shell for developing a custom EEG BCI, https://flows.nodered.org/collection/-bU3rdvsYIpL.
[79]
G. Karvat, A. Schneider, M. Alyahyay et al., “Real-time detection of neural oscillation bursts allows behaviourally relevant neurofeedback,” Communication in Biology, vol. 3, 2020.
[80]
M. F. Carr, M. P. Karlsson, and L. M. Frank, “Transient slow gamma synchrony underlies hippocampal memory replay,” Neuron, vol. 75, no. 4, pp. 700–713, 2012.
[81]
R. H. Guerra, R. Quiza, A. Villalonga, J. Arenas, and F. Castano, “Digital twin-based optimization for ultraprecision motion systems with backlash and friction,” IEEE Access, vol. 7, pp. 93462–93472, 2019.
[82]
B. Alger, “Scientific hypothesis-testing strengthens neuroscience research,” Eneuro, vol. 8, no. 7, 2020.
[83]
L. Battaglini, A. Ghiani, C. Casco, and L. Ronconi, “Parietal tACS at beta frequency improves vision in a crowding regime,” Neuroimage, vol. 208, 2020.
[84]
C. S. Herrmann and A. Mecklinger, “Gamma activity in human EEG is related to highspeed memory comparisons during object selective attention,” Visual Cognition, vol. 8, no. 3–5, pp. 593–608, 2001.
[85]
M. W. Howard, “Gamma oscillations correlate with working memory load in humans,” Cerebral Cortex, vol. 13, no. 12, pp. 1369–1374, 2003.
[86]
D. J. White, M. Congedo, J. Ciorciari, and R. B. Silberstein, “Brain oscillatory activity during spatial navigation: theta and gamma activity link medial temporal and parietal regions,” Journal of Cognitive Neuroscience, vol. 24, no. 3, pp. 686–697, 2012.
[87]
J. A. Meltzer, H. P. Zaveri, I. I. Goncharova et al., “Effects of working memory load on oscillatory power in human intracranial EEG,” Cerebral Cortex, vol. 18, no. 8, pp. 1843–1855, 2008.
[88]
J. E. Lisman and O. Jensen, “The theta-gamma neural code,” Neuron, vol. 77, no. 6, pp. 1002–1016, 2013.
[89]
J. B. Caplan, J. R. Madsen, and S. Raghavachari, “Distinct patterns of brain oscillations underlie two basic parameters of human maze learning,” Journal of Neurophysiology, vol. 86, no. 1, pp. 368–380, 2001.
[90]
M. Kahana, R. J. Schickel, E. Jauk, A. Fink, and A. C. Neubauer, “Alpha power increases in right parietal cortex reflects focused internal attention,” Neuropsychologia, vol. 56, no. 100, pp. 393–400, 2014.
[91]
M. C. Cervenka, S. Nagle, and D. Boatman-Reich, “Cortical high-gamma responses in auditory processing,” American Journal of Audiology, vol. 20, no. 2, pp. 171–180, 2011.
[92]
ANOVA MATLAB script for BCIFS, http://alekova.aabg.eu/index.php?option=com_content&view=article&id=8.
[93]
J. Jang, “ANFIS: adaptive-network-based fuzzy inference systems,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 23, no. No. 3, pp. 665–685, 1993.
[94]
J. Bezdec, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, NY, USA, 1981.
[95]
Q. Song and N. Kasabov, “A neuro-fuzzy inference method for transductive reasoning,” IEEE, vol. 13, no. 6, pp. 799–808, 2005.
[96]
A. Gajate, R. E. Haber, P. I. Vega, and J. R. Alique, “A transductive neuro-fuzzy controller: application to a drilling process,” IEEE Transactions on Neural Networks, vol. 21, no. 7, pp. 1158–1167, 2010.
Recommendations
Age-related differences in SSVEP-based BCI performance
BrainComputer Interface (BCI) systems analyze brain signals to generate control commands for computer applications or external devices. Utilized as alternative communication channel, BCIs have the potential to assist people with severe motor ...
Brain--computer interface (BCI): is it strictly necessary to use random sequences in visual spellers?
APCHI '12: Proceedings of the 10th asia pacific conference on Computer human interactionThe P300 speller is a standard paradigm for brain--computer interfacing (BCI) based on electroencephalography (EEG). It exploits the fact that the user's selective attention to a target stimulus among a random sequence of stimuli enhances the magnitude ...
A hybrid BCI system based on motor imagery and transient visual evoked potential
AbstractMotion imaging (MI) refers to the psychological realization of motions without movement or muscle activity; the basis of neural rehabilitation as a brain-computer interface (BCI) technique has been extensively studied. The combination of motor ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2021 Anna Lekova and Ivan Chavdarov.
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Publisher
Hindawi Limited
London, United Kingdom
Publication History
Published: 01 January 2021
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 24 Dec 2024