Abstract
Although neuroimaging has greatly expanded our knowledge about the brain-behavior relation, combining multiple neuroimaging modalities with complementing strengths can overcome some limitations encountered when using a single modality. Valuable candidates for a multimodal approach are functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG). fNIRS is an imaging technology that localizes hemodynamic changes within the cortex. However, hemodynamic activation is an intrinsically slow process. On the other hand, EEG has excellent time resolution by directly measuring the manifestation of the brain electrical activity at the scalp. Based on their complementary strengths, the integration of fNIRS and EEG may provide higher spatiotemporal resolution than either method alone. In this effort, we integrate fNIRS and EEG to evaluate the behavioral performance of six healthy adults in a working memory task. To this end, features extracted from fNIRS and EEG were used separately, as well as in combination, and their performances were compared against each other.
Chapter PDF
Similar content being viewed by others
Keywords
References
Sergent, J.: Brain-imaging studies of cognitive functions. Trends Neurosci. 17, 221–227 (1994)
Stufflebeam, S.M., Rosen, B.R.: Mapping cognitive function. Neuroimaging Clin N Am. 17, 469–484, viii-ix (2007)
Malhi, G.S., Lagopoulos, J.: Making sense of neuroimaging in psychiatry. Acta Psychiatr Scand 117, 100–117 (2008)
Eliassen, J.C., Boespflug, E.L., Lamy, M., Allendorfer, J., Chu, W.J., Szaflarski, J.P.: Brain-mapping techniques for evaluating poststroke recovery and rehabilitation: a review. Top Stroke Rehabil 15, 427–450 (2008)
Calvert, G.A.: Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 11, 1110–1123 (2001)
Lalanne, C., Lorenceau, J.: Crossmodal integration for perception and action. J. Physiol. Paris 98, 265–279 (2004)
Lewine, J.D., Orrison, W.W.J.: Clinical electroencephalography and event-related potentials. In: Orrison, W.W.J., Lewine, J.D., Sanders, J.A., Hartshorne, M.F. (eds.) Functional brain imaging, pp. 327–368. Mosby-Year Book, Boston (1995)
Lewine, J.D., Orrison, W.W.J.: Magnetoenecephalography and magnetic source imaging. In: Orrison, W.W.J., Lewine, J.D., Sanders, J.A., Hartshorne, M.F. (eds.) Functional brain imaging, pp. 369–418. Mosby-Year Book, Boston (1995)
Raichle, M.E., Mintun, M.A.: Brain work and brain imaging. Ann. Rev. Neurosci. 29, 449–476 (2006)
Logothetis, N.K., Wandell, B.A.: Interpreting the BOLD Signal. Annu. Rev. Physiol. 66, 735–769 (2004)
George, J.S., Aine, C.J., Mosher, J.C., Schmidt, D.M., Ranken, D.M., Schlitt, H.A., Wood, C.C., Lewine, J.D., Sanders, J.A., Belliveau, J.W.: Mapping function in the human brain with magnetoencephalography, anatomical magnetic resonance imaging, and functional magnetic resonance imaging. J. Clin. Neurophysiol. 12, 406–431 (1995)
He, B., Lian, J.: High-resolution spatio-temporal functional neuroimaging of brain activity. Crit. Rev. Biomed. Eng. 30, 283–306 (2002)
Ritter, P., Villringer, A.: Simultaneous EEG-fMRI. Neurosci. Biobehav. Rev. 30, 823–838 (2006)
Schiff, N.D.: Multimodal neuroimaging approaches to disorders of consciousness. J. Head Trauma Rehabil. 21, 388–397 (2006)
Villringer, A.: Functional neuroimaging. Optical approaches Adv. Exp. Med. Biol. 413, 1–18 (1997)
Izzetoglu, M., Izzetoglu, K., Bunce, S., Ayaz, H., Devaraj, A., Onaral, B., Pourrezaei, K.: Functional near-infrared neuroimaging. IEEE Trans Neural Syst. Rehabil. Eng. 13, 153–159 (2005)
Jobsis, F.F.: Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. Science 198, 1264–1267 (1977)
Izzetoglu, M., Bunce, S.C., Izzetoglu, K., Onaral, B., Pourrezaei, K.: Functional brain imaging using near-infrared technology. IEEE Eng. Med. Biol. Mag. 26, 38–46 (2007)
Kok, A.: Event-related-potential (ERP) reflections of mental resources: a review and synthesis. Biol. Psychol. 45, 19–56 (1997)
Johnson Jr., R.: On the neural generators of the P300 component of the event-related potential. Psychophysiology 30, 90–97 (1993)
Kok, A.: On the utility of P3 amplitude as a measure of processing capacity. Psychophysiology 38, 557–577 (2001)
Chance, B., Anday, E., Nioka, S., Zhou, S., Hong, L., Worden, K., Li, C., Murray, T., Ovetsky, Y., Pidikiti, D., Thomas, R.: A novel method for fast imaging of brain function, non-invasively, with light. Opt. Express 2, 411–423 (1998)
Owen, A.M., McMillan, K.M., Laird, A.R., Bullmore, E.: N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies. Hum. Brain Mapp. 25, 46–59 (2005)
Delpy, D.T., Cope, M., van der Zee, P., Arridge, S., Wray, S., Wyatt, J.: Estimation of optical pathlength through tissue from direct time of flight measurement. Phys. Med. Biol. 33, 1433–1442 (1988)
Jung, T.P., Makeig, S., Humphries, C., Lee, T.W., McKeown, M.J., Iragui, V., Sejnowski, T.J.: Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37, 163–178 (2000)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern classification. Wiley Interscience, New York (2001)
Kuncheva, L.I.: Combining pattern classifiers: Methods and algorithms. Wiley Interscience, New York (2004)
Parikh, D., Polikar, R.: An Ensemble-Based Incremental Learning Approach to Data Fusion. IEEE Trans Sys. Man Cyber 37, 437–450 (2007)
Kennan, R.P., Horovitz, S.G., Maki, A., Yamashita, Y., Koizumi, H., Gore, J.C.: Simultaneous recording of event-related auditory oddball response using transcranial near infrared optical topography and surface EEG. Neuroimage 16, 587–592 (2002)
Butti, M., Pastori, A., Merzagora, A., Zucca, C., Bianchi, A., Reni, G., Cerutti, S.: Multimodal analysis of a sustained attention protocol: Continuous Performance Test assessed with Near Infrared Spectroscopy and EEG. In: 28th Annual International Conference of the IEEE EMBS, pp. 1040–1043 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Merzagora, A.C., Izzetoglu, M., Polikar, R., Weisser, V., Onaral, B., Schultheis, M.T. (2009). Functional Near-Infrared Spectroscopy and Electroencephalography: A Multimodal Imaging Approach. In: Schmorrow, D.D., Estabrooke, I.V., Grootjen, M. (eds) Foundations of Augmented Cognition. Neuroergonomics and Operational Neuroscience. FAC 2009. Lecture Notes in Computer Science(), vol 5638. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02812-0_50
Download citation
DOI: https://doi.org/10.1007/978-3-642-02812-0_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02811-3
Online ISBN: 978-3-642-02812-0
eBook Packages: Computer ScienceComputer Science (R0)