Abstract
Presence is a mental state when a user in virtual reality (VR) reacts to events in it as if it is real. Place illusion (PI) and plausibility illusion (PSI) are components of Presence and depend on the Immersion and Coherence of a VR system and the experience. Measuring Presence (PI and PSI) is critical when designing new systems and experiences. However, the traditional questionnaire-based methods of measuring Presence have limitations. Therefore, we propose a method for augmented measurement of Presence, PI, and PSI of VR users with biosignals. For this, we designed a within-subjects experiment that presented VR scenarios with varying levels of Immersion and Coherence while measuring electroencephalography (EEG) of users concurrently. For validation, we took feedback from post-scenario questionnaires presented within the VR environment. The study was conducted with 20 participants. Analyzing the Questionnaire responses revealed that an increase in plausibility illusion or place illusion led to an increase in Presence, confirming the fundamental theory. Analyzing the EEG results revealed that the Envelope Amplitude Correlation features and Spectral Coherence are able to discriminate between the Presence, PI, and PSI of the user. In contrast, there are many entropy features that increase for high PSI.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
Ethical restrictions prohibit the authors from making the data set publicly available.
Notes
References
Athif M, Rathnayake BLK, Nagahapitiya SMDBS, Samarasinghe SADAK, Samaratunga PS, Peiris RL, De Silva AC (2020) Using biosignals for objective measurement of presence in virtual reality environments. In: 2020 42nd Annual international conference of the IEEE engineering in medicine biology society (EMBC), pp 3035–3039. https://doi.org/10.1109/EMBC44109.2020.9176022
Baka E, Stavroulia K-E, Thalmann N, Lanitis A (2018) An eeg-based evaluation for comparing the sense of presence between virtual and physical environments, pp. 107–116. https://doi.org/10.1145/3208159.3208179
Baumgartner T, Speck D, Wettstein D, Masnari O, Beeli G, Jäncke L (2008) Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children. Front Hum Neurosci 2:8. https://doi.org/10.3389/neuro.09.008.2008
Baumgartner T, Speck D, Wettstein D, Masnari O, Beeli G, Jäncke L (2008) Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children. Front Hum Neurosci 2:8. https://doi.org/10.3389/neuro.09.008.2008
Baumgartner T, Valko L, Esslen M, Jäncke L (2006) Neural correlate of spatial presence in an arousing and noninteractive virtual reality: an EEG and psychophysiology study. Cyberpsychol Behav 9:30–45. https://doi.org/10.1089/cpb.2006.9.30
Bouchard S, Dumoulin S, Talbot J, Ledoux A-A, Phillips J, Monthuy-Blanc J, Labonté-Chartrand G, Robillard G, Cantamesse M, Renaud P (2012) Manipulating subjective realism and its impact on presence: preliminary results on feasibility and neuroanatomical correlates. Interact Comput 24:227–236. https://doi.org/10.1016/j.intcom.2012.04.011
Brain map: parietal lobes. The State of Queensland (2013). https://www.health.qld.gov.au/abios/asp/bparietal
Chang C-Y, Hsu S-H, Pion-Tonachini L, Jung T-P (2020) Evaluation of artifact subspace reconstruction for automatic artifact components removal in multi-channel EEG recordings. IEEE Trans Biomed Eng 67(4):1114–1121. https://doi.org/10.1109/TBME.2019.2930186
Clemente M, Rodríguez A, Rey B, Alcañiz Raya M (2013) Measuring presence during the navigation in a virtual environment using EEG. Stud Health Technol Inform 191:136–40
Cohen MX (2014) Analyzing neural time series data: theory and practice. The MIT Press, Massachusetts
Delgado-Bonal A, Marshak A (2019) Approximate entropy and sample entropy: a comprehensive tutorial. Entropy 21(6):541. https://doi.org/10.3390/e21060541
Dey A, Phoon J, Saha S, Dobbins C, Billinghurst M (2020) Neurophysiological effects of presence in calm virtual environments. In: 2020 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW), pp 744–745 (2020). https://doi.org/10.1109/VRW50115.2020.00223
Dillon C, Keogh E, Freeman J, Davidoff J (2001) Presence: is your heart in it. 4th Int. Wkshp. on Presence
Grassini S, Laumann K, Thorp S, de Martin Topranin V (2021) Using electrophysiological measures to evaluate the sense of presence in immersive virtual environments: an event-related potential study. Brain Behav 11:e2269
Guevara MA, Corsi-Cabrera M (1996) EEG coherence or EEG correlation? Int J Psychophysiol 23(3):145–153. https://doi.org/10.1016/s0167-8760(96)00038-4
Halbig A, Latoschik ME (2021) A systematic review of physiological measurements, factors, methods, and applications in virtual reality. Front Virtual Real 2:89. https://doi.org/10.3389/frvir.2021.694567
Kober S, Kurzmann J, Neuper C (2011) Cortical correlate of spatial presence in 2d and 3d interactive virtual reality: an EEG study. Int J Psychophysiol Off J Int Organ Psychophysiol 83:365–74. https://doi.org/10.1016/j.ijpsycho.2011.12.003
Kober S, Neuper C (2012) Using auditory event-related EEG potentials to assess presence in virtual reality. Int J Hum-Comput Stud 70:577–587. https://doi.org/10.1016/j.ijhcs.2012.03.004
Krokos E, Varshney A (2022) Quantifying VR cybersickness using EEG. Virtual Real 26:1–13. https://doi.org/10.1007/s10055-021-00517-2
Meehan M, Razzaque S, Insko B, Whitton M, Brooks F Jr (2005) Review of four studies on the use of physiological reaction as a measure of presence in Stressful virtual environments. Appl Psychophysiol Biofeedback 30:239–58. https://doi.org/10.1007/s10484-005-6381-3
Moinnereau M-A, Oliveira A, Falk T (2022) Instrumenting a virtual reality headset for at-home gamer experience monitoring and behavioural assessment. Front Virtual Real. https://doi.org/10.3389/frvir.2022.971054
Morling B (2011) Research methods in psychology: evaluating a world of information, 4th edn. W. W. Norton & Company, p 592. ISBN: 978-0-393-89372-4
Omnipres project ist-2001-39237 deliverable 5 measuring presence : a guide to current measurement approaches. (2004)
Palmer JA, Kreutz-delgado K, Makeig S (2011) AMICA: an adaptive mixture of independent component analyzers with shared components. https://sccn.ucsd.edu/~jason/amica_a.pdf
Perrin F, Pernier J, Bertrand O, Echallier JF (1989) Spherical splines for scalp potential and current density mapping. Electroencephalogr Clin Neurophyasiol 72(2):184–187. https://doi.org/10.1016/0013-4694(89)90180-6
Pion-Tonachini L, Kreutz-Delgado K, Makeig S (2019) ICLabel: an automated electroencephalographic independent component classifier, dataset, and website. NeuroImage 198:181–197. https://doi.org/10.1016/j.neuroimage.2019.05.026
Richman JS, Moorman JR (2000) Physiological time-series analysis using approximate entropy and sample entropy. Am J Physiol Heart Circ Physiol 278(6):2039–2049. https://doi.org/10.1152/ajpheart.2000.278.6.h2039
Rosakranse C, Oh SY (2014) Measuring presence: the use trends of five canonical presence questionnaire. In: 15th International workshop on presence
Schwind V, Knierim P, Haas N, Henze N (2019). Using presence questionnaires in virtual reality. https://doi.org/10.1145/3290605.3300590
Skarbez R, Brooks FP Jr, Whitton MC (2017) A survey of presence and related concepts. ACM Comput Surv. https://doi.org/10.1145/3134301
Skarbez R (2016) Plausibility illusion in virtual environments. https://doi.org/10.17615/2MG3-GH93
Slater M (2009) Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc London Ser B Biol Sci 364:3549–57. https://doi.org/10.1098/rstb.2009.0138
Slater M, Usoh M (1993) Representations systems, perceptual position, and presence in immersive virtual environments. Presence 2:221–233. https://doi.org/10.1162/pres.1993.2.3.221
Terkildsen T, Makransky G (2019) Measuring presence in video games: an investigation of the potential use of physiological measures as indicators of presence. Int J Hum Comput Stud 126:64–80. https://doi.org/10.1016/j.ijhcs.2019.02.006
Tran Y, Austin P, Ho C, Craig A, Middleton J, Wrigley P, Siddall P (2022) An exploratory EEG analysis on the effects of virtual reality in people with neuropathic pain following spinal cord injury. Sensors 22:2629. https://doi.org/10.3390/s22072629
Vallat R (2018) Raphael vallat. Independent. https://raphaelvallat.com/bandpower.html
Wang Z, An J, Zhao Y, Wang Z, Yu Y, Jiang T, Wu J (2021) The effect of restorative environment and presence based on virtual reality for anxiety and depression, 55: pp 293–300 . https://doi.org/10.1007/978-3-030-80091-8_34
Winkler I, Debener S, Muller K-R, Tangermann M (2015) On the influence of high-pass filtering on ICA-based artifact reduction in EEG-ERP. In: 2015 37th Annual international conference of the IEEE engineering in medicine and biology society. https://doi.org/10.1109/embc.2015.7319296
Witmer BG, Jerome CJ, Singer MJ (2005) The factor structure of the presence questionnaire. Presence Teleoper Virtual Environ 14(3):298–312
Witmer BG, Singer MJ (1998) Measuring presence in virtual environments: a presence questionnaire. Presence Teleoper Virtual Environ 7(3):225–240
Wobbrock J, Findlater L, Gergle D, Higgins J (2011) The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures 2011:143–146. https://doi.org/10.1145/1978942.1978963
Zhang S, Feng X, Shen Y (2022) Investigating the potential use of EEG for the objective measurement of auditory presence. Appl Sci 12:2647. https://doi.org/10.3390/app12052647
Acknowledgements
The authors would like to thank Prof Ruwan Gopura, Dr.Nuwan Dayananda, The Bionics Lab of University of Moratuwa, and The Biomedical Engineering Lab of University of Moratuwa.
Funding
No external funding was received for this work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author has no competing interests or conflicts or interests to declare that are relevant to this submission.
Ethical approval
The research procedures were approved by the University of Moratuwa Ethics Review Committee (ERN/2020/002).
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bahavan, T.T.N., Navaratnarajah, S., Owinda, D. et al. Towards an objective measurement of presence, place illusion, and plausibility illusion in virtual reality using electroencephalography. Virtual Reality 27, 2649–2664 (2023). https://doi.org/10.1007/s10055-023-00815-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-023-00815-x