Abstract
This paper introduces a system for real-time physiological measurement, analysis, and metaphorical visualization within a virtual environment (VE). Our goal is to develop a method that allows humans to unconsciously relate to parts of an environment more strongly than to others, purely induced by their own physiological responses to the virtual reality (VR) displays. In particular, we exploit heart rate, respiration, and galvanic skin response in order to control the behavior of virtual characters in the VE. Such unconscious processes may become a useful tool for storytelling or assist guiding participants through a sequence of tasks in order to make the application more interesting, e.g., in rehabilitation. We claim that anchoring of subjective bodily states to a virtual reality (VR) can enhance a person’s sense of realism of the VR and ultimately create a stronger relationship between humans and the VR.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Akizuki, H., Uno, A., Arai, K., Morioka, S., Ohyama, S., Nishiike, S., Tamura, K., Takeda, N.: Effects of immersion in virtual reality on postural control. Neurosci. Lett. 379(1), 23–26 (2005)
Andreassi, J.L.: Psychophysiology Human Behavior and Physiological Response. Erlbaum Associates, Hillsdale (2000)
Antley, A., Slater, M.: The effect on lower spine muscle activation of walking on a narrow beam in virtual real. IEEE Trans. Vis. Comput. Graph. (2010). http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.26
Brogni, A., Vinayagamoorthy, V., Steed, A., Slater, M.: Responses of participants during an immersive virtual environment experience. Int. J. Virtual Real. 6(2), 1–10 (2007)
Cardillo, C., Russo, M., LeDuc, P., Torch, W.: Quantitative EEG changes under continuous wakefulness and with fatigue countermeasures: implications for sustaining aviator performance. In: Schmorrow, D., Reeves, L. (eds.) Foundations of Augmented Cognition. Lecture Notes in Computer Science, pp. 137–146. Springer, Berlin (2007)
Carrozzino, M., Tecchia, F., Bacinelli, S., Cappelletti, C., Bergamasco, M.: Lowering the development time of multimodal interactive application: the real-life experience of the XVR project. In: ZhiYing, S.Z., Ping, L.S. (eds.) Proc. of the 2005 ACM SIGCHI Intern. Conf. on Advances in Comput. Entertain. Technol., pp. 270–273. Valencia (2005)
Dawson, M.E., Schell, A.E., Filion, D.L.: The electrodermal system. In: Cacioppo, J.T., Tassinary, L.G., Berntson, G.G. (eds.) Handbook of Psychophysiology, pp. 200–223. Cambridge Univ. Press, Cambridge (2007)
Garau, M., Slater, M., Pertaub, D.P., Razzaque, S.: The responses of people to virtual humans in an immersive virtual environment. Presence: Teleoper. Virtual Environ. 14(1), 104–116 (2005)
Gillies, M., Slater, M.: Non-verbal communication for correlational characters. In: The 8th Annu. Intern. Workshop on Presence, vol. 8, pp. 103–106 (2005)
Groenegress, C., Holzner, C., Guger, C., Slater, M.: Effects of BCI use on reported presence in a virtual environment. Presence: Teleoper. Virtual Environ. (2010, in press)
Groenegress, C., Thomsen, M.R., Slater, M.: Correlations between vocal input and visual response apparently enhance presence in virtual environments. Cyberpsychol. Behav. 12(4), 429–431 (2009)
Hall, E.T.: The Hidden Dimension. Doubleday, Garden City (1966)
Heeter, C.: Being there: the subjective experience of presence. Presence: Teleoper. Virtual Environ. 1(2), 262–271 (1992)
Huang, R.S., Jung, T.P., Makeig, S.: Event-related brain dynamics in continuous sustained-attention tasks. In: Schmorrow, D.D., Reeves, L.M. (eds.) Augmented Cognition. Lecture Notes in Computer Science, vol. 4565, pp. 65–74. Springer, Berlin (2007). doi:10.1007/978-3-540-73216-7_8
Jang, D.P., Kim, I.Y., Nam, S.W., Wiederhold, B.K., Wiederhold, M.D., Kim, S.I.: Analysis of physiological response to two virtual environments: driving and flying simulation. Cyberpsychol. Behav. 5(1), 11–18 (2002)
Leeb, R., Kleinrath, C., Guger, C., Scherer, R., Friedman, D., Slater, M., Pfurtscheller, G.: Using a BCI as a navigation tool in virtual environments. In: 2nd Intern. Brain-Comput. Interface Workshop and Train., pp. 49–50 (2004)
Leeb, R., Settgast, V., Fellner, D., Pfurtscheller, G.: Self-paced exploration of the Austrian national library through thought. Int. J. Bioelectromagn. 9(4), 237–244 (2007)
Meehan, M., Insko, B., Whitton, M.C., Brooks, F.P.: Physiological measures of presence in stressful virtual environments. ACM Trans. Graph. 21(3), 645–652 (2002)
Meehan, M., Razzaque, S., Whitton, M.C., Brooks, F.P.: Effect of latency on presence in stressful virtual environments. In: IEEE Virtual Real. pp. 141–148 (2003)
Nagai, Y., Critchley, H.D.: Novel therapeutic application of galvanic skin response (GSR) biofeedback to a neurological disorder: mechanisms underlying biofeedback in epilepsy management. In: New Research on Biofeedback, pp. 1–31. Nova Science, Hauppauge (2007)
Pan, X., Gillies, M., Slater, M.: Male bodily responses during an interaction with a virtual woman. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) Intell. Virtual Agents, pp. 89–96. Springer, Berlin (2008)
Pertaub, D.P., Slater, M., Barker, C.: An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoper. Virtual Environ. 11(1), 68–78 (2002)
Slater, M.: Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Phil. Trans. R. Soc. B 364(1535), 3549–3557 (2009)
Slater, M., Antley, A., Davison, A., Swapp, D., Guger, C., Barker, C., Pistrang, N., Sanchez-Vives, M.V.: A virtual reprise of the Stanley Milgram obedience experiments. PLoS ONE. http://www.plosone.org/article/fetchArticle.action?articleURI=info%3Adoi%2F10.1371%2Fjournal.pone.0000039 (2006). Accessed 12 January 2010
Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., Friedman, D.: Analysis of physiological responses to a social situation in an immersive virtual environment. Presence: Teleoper. Virtual Environ. 15(5), 553–569 (2006)
Slater, M., Pérez Marcos, D., Ehrsson, H., Sanchez-Vives, M.V.: Towards a digital body: the virtual arm illusion. Front. Hum. Neurosci. 2(6), 1–8 (2008)
Slater, M., Spanlang, B., Sanchez-Vives, M.V., Blanke, O.: First person experience of body transfer in virtual reality. Plos ONE (2010, in press)
Spanlang, B.: HALCA Hardware Accelerated Library for Character Animation. Technical report 2009-1, Event Lab (2009)
Tarvainen, M.P., Koistinen, A.S., Valkonen-Korhonen, M., Partanen, J., Karjalainen, P.A.: Analysis of galvanic skin responses with principal components and clustering techniques. IEEE Biomed. Eng. 48(10), 1071–1079 (2001)
Slater, M., Usoh, M., Steed, A.: Taking steps: the influence of a walking technique on presence in virtual reality. ACM Trans. Comput.-Hum. Interact. 2(3), 201–219 (1995)
Venables, P.H., Christie, M.J.: Electrodermal activity. In: Martin, I., Venables, P.H. (eds.) Techniques in Psychopsychology, pp. 2–67. Wiley, New York (1980)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Groenegress, C., Spanlang, B. & Slater, M. The physiological mirror—a system for unconscious control of a virtual environment through physiological activity. Vis Comput 26, 649–657 (2010). https://doi.org/10.1007/s00371-010-0471-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-010-0471-9