Abstract
There is a significant increase in the use of virtual reality in scientific experiments in the fields of ergonomics, education, and psychology among others. Many researchers successfully provoked different affective states in participants in order to capture physiological correlates or apply psychotherapeutic techniques. All these studies employed different stimuli, like 3D pictures, computer-built graphics and 180- or 360-degree panoramic photographs. In an attempt to begin the standardization of the measurements, we propose PanoEmo, a set of affective 360-degree photographic panoramas. Our aim was to explore the emotional reactions in response to PanoEmo, based on self-report scales, somatic, and vegetative affective indices. Fifty-five participants watched 45 photographic panoramas of different valence during 20 s without a special task. Self-reported valence correlated positively to zygomaticus major and negatively to corrugator supercilii electromyographic activity. Zygomaticus major also correlated positively to arousal. Respiratory rate correlated negatively to valence. Pleasant panoramas provoked a slower respiratory rate, while unpleasant ones increased it. Skin conductance response was positively related to self-reported arousal. Unexpectedly, heart rate did not correlate to self-report measures during the whole epoch, but it correlated positively around 5 s after the panorama onset. As a limitation, we should mention that our database contains a much higher number of positive panoramas. Although we expected the equal number of negative, neutral, and positive panoramas, we found a prevalence of positive ones. Nonetheless, subsequent studies should enrich the set with more negative panoramas to get a homogeneously distributed database.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The links to all stimulus material (360-degree panoramas) can be found in Table 1. All the physiological and self-report data were uploaded to https://osf.io/e9f4n/.
References
Aluja A, Rossier J, Blanch Á, Blanco E, Martí-Guiu M, Balada F (2015) Personality effects and sex differences on the International Affective Picture System (IAPS): a Spanish and Swiss study. Pers Individ Differ 77:143–148. https://doi.org/10.1016/j.paid.2014.12.058
Astor P, Adam M, Jähnig C, Seifert S (2013) The joy of winning and the frustration of losing: a psychophysiological analysis of emotions in first-price sealed-bid auctions. J Neurosci Psychol Econ 6:14–30. https://doi.org/10.1037/a0031406
Baker C (2021) Emotional responses in virtual reality environments. ProQuest Dissertations Publishing, p 163
Balan O, Moise G, Moldoveanu A, Leordeanu M, Moldoveanu F (2020) Automatic adaptation of exposure intensity in VR acrophobia therapy, based on deep neural networks. In: 27th European conference on information systems, ECIS 2019
Bastiaansen M, Oosterholt M, Mitas O, Han D, Lub X (2022) An emotional roller coaster: electrophysiological evidence of emotional engagement during a roller-coaster ride with virtual reality add-on. J Hosp Tour Res 46:29–54. https://doi.org/10.1177/1096348020944436
Bates D., Maechler M., Bolker B., Walker S., Christensen RHB, Singmann H, Green P (2009) Package ‘lme4’ CRAN. https://github.com/lme4/lme4/
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (methodol) 57:289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
Bradley MM, Codispoti M, Cuthbert BN, Lang PJ (2001) Emotion and motivation I: defensive and appetitive reactions in picture processing. Emotion 1:276–298. https://doi.org/10.1037/1528-3542.1.3.276
Braithwaite JJ, Watson DG, Jones R, Rowe M (2013) A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. University of Birmingham, Birmingham
Cacioppo JT, Berntson GG, Klein DJ, Poehlmann KM (1997) Psychophysiology of emotion across the life span. Annu Rev Gerontol Geriatr 17:27–74
Cacioppo JT, Petty RE (1981) Electromyograms as measures of extent and affectivity of information processing. Am Psychol 36:441–456. https://doi.org/10.1037/0003-066X.36.5.441
Cacioppo JT, Petty RE, Losch ME, Kim HS (1986) Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. J Pers Soc Psychol 50:260–268. https://doi.org/10.1037/0022-3514.50.2.260
Cameirão MS, Faria AL, Paulino T, Alves J, Bermúdez i Badia S (2016) The impact of positive, negative and neutral stimuli in a virtual reality cognitive-motor rehabilitation task: a pilot study with stroke patients. J NeuroEng Rehabil 13:70. https://doi.org/10.1186/s12984-016-0175-0
Cebeci B, Celikcan U, Capin TK (2019) A comprehensive study of the affective and physiological responses induced by dynamic virtual reality environments. Comput Anim Virtual Worlds 30:e1893
Centifanti LCM, Gillespie SM, Thomson ND (2021) Skin conductance responses to a discrete threat in virtual reality: associations with psychopathy and anxiety. J Psychopathol Behav Assess 44:39–50. https://doi.org/10.1007/s10862-021-09943-7
Chirico A, Ferrise F, Cordella L, Gaggioli A (2018) Designing awe in virtual reality: an experimental study. Front Psychol 8:2351. https://doi.org/10.3389/fpsyg.2017.02351
Cipresso P, Giglioli IAC, Raya MA, Riva G (2018) The past, present, and future of virtual and augmented reality research: a network and cluster analysis of the literature. Front Psychol 9:2086. https://doi.org/10.3389/fpsyg.2018.02086
Diemer J, Alpers GW, Peperkorn HM, Shiban Y, Mühlberger A (2015) The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front Psychol 6:26. https://doi.org/10.3389/fpsyg.2015.00026
de Groot JHB, van Houtum LAEM, Gortemaker IYY, Chen W, Zhou W, Smeets MAM (2018) Beyond the west: chemosignaling of emotions transcends ethno-cultural boundaries. Psychoneuroendocrinology 98:177–185. https://doi.org/10.1016/j.psyneuen.2018.08.005
Dignath D, Berger A, Spruit M, van Steenbergen H (2019) Temporal dynamics of error-related corrugator supercilii and zygomaticus major activity: evidence for implicit emotion regulation following errors. Int J Psychophysiol 146:208–216. https://doi.org/10.1016/j.ijpsycho.2019.10.003
Dimberg U (1988) Facial electromyography and the experience of emotion. J Psychophysiol 2(4):277–282. https://doi.org/10.1111/j.1469-8986.1990.tb01962.x
Dimberg U, Thunberg M (2012) Empathy, emotional contagion, and rapid facial reactions to angry and happy facial expressions. PsyCh J 1(2):118–127. https://doi.org/10.1002/pchj.4
Ekman P, Friesen WV (1975) Unmasking the face: a guide to recognizing emotions from facial clues. Prentice-Hall, Englewood Cliffs
Egan D, Brennan S, Barrett J, Qiao Y, Timmerer C, Murray N (2016) An evaluation of Heart Rate and ElectroDermal Activity as an objective QoE evaluation method for immersive virtual reality environments. In: 2016 Eighth international conference on quality of multimedia experience (QoMEX), pp 1–6. https://doi.org/10.1109/QoMEX.2016.7498964
Felnhofer A, Kothgassner OD, Schmidt M, Heinzle A-K, Beutl L, Hlavacs H, Kryspin-Exner I (2015) Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios. Int J Hum Comput Stud 82:48–56. https://doi.org/10.1016/j.ijhcs.2015.05.004
Fridlund AJ, Cacioppo JT (1986) Guidelines for human electromyographic research. Psychophysiology 23:567–589. https://doi.org/10.1111/j.1469-8986.1986.tb00676.x
Gilpin G, Gain J, Lipinska G (2021) The physiological signature of sadness: a comparison between text, film and virtual reality. Brain Cogn 152:105734. https://doi.org/10.1016/j.bandc.2021.105734
Golland Y, Hakim A, Aloni T, Schaefer S, Levit-Binnun N (2018) Affect dynamics of facial EMG during continuous emotional experiences. Biol Psychol 139:47–58. https://doi.org/10.1016/j.biopsycho.2018.10.003
Guimard Q, Robert F, Bauce C, Ducreux A, Sassatelli L (2022). PEM360: a dataset of 360° videos with continuous Physiological measurements, subjective Emotional ratings and Motion traces. In: MMSys 2022—13th ACM multimedia systems conference, June 2022, Athlone, Ireland. https://doi.org/10.1145/3524273.3532895ff.ffhal-03710323f
Hart B, Struiksma ME, van Boxtel A, van Berkum J (2018) Emotion in stories: facial EMG evidence for both mental simulation and moral evaluation. Front Psychol 9:613. https://doi.org/10.3389/fpsyg.2018.00613
Herrero R, Garcia-Palacios A, Castilla D, Molinari G, Botella C (2014) Virtual reality for the induction of positive emotions in the treatment of fibromyalgia: a pilot study over acceptability, satisfaction, and the effect of virtual reality on mood. Cyberpsychol Behav Soc Netw 17:379–384. https://doi.org/10.1089/cyber.2014.0052
Higuera-Trujillo JL, Maldonado JLT, Millán CL (2017) Psychological and physiological human responses to simulated and real environments: a comparison between Photographs, 360 Panoramas, and Virtual Reality. Appl Ergon 65:398–409
Homma I, Masaoka Y (2008) Breathing rhythms and emotions. Exp Physiol 93:1011–1090. https://doi.org/10.1113/expphysiol.2008.04242
Huang X, Liu C, Wei Z, Leung XY (2021) How children experience virtual reality travel: a psycho-physiological study based on flow theory. J Hospit Tour Technol 12:777–790. https://doi.org/10.1108/JHTT-07-2020-0186
Ito TA, Larsen JT, Smith NK, Cacioppo JT (1998) Negative information weighs more heavily on the brain: the negativity bias in evaluative categorizations. J Pers Soc Psychol 75:887–900. https://doi.org/10.1037/0022-3514.75.4.887
Hidaka K, Qin H, Kobayashi J (2017) Preliminary test of affective virtual reality scenes with head mount display for emotion elicitation experiment. In: 17th International conference on control and automation system (ICCAS), pp 325–329. https://doi.org/10.23919/ICCAS.2017.8204459
Hodes RL, Cook EW III, Lang PJ (1985) Individual differences in autonomic response: conditioned association or conditioned fear? Psychophysiology 22:545–560. https://doi.org/10.1111/j.1469-8986.1985.tb01649.x
Knaust T, Felnhofer A, Kothgassner OD, Hoellmer H, Gorzka RJ, Schulz H (2022) Exposure to virtual nature: the impact of different immersion levels on skin conductance level, heart rate, and perceived relaxation. Virtual Real 26:925–938. https://doi.org/10.1007/s10055-021-00595-2
Kop WJ, Synowski SJ, Newell ME, Schmidt LA, Waldstein SR, Fox NA (2011) Autonomic nervous system reactivity to positive and negative mood induction: the role of acute psychological responses and frontal electrocortical activity. Biol Psychol 86:230–238. https://doi.org/10.1016/j.biopsycho.2010.12.003
Kosonogov V (2020) The effects of the order of picture presentation on the subjective emotional evaluation of pictures. Psicologia 34:171–178. https://doi.org/10.17575/psicologia.v34i2.1608
Künecke J, Hildebrandt A, Recio G, Sommer W, Wilhelm O (2014) Facial EMG responses to emotional expressions are related to emotion perception ability. PLoS ONE 9:e84053. https://doi.org/10.1371/journal.pone.0084053
Lang PJ, Greenwald MK, Bradley MM, Hamm AO (1993) Looking at pictures: affective, facial, visceral, and behavioral reactions. Psychophysiology 30:261–273. https://doi.org/10.1111/j.1469-8986.1993.tb03352.x
Larsen J, Norris C, Cacioppo J (2003) Effects of positive and negative affect on electromyography activity over zygomaticus major and corrugator supercilii. Psychophysiology 40:776–785. https://doi.org/10.1111/1469-8986.00078
Li BJ, Bailenson JN, Pines A, Greenleaf WJ, Williams LM (2017) A public database of immersive VR videos with corresponding ratings of arousal, valence, and correlations between head movements and self report measures. Front Psychol 8:2116. https://doi.org/10.3389/fpsyg.2017.02116
Lüdecke D, Patil I, Ben-Shachar M, Wiernik B, Bacher E, Thériault R, Makowski D (2022). easystats: framework for easy statistical modeling, visualization, and reporting. CRAN. Available from https://easystats.github.io/easystats/
Masaoka Y, Homma I (2001) The effect of anticipatory anxiety on breathing and metabolism in humans. Respir Physiol 128:171–177. https://doi.org/10.1016/S0034-5687(01)00278-X
Marchiori E, Niforatos E, Preto L (2018) Analysis of users’ heart rate data and self-reported perceptions to understand effective virtual reality characteristics. Inform Technol Tour 18:33–155. https://doi.org/10.1007/s40558-018-0104-0
Marín Morales J (2020) Modelling human emotions using immersive virtual reality, physiological signals and behavioural responses. Doctoral dissertation, Universitat Politècnica de València
Marín-Morales J, Higuera- Trujillo JL, Guixeres J, Llinares C, Alcañiz M, Valenza G (2021) Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: comparing real and virtual scenarios. PLoS ONE 16:e0254098. https://doi.org/10.1371/journal.pone.0254098
Martin GN (2019) (Why) do you like scary movies? A review of the empirical research on psychological responses to horror films. Front Psychol 10:2298. https://doi.org/10.3389/fpsyg.2019.02298
Martínez-Rodrigo A, García-Martínez B, Alcaraz R, Fernández-Caballero A, González P (2017) Study of electroencephalographic signal regularity for automatic emotion recognition. In: 11th International conference on ubiquitous computing and ambient intelligence: UCAmI 2017, Philadelphia, PA, USA, November 7–10, 2017, Proceedings. Springer International Publishing, pp 766–777
Massetti T, da Silva TD, Crocetta TB, Guarnieri R, de Freitas BL, Bianchi Lopes P, Watson S, Tonks J, de Mello Monteiro CB (2018) The clinical utility of virtual reality in neurorehabilitation: a systematic review. J Cent Nerv Syst Dis 10:1–18. https://doi.org/10.1177/1179573518813541
Mavridou I (2021) Affective state recognition in virtual reality from electromyography and photoplethysmography using head-mounted wearable sensors. Doctoral thesis (doctoral), Bournemouth University, p 369
Medved V (2021) Measurement and analysis of human locomotion. Springer, Berlin
Meuleman B, Rudrauf D (2018) Induction and profiling of strong multi-componential emotions in virtual reality. IEEE Trans Affect Comput 12:189–202. https://doi.org/10.1109/TAFFC.2018.2864730
Mikels JA, Fredrickson BL, Larkin GR, Lindberg CM, Maglio SJ, Reuter-Lorenz PA (2005) Emotional category data on images from the international affective picture system. Behav Res Method 37:626–630. https://doi.org/10.3758/BF03192732
Mohammed AR, Kosonogov V, Lyusin D (2021) Expressive suppression versus cognitive reappraisal: effects on self-report and peripheral psychophysiology. Int J Psychophysiol 167:30–37. https://doi.org/10.1016/j.ijpsycho.2021.06.007
Munafo J, Diedrick M, Stoffregen TA (2017) The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 235:889–901. https://doi.org/10.1007/s00221-016-4846-7
Pallavicini F, Pepe A (2020) Virtual reality games and the role of body involvement in enhancing positive emotions and decreasing anxiety: within-subjects pilot study. JMIR Serious Games 8:e15635. https://doi.org/10.2196/15635
Peira N, Fredrikson M, Pourtois G (2014) Controlling the emotional heart: heart rate biofeedback improves cardiac control during emotional reactions. Int J Psychophysiol 91:225–231. https://doi.org/10.1016/j.ijpsycho.2013.12.008
Peperkorn HM, Mühlberger A (2013) The impact of different perceptual cues on fear and presence in virtual reality. Annu Rev Cyber Ther Telemed 11:75–79. https://doi.org/10.3233/978-1-61499-282-0-75
Philip L, Martin J-C, Clavel C (2018) Rapid facial reactions in response to facial expressions of emotion displayed by real versus virtual faces. I-Percept 9:1–18. https://doi.org/10.1177/2041669518786527
Riva G, Mantovani F, Capideville CS, Preziosa A, Morganti F, Villani D, Gaggioli A, Botella C, Alcañiz M (2007) Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychol Behav 10:45–56. https://doi.org/10.1089/cpb.2006.9993
Rockstroh C, Blum J, Göritz AS (2019) Virtual reality in the application of heart rate variability biofeedback. Int J Hum Comput Stud 130:209–220. https://doi.org/10.1016/j.ijhcs.2019.06.011
Sánchez-Navarro JP, Martínez-Selva JM, Torrente G, Román F (2008) Psychophysiological, behavioral, and cognitive indices of the emotional response: a factor-analytic study. Span J Psychol 11:16–25. https://doi.org/10.1017/s1138741600004078
Sánchez-Navarro JP, Maldonado EF, Martínez-Selva JM, Enguix A, Ortiz C (2012) Salivary alpha-amylase changes promoted by sustained exposure to affective pictures. Psychophysiology 49(12):1601–1609. https://doi.org/10.1111/j.1469-8986.2012.01475.x
Shiota MN, Neufeld SL, Yeung WH, Moser SE, Perea EF (2011) Feeling good: autonomic nervous system responding in five positive emotions. Emotion 11:1368–1378. https://doi.org/10.1037/a0024278
Slobounov SM, Ray W, Johnson B, Slobounov E, Newell KM (2015) Modulation of cortical activity in 2D versus 3D virtual reality environments: an EEG study. Int J Psychophysiol 95:254–260. https://doi.org/10.1016/j.ijpsycho.2014.11.003
Susindar S, Sadeghi M, Huntington L, Singer A, Ferris TK (2019) The feeling is real: emotion elicitation in virtual reality. In: Proceedings of the human factors and ergonomics society annual meeting, vol 63, pp 252–256. https://doi.org/10.1177/1071181319631509
Tabbaa L, Searle R, Bafti SM, Hossain MM, Intarasisrisawat J, Glancy M, Ang CS (2021) VREED: virtual reality emotion recognition dataset using eye tracking & physiological measures. Proc ACM Interact Mob Wearable Ubiquitous Technol 5(4):1–20
Tan JW, Walter S, Scheck A, Hrabal D, Hoffmann H, Kessler H, Traue HC (2012) Repeatability of facial electromyography (EMG) activity over corrugator supercilii and zygomaticus major on differentiating various emotions. J Ambient Intell Hum Comput 3:3–10. https://doi.org/10.1007/s12652-011-0084-9
Task Force of the European Society of Cardiology (1996) Guidelines, heart rate variability, standards of measurement, physiological interpretation, and clinical use. Eur Heart J 17:354–381
Tian F, Hua M, Zhang W, Li Y (2021) Emotional arousal in 2D versus 3D virtual reality environments. PLoS ONE 16:e0256211. https://doi.org/10.1371/journal.pone.0256211
Toet A, Heijn F, Brouwer AM, Mioch T, van Erp JB (2020) An immersive self-report tool for the affective appraisal of 360 VR videos. Front Virtual Real 1:552587. https://doi.org/10.3389/frvir.2020.552587
Venables PH, Gartshore SA, O’Riordan PW (1980) The function of skin conductance response recovery and rise time. Biol Psychol 10:1–6. https://doi.org/10.1016/0301-0511(80)90002-2
Wilcox IM, Allison RS, Elfassy S, Grelik C (2006) Personal Space in Virtual Reality. Proc Hum Factors Ergon Soc Annu Meet 3:412–428. https://doi.org/10.1145/1190036.1190041
Xue T, El Ali A, Zhang T, Ding G, Cesar P (2021a) CEAP-360VR: a continuous physiological and behavioral emotion annotation dataset for 360 VR videos. IEEE Trans Multimed 25:243–255. https://doi.org/10.1109/TMM.2021.3124080
Xue T, El Ali A, Zhang T, Ding G, Cesar P (2021b) Rcea-360vr: real-time, continuous emotion annotation in 360 VR videos for collecting precise viewport-dependent ground truth labels. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp 1–15
Funding
The publication was prepared within the framework of the Academic Fund Program at HSE University (Grant No. 23-00-009, Vegetative markers of emotional states).
Author information
Authors and Affiliations
Contributions
Conceptualization, Methodology: VK; Formal analysis: VK, GH, IZ; Investigation: GH, IZ; Writing—original draft preparation: VK, GH, IZ; Writing—review and editing: VK, GH, IZ Funding acquisition, Supervision: VK. All authors confirmed the submitted version.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kosonogov, V., Hajiyeva, G. & Zyabreva, I. PanoEmo, a set of affective 360-degree panoramas: a psychophysiological study. Virtual Reality 28, 3 (2024). https://doi.org/10.1007/s10055-023-00900-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10055-023-00900-1