abstract

WizardOfVR: An Emotion-Adaptive Virtual Wizard Experience

Authors:

Kunal Gupta,

Yuewei Zhang,

Yun Suen Pai,

Mark BillinghurstAuthors Info & Claims

SA '21 XR: SIGGRAPH Asia 2021 XR

Article No.: 18, Pages 1 - 2

https://doi.org/10.1145/3478514.3487628

Published: 14 December 2021 Publication History

Get Access

Abstract

We demonstrate WizardOfVR, a personalized emotion-adaptive Virtual Reality (VR) game akin to a Harry Potter experience, which uses using off-the-shelf physiological sensors to create a real-time biofeedback loop between a user’s emotional state and an adaptive VR environment (VRE). In our demo, the user initially trains the system during a calibration process using Electroencephalogram (EEG), Electrodermal Activity (EDA), and Heart Rate Variability (HRV) physiological signals. After calibration, the user will explore a virtual forest with adapting environmental factors based on a ’SanityMeter’ determined by the user’s real-time emotional state. The overall goal is to provide more balanced, immersive, and optimal emotional virtual experiences.

Supplementary Material

MP4 File (sa21xr-20.mp4)

Supplemental video

Download
136.47 MB

MP4 File (3478514.3487628.mp4)

presentation

Download
200.66 MB

References

[1]

Guillermo Bernal and Pattie Maes. 2017. Emotional beasts: visually expressing emotions through avatars in VR. In Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems. 2395–2402.

Digital Library

Google Scholar

[2]

Margaret M Bradley and Peter J Lang. 1994. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry 25, 1(1994), 49–59.

Crossref

Google Scholar

[3]

Arindam Dey, Hao Chen, Mark Billinghurst, and Robert W Lindeman. 2018. Effects of Manipulating Physiological Feedback in Immersive Virtual Environments. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, 101–111.

Digital Library

Google Scholar

[4]

Paul Ed Ekman and Richard J Davidson. 1994. The nature of emotion: Fundamental questions.Oxford University Press.

Google Scholar

[5]

Barbara L Fredrickson. 2001. The role of positive emotions in positive psychology: the broaden-and-build theory of positive emotions.American psychologist 56, 3 (2001), 218.

Google Scholar

[6]

Kunal Gupta, Jovana Lazarevic, Yun Suen Pai, and Mark Billinghurst. 2020. AffectivelyVR: Towards VR Personalized Emotion Recognition. In 26th ACM Symposium on Virtual Reality Software and Technology. 1–3.

Google Scholar

[7]

Javier Marín-Morales, Carmen Llinares, Jaime Guixeres, and Mariano Alcañiz. 2020. Emotion recognition in immersive virtual reality: From statistics to affective computing. Sensors 20, 18 (2020), 5163.

Crossref

Google Scholar

[8]

Justin Munafo, Meg Diedrick, and Thomas A Stoffregen. 2017. The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Experimental brain research 235, 3 (2017), 889–901.

Google Scholar

Cited By

View all

Sehrt JYilmaz UKosch TSchwind V(2024)Closing the Loop: The Effects of Biofeedback Awareness on Physiological Stress Response Using Electrodermal Activity in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650830(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650830
Nwagu CAlSlaity AOrji R(2023)EEG-Based Brain-Computer Interactions in Immersive Virtual and Augmented Reality: A Systematic ReviewProceedings of the ACM on Human-Computer Interaction10.1145/35932267:EICS(1-33)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593226
Gupta KZhang YGunasekaran TSasikumar PKrishna NPai YBillinghurst M(2023)VRdoGraphy: An Empathic VR Photography Experience2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00352(1013-1014)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00352
Show More Cited By

Recommendations

VR-Wizard: Towards an Emotion-Adaptive Experience in VR
SA '21 Posters: SIGGRAPH Asia 2021 Posters

In this research, we investigate the impact of real-time biofeedback-based emotion adaptive Virtual Reality (VR) environments on the immersiveness, game engagement, and flow state using physiological information such as Electroencephalogram (EEG), ...
Effects on User Experience in an Edutainment Virtual Environment: Comparison Between CAVE and HMD
ECCE '17: Proceedings of the European Conference on Cognitive Ergonomics

The user experience in immersive virtual environment can be broadly defined by the feeling of presence and immersion in a virtual environment. The propensity of feeling "there" and "enveloped by" in the virtual environment seems to be essential in ...
Using Virtual Reality Technology to Enhance the Experience of Immersive Sensation Training Color Applied to the Environment by Means of EEG
ICCBD '19: Proceedings of the 2nd International Conference on Computing and Big Data

The aim of this study explores whether color perception is reinforced by the immersive experience created by virtual reality technology. In an environment that emphasizes vision, the feelings of immersion stimulate people's emotions due to changes in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SA '21 XR: SIGGRAPH Asia 2021 XR

December 2021

40 pages

ISBN:9781450390750

DOI:10.1145/3478514

Editors:
Shuzo John Shiota
CEO, Polygon Pictures Inc., Japan
,
Ayumi Kimura
Research Manager at OLM Digital, Inc., Japan and Program Manager and Collaboration Coordinator at CMIC, Victoria University of Wellington, New Zealand
,
Christian Sandor
Professor, Paris-Saclay University, France
,
Maki Sugimoto
Keio University, Japan

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2021

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Funding Sources

Empathic Computing Programme research grant under the Entrepreneurial Universities (EU) initiative of New Zealand

Conference

SA '21

Sponsor:

SIGGRAPH

SA '21: SIGGRAPH Asia 2021

December 14 - 17, 2021

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)4

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sehrt JYilmaz UKosch TSchwind V(2024)Closing the Loop: The Effects of Biofeedback Awareness on Physiological Stress Response Using Electrodermal Activity in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650830(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650830
Nwagu CAlSlaity AOrji R(2023)EEG-Based Brain-Computer Interactions in Immersive Virtual and Augmented Reality: A Systematic ReviewProceedings of the ACM on Human-Computer Interaction10.1145/35932267:EICS(1-33)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3593226
Gupta KZhang YGunasekaran TSasikumar PKrishna NPai YBillinghurst M(2023)VRdoGraphy: An Empathic VR Photography Experience2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00352(1013-1014)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00352
He HKim CPai YMinamizawa K(2023)Project Corvus: A Virtual Reality Horror Tool for Improving Self-Efficacy2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00140(652-656)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00140
Rokhsaritalemi SSadeghi-Niaraki AChoi S(2023)Exploring Emotion Analysis Using Artificial Intelligence, Geospatial Information Systems, and Extended Reality for Urban ServicesIEEE Access10.1109/ACCESS.2023.330763911(92478-92495)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3307639

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplementary Material

References

Cited By

Recommendations

VR-Wizard: Towards an Emotion-Adaptive Experience in VR

Effects on User Experience in an Edutainment Virtual Environment: Comparison Between CAVE and HMD

Using Virtual Reality Technology to Enhance the Experience of Immersive Sensation Training Color Applied to the Environment by Means of EEG

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations