More Web Proxy on the site http://driver.im/

research-article

Making you matter: creating interactive VR narratives through experimentation and learning

Authors:

Nathaniel Dirksen,

Michael Hutchinson,

Scott Peterson,

Robert Schiewe,

Wei WangAuthors Info & Claims

DigiPro '19: Proceedings of the 2019 Digital Production Symposium

Article No.: 5, Pages 1 - 9

https://doi.org/10.1145/3329715.3338883

Published: 27 July 2019 Publication History

Abstract

Virtual Reality (VR) is a transformative medium for narrative storytelling where content creators can place an audience member inside the story, give them a role to play, and ultimately make them matter to the characters. Immersive storytelling is fundamentally different from film and games. It requires a new creative toolset that is still in its infancy compared to other entertainment mediums.

We provide a behind the scenes look at our many experimentations, failures, and learnings in developing interactive VR animated narratives spanning four released projects: Invasion!, Asteroids!, Crow: The Legend, and Bonfire. We delve into cinematic techniques for VR, including staging, movement mechanics, and directing the viewer's eye. We explore the role the viewer plays in each of our pieces. Finally, we dive into how we make you matter through nonverbal communication, interactivity that supports the narrative structure, non-linear storytelling, and character AI.

References

[1]

Jeremy N. Bailenson and Nick Yee. 2005. Digital Chameleons: Automatic Assimilation of Nonverbal Gestures in Immersive Virtual Environments. Psychological Science 16, 10 (2005), 814--819. 16181445.

[2]

Giovanni Bertolini and Dominik Straumann. 2016. Moving in a Moving World: A Review on Vestibular Motion Sickness. Frontiers in neurology 7, 14 (Feb. 2016).

[3]

Costas Boletsis. 2017. The New Era of Virtual Reality Locomotion: A Systematic Literature Review of Techniques and a Proposed Typology. Multimodal Technologies and Interaction 1, 4 (2017).

[4]

Larry Cutler, Eric Darnell, Nathaniel Dirksen, Michael Hutchinson, and Scott Peterson. 2018. Crow: The Legend. In ACM SIGGRAPH 2018 Virtual, Augmented, and Mixed Reality (SIGGRAPH '18). ACM, New York, NY, USA, Article 12, 1 pages.

Digital Library

[5]

Larry Cutler, Eric Darnell, Nathaniel Dirksen, Michael Hutchinson, and Wei Wang. 2019. Bonfire. In ACM SIGGRAPH 2019 VR Theatre (SIGGRAPH '19). ACM, New York, NY, USA.

[6]

Eric Darnell, Larry Cutler, Maureen Fan, Kane Lee, and Claudia SouthMartin. 2017. Baobab Studios Asteroids! https://www.oculus.com/experiences/gear-vr/1309677705722446.

[7]

Eric Darnell and Michael Hutchinson. 2016. Invasion!: Exploring Empathy and Agency in VR. In ACM SIGGRAPH 2016 VR Village (SIGGRAPH '16). ACM, New York, NY, USA, Article 10, 2 pages.

Digital Library

[8]

EagleFlight. 2016. Ubisoft Eagle Flight. https://store.steampowered.com/app/408250/Eagle_Flight/.

[9]

Dominik P. Käser, Evan Parker, Adam Glazier, Mike Podwal, Matt Seegmiller, Chun-Po Wang, Per Karlsson, Nadav Ashkenazi, Joanna Kim, Andre Le, Matthias Bühlmann, and Joshua Moshier. 2017. The Making of Google Earth VR. In ACM SIGGRAPH 2017 Talks (SIGGRAPH '17). ACM, New York, NY, USA, Article 63, 2 pages.

Digital Library

[10]

Gustav Kuhn. 2011. Sleights of mind: What the neuroscience of magic reveals about our everyday deceptions.

[11]

Robert McKee. 1997. Story: Substance, Structure, Style and the Principles of Screenwriting. ReganBooks.

[12]

Laura Mingail. 2016. Sleight of Hand: How VR Content Creators Trick Your Brain Like Expert Magicians. https://uploadvr.com/the-secrets-magicians-vr/.

[13]

Katie Salen and Eric Zimmerman. 2003. Rules of Play: Game Design Fundamentals. The MIT Press.

Digital Library

[14]

Ivan E. Sutherland. 1968. A Head-mounted Three Dimensional Display. In Proceedings of the December 9--11, 1968, Fall Joint Computer Conference, Part I (AFIPS '68 (Fall, part I)). ACM, New York, NY, USA, 757--764.

Digital Library

[15]

Elsa Waithe. 2019. How to Write a 5-Minute Comedy Set. http://www.goldcomedy.com/resources/put-together-five-minute-set/.

Cited By

Kritikos YGiariskanis FProtopapadaki EPapanastasiou APapadopoulou EMania K(2023)Audio Augmented Reality OutdoorsProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3597028(199-204)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3597028
Peng XHuang JDenisova AChen HTian FWang HBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)A Palette of Deepened Emotions: Exploring Emotional Challenge in Virtual Reality GamesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376221(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376221

Index Terms

Making you matter: creating interactive VR narratives through experimentation and learning
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality

Recommendations

Towards a narrative theory of virtual reality

Virtual Reality (VR), by its nature and characteristics, is of specific interest to the AI community, particularly in the domains of Storytelling and Intelligent Characters. We argue that VR must be considered a particular narrative medium alongside ...
Imago: presence and emotion in virtual reality
SIGGRAPH '16: ACM SIGGRAPH 2016 VR Village

As virtual reality becomes available to a wider audience, filmmakers are being challenged to create ever more immersive and creative narratives for this quickly evolving medium. While many of the early attempts at virtual reality filmmaking have been ...
Interactive virtual reality animation STRAY SHEEP
SA '16: SIGGRAPH ASIA 2016 VR Showcase

"STRAY SHEEP" is a virtual reality character animation, which uses Oculus. This narrative film follows a quirky and curious lost sheep. The viewer will explore various imaginative environments made from common items of a child's daily life by following ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DigiPro '19: Proceedings of the 2019 Digital Production Symposium

July 2019

52 pages

ISBN:9781450367998

DOI:10.1145/3329715

Conference Chairs:
Sandy Kao
DreamWorks Animation
,
Barbara Balents
BB Consulting
,
Program Chairs:
Trina Roy
Pixar Animation Studios
,
Rachel Rose
Industrial Light & Magic

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

DigiPro '19

Sponsor:

SIGGRAPH

DigiPro '19: The Digital Production Symposium

July 27, 2019

California, Los Angeles

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
320
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kritikos YGiariskanis FProtopapadaki EPapanastasiou APapadopoulou EMania K(2023)Audio Augmented Reality OutdoorsProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3597028(199-204)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3597028
Peng XHuang JDenisova AChen HTian FWang HBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)A Palette of Deepened Emotions: Exploring Emotional Challenge in Virtual Reality GamesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376221(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376221

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents