[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3441000.3441028acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
Work in Progress

Creating 3D worlds through storytelling and narration

Published: 15 February 2021 Publication History

Abstract

While contemporary game engine tools have allowed a lower barrier of entry into creating 3D environments, many rely on engineering, architectural or cartographic approaches. While useful, this usually facilitates very particular methods of 3D space creation. In this paper, we present our tool for creating 3D spaces through the use of narration and storytelling as an interface. Our platform utilizes voice recognition to allow users to narrate a story or event and have elements of the story appear in 3D space as virtual objects in real-time. Through further voice commands or the use of drag-and-drop controls, users can then reconfigure these objects to better suit their story or create new variations of the story. Our platform is designed for immersive systems such as VR HMDs, 3D-enabled cylindrical screens, stereo walls, and non-immersive ones such as desktops and tablets allowing for accessibility and collaboration. A novel contribution of this paper is this method of building worlds through narration. To provide some insight into its capabilities and the reasoning behind design decisions, an account of constructing the story Lessons in Vinyl within the tool during early development is presented.

Supplementary Material

p677-edmond-supplement (p677-edmond-supplement.pdf)
Lessons in Vinyl

References

[1]
Conan Bourke and Tomasz Bednarz. 2019. Multi-Modal High-End Visualization System. In Proceedings of the 17 th International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI‘19). Association for Computing Machinery, Brisbane, QLD, 1-2. https://doi.org/10.1145/3359997.3365731.
[2]
Jaimee Brennan 2016. Entertainment Center by Hope Bremiller. Retrieved August 21, 2020 from https://www.turbosquid.com/3d-models/free-obj-mode-victorian-entertainment-center/1078494.
[3]
Nguyen Thong Dang, Monica Tavanti, Ivan Rankin and Matthew Cooper, 2009. A comparison of different input devices for a 3D environment. Int. J. Ind. Ergonom. 39, 3 (May 2009), 554-563. https://doi.org/10.1016/j.ergon.2008.10.016.
[4]
Franca Garzotto and Matteo Forfori. 2006. FaTe2: storytelling edutainment experiences in 2D and 3D collaborative spaces. In Proceedings of the 2006 conference on Interaction design and children (IDC '06). Association for Computing Machinery, New York, NY, USA, 113–116. https://doi.org/10.1145/1139073.1139102.
[5]
Hadwa 2010. Coffee Maker. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/coffee-making-machine-3ds-free/541555.
[6]
Hend_Z 2015. Vase 01. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/free-max-model-vase/963988.
[7]
Daniel Hepperle, Yannick Weiß, Andreas Siessa and Matthias Wölfel, 2018. 2D, 3D or speech? A case study on which user interface is preferable for what kind of object interaction in immersive virtual reality. Comput. Graph. 82 (August 2019), 321-331. https://doi.org/10.1016/j.cag.2019.06.003.
[8]
HighPolyCNC 2016. Ring Little Dragon. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-rings-printing/1044679.
[9]
McCloud, Scott. 1993. Understanding Comics. William Morrow. New York, USA.
[10]
MrCAD 2000. Model2. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-dresser-model/127879.
[11]
pholubz4 2002. Jar.3ds. Retrieved August 21, 2020 from https://www.turbosquid.com/3d-models/jar-3ds-free/180667.
[12]
TalismanST 2019. 3D diamond ring model. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-jewellery-diamond-ring-modell-model-1466699.
[13]
Matthias Thöny, Raimund Schnürer, René Sieber, Lorenz Hurni and Renato Pajarola. ISPRS Int. J. Geo-Inf. 7, 3 (March 2018), 1-4. https://doi.org/10.3390/ijgi7030123.
[14]
Myrthe L. Tielman, Mark A. Neerincx, Rafael Bidarra, Ben Kybartas and Willem-Paul Brinkman. 2017. A Therapy System for Post-Traumatic Stress Disorder Using a Virtual Agent and Virtual Storytelling to Reconstruct Traumatic Memories. J. Med. Syst. 41 (April 2017), 1-10. https://doi.org/10.1007/s10916-017-0771-y.
[15]
Tomoplace 2020. 3D Refrigerator. Retrieved August 21, 2020, from https://www.turbosquid.com/3d-models/3d-refrigerator-1506717.
[16]
Turbosquid 2020. Turbosquid. Retrieved August 21, 2020, from https://www.turbosquid.com/.
[17]
Unity Technologies 2020. ProBuilder. Retrieved August 21, 2020, from https://unity3d.com/unity/features/worldbuilding/probuilder.
[18]
Unity Technologies 2020 Unity3D. Retrieved August 21, 2020, from https://unity.com/.
[19]
Theodor G Wyeld, Brett Leavy, Joti Carroll, Craig Gibbons, Brendan Ledwich and James Hills. 2007. The Ethics of Indigenous Storytelling: using the TorqueGame Engine to Support Australian Aboriginal Cultural Heritage. In Proceedings of the 2007 DiGRA International Conference: Situated Play (DIGRA’07). Digital Games Research Association, Tokyo, Japan, 261-268. http://www.digra.org/wp-content/uploads/digital-library/07312.11188.pdf.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer Interaction
December 2020
764 pages
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 February 2021

Check for updates

Author Tags

  1. collaborative storytelling
  2. digital and interaction design
  3. immersive environments
  4. immersive prototyping
  5. narration

Qualifiers

  • Work in progress
  • Research
  • Refereed limited

Conference

OzCHI '20

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 114
    Total Downloads
  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Dec 2024

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media