Duet: Improvising Spatial Dialogues with an Artificially Intelligent Agent
Pages 57 - 60
Abstract
This paper presents an experimental framework for a virtual reality artwork, Duet, that employs a combination of live, full body motion capture and Oculus Rift HMD to construct an experience through which a human User can spatially interact with an artificially intelligent Agent. The project explores conceptual notions of embodied knowledge transfer, shared poetics of movement and distortions of the body schema. Within this context, both the User and the Agent become performers, constructing an intimate and spontaneously generated proximal space. The project generates a visualization of the relationship between the User and the Agent without the context of a fixed VR landscape or architecture. The Agent's ability to retain and accumulate movement knowledge in a way that mimics human learning transforms an interactive experience into a collaborative one. The virtual representation of both performers is distorted and amplified in a dynamic manner, enhancing the potential for creative dialogue between the Agent and the User.
References
[1]
Blake, J. Natural User Interfaces. In .NET --WPF 4, surface 2, and Kinect. Manning Publications.
[2]
Roupé, M., Bosch-Sijtsema, P. and Johansson, M. Interactive navigation interface for Virtual Reality using the human body. Computers, Environment and Urban Systems, 43(1/1/January 2014 2014), 42--50.
[3]
Kohonen, T. Self-organization and associative memory. Springer-Verlag, Berlin; New York:, 1989.
[4]
Kohonen, T. Self-organizing maps. Springer, Berlin; New York:, 1997.
[5]
Morie, J. F. Performing in (virtual) spaces: Embodiment and being in virtual environments. International Journal of Performance Arts & Digital Media, 3, (2/3 2007), 123--138
[6]
McCormick, J., Vincs, K., Nahavandi, S. and Creighton, D. Learning to dance with a human. In Proceedings of (Sydney, Australia, 2013). ISEA International, Australian Network for Art & Technology, University of Sydney, Sydney, 2013.
[7]
McCormick, J., Vincs, K., Nahavandi, S., Creighton, D. and Hutchison, S. Teaching a Digital Performing Agent: Artificial Neural Network and Hidden Markov Model for recognising and performing dance movement. In Proceedings of the 2014 International Workshop on Movement and Computing (Paris, France, 2014), ACM, Paris, 2014.
[8]
Burgess, N. Spatial memory: how egocentric and allocentric combine, Trends In Cognitive Sciences, 12 2006), 551--558.
[9]
Holmes, N. P., Spence, C., Giard, M.-H. and Wallace, M. The body schema and multisensory representation(s) of peripersonal space. Cognitive Processing, 5, 2 2004), 94--105.
[10]
Mohler, B. J. b. m. t. m. d., Creem-Regehr, S. H., Thompson, W. B. and Bülthoff, H. H. The Effect of Viewing a SelfAvatar on Distance Judgments in an HMD-Based Virtual Environment. Presence: Teleoperators & Virtual Environments, 19, 3 (06// 2010), 230--242.
[11]
Lee, K. M. Presence, Explicated. Communication Theory (10503293), 14, 1 2004), 27--50.
[12]
Kilteni, K., Bergstrom, I. and Slater, M. Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play. IEEE Transactions on Visualization & Computer Graphics, 19, 4 (04// 2013), 597.
[13]
Banakou, B. Groten, R, and Slater, M. Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. In The Proceedings of the National Academy of Sciences, 110, 31 (07/30/2013), 12846--51.
[14]
Kilteni, K.N., Sanchez-Vives J. M., Slater, M. V. Extending body space in immersive virtual reality: A very long arm illusion. PLoS ONE, 7, 7 (2012)
[15]
Lenggenhager, B.,Tadi, T., Metzinger, T., and Blanke, O. Video Ergo Sum: Manipulating Bodily Self-Consciousness. Science, 317, (24/07/2007) 1096--1099.
[16]
Iachini, T., Coello, Y., Frassinetti, F. and Ruggiero, G. Body Space in Social Interactions: A Comparison of Reaching and Comfort Distance in Immersive Virtual Reality. PLoS ONE, 9, 11 2014), 1--7.
Index Terms
- Duet: Improvising Spatial Dialogues with an Artificially Intelligent Agent
Recommendations
Bodylab: in virtuo sculpting, painting and performing of full-body avatars
Bodylab is a virtual reality system for creating full-body virtual reality avatars. It provides anatomically realistic mannequins as canvases, which can be painted and textured, sculpted and deformed, adorned with objects and animated with particle ...
Upwell: Performative Immersion Hybridizing Two Worlds
TEI '19: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied InteractionUpwell is a mixed reality performance that allows audience members to explore virtual and physical worlds with two dancers. The environment provokes the feeling of being underwater. A dancer with a conventional VR head-mounted display and wearable ...
Effects of Third-Person Locomotion Techniques on Sense of Embodiment in Virtual Reality
MUM '24: Proceedings of the International Conference on Mobile and Ubiquitous MultimediaVirtual Reality (VR) has enabled novel ways to study embodiment and understand how a virtual avatar may be treated as part of a person’s body. These studies mainly employ virtual bodies perceived from a first-person perspective, given that VR has a ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
August 2015
152 pages
ISBN:9781450337038
DOI:10.1145/2788940
- General Chair:
- Amy Banic,
- Program Chairs:
- Evan Suma,
- Frank Steinicke,
- Wolfgang Stuerzlinger
Copyright © 2015 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 August 2015
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
Acceptance Rates
SUI '15 Paper Acceptance Rate 17 of 48 submissions, 35%;
Overall Acceptance Rate 86 of 279 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 203Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)5
Reflects downloads up to 22 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in