More Web Proxy on the site http://driver.im/

research-article

Malleable Embodiment: Changing Sense of Embodiment by Spatial-Temporal Deformation of Virtual Human Body

Authors:

Shunichi Kasahara,

Akiko Takeshita,

Junichi UshibaAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 6438 - 6448

https://doi.org/10.1145/3025453.3025962

Published: 02 May 2017 Publication History

Abstract

We hypothesize that replacing the visual perception of one's body with a spatial-temporal deformed state would change sensations associated with the body. We developed a system that captures full-body movement and generates estimated past and future body movement by deformation. With a head mounted display, people could see their bodies as slightly deformed. We then investigated 1) how human movement is physically changed, and 2) how humans feel about the change in physical and emotional views of the body due to virtual body deformation. Our results show that spatial-temporal deformation of a virtual body actually changes the sense of body as well as physical movement. For instance, a body image generated at approximately 25-100 ms in the future induced a "lighter weight" sensation. On the basis of our findings, we discuss the design implication of computational control for the physical and emotional sense of body.

Supplementary Material

suppl.mov (pn4103.mp4)

Supplemental video

Download
16.20 MB

suppl.mov (pn4103p.mp4)

Supplemental video

Download
4.07 MB

References

[1]

K Carrie Armel and Vilayanur S Ramachandran. 2003. Projecting sensations to external objects: evidence from skin conductance response. Proceedings of the Royal Society of London B: Biological Sciences 270, 1523 (2003), 1499--1506.

[2]

Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1968--1979.

Digital Library

[3]

Domna Banakou, Raphaela Groten, and Mel Slater. 2013. Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proceedings of the National Academy of Sciences 110, 31 (2013), 12846--12851.

[4]

Ilias Bergstrom, Konstantina Kilteni, and Mel Slater. 2016. First-Person Perspective Virtual Body Posture Influences Stress: A Virtual Reality Body Ownership Study. PLoS ONE 11, 2 (02 2016), 1--21.

[5]

Marco Bertamini, Nausicaa Berselli, Carole Bode, Rebecca Lawson, and Li Ting Wong. 2011. The rubber hand illusion in a mirror. Consciousness and cognition 20, 4 (2011), 1108--1119.

[6]

Corey J Bohil, Bradly Alicea, and Frank A Biocca. 2011. Virtual reality in neuroscience research and therapy. Nature reviews neuroscience 12, 12 (2011), 752--762.

[7]

Matthew Botvinick, Jonathan Cohen, and others. 1998. Rubber hands' feel'touch that eyes see. Nature 391, 6669 (1998), 756--756.

[8]

Timothy Dummer, Alexandra Picot-Annand, Tristan Neal, and Chris Moore. 2009. Movement and the rubber hand illusion. Perception 38, 2 (2009), 271--280.

[9]

Michael SA Graziano. 1999. Where is my arm? The relative role of vision and proprioception in the neuronal representation of limb position. Proceedings of the National Academy of Sciences 96, 18 (1999), 10418--10421.

[10]

Denise YP Henriques and Erin K Cressman. 2012. Visuomotor adaptation and proprioceptive recalibration. Journal of motor behavior 44, 6 (2012), 435--444.

[11]

Ludovic Hoyet, Ferran Argelaguet, Corentin Nicole, and Anatole Lecuyer. 2016. "Wow! I Have Six Fingers!": Would You Accept Structural Changes of Your Hand in VR? Frontiers in Robotics and AI 3 (2016), 27.

[12]

D. A. G. Jauregui, F. Argelaguet, A. H. Olivier, M. Marchal, F. Multon, and A. Lecuyer. 2014. Toward "Pseudo-Haptic Avatars": Modifying the Visual Animation of Self-Avatar Can Simulate the Perception of Weight Lifting. IEEE Transactions on Visualization and Computer Graphics 20, 4 (April 2014), 654--661.

Digital Library

[13]

K. Kilteni, I. Bergstrom, and M. Slater. 2013. Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play. IEEE Transactions on Visualization and Computer Graphics 19, 4 (April 2013), 597--605.

Digital Library

[14]

Konstantina Kilteni, Antonella Maselli, Konrad P. Kording, and Mel Slater. 2015. Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience 9 (2015), 141.

[15]

Konstantina Kilteni, Jean-Marie Normand, Maria V. Sanchez-Vives, and Mel Slater. 2012. Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion. PLoS ONE 7, 7 (07 2012), 1--15.

[16]

Elena Kokkinara, Mel Slater, and Joan López-Moliner. 2015. The Effects of Visuomotor Calibration to the Perceived Space and Body, Through Embodiment in Immersive Virtual Reality. ACM Trans. Appl. Percept. 13, 1, Article 3 (Oct. 2015), 22 pages.

Digital Library

[17]

John W Krakauer, Zachary M Pine, Maria-Felice Ghilardi, and Claude Ghez. 2000. Learning of visuomotor transformations for vectorial planning of reaching trajectories. The Journal of neuroscience 20, 23 (2000), 8916--8924.

[18]

Matteo Martini, D Perez-Marcos, and MV Sanchez-Vives. 2014. Modulation of pain threshold by virtual body ownership. European Journal of Pain 18, 7 (2014), 1040--1048.

[19]

Antonella Maselli and Mel Slater. 2013. The building blocks of the full body ownership illusion. Frontiers in human neuroscience 7 (2013), 83.

[20]

Antonella Maselli and Mel Slater. 2014. Sliding perspectives: dissociating ownership from self-location during full body illusions in virtual reality. Frontiers in Human Neuroscience 8 (2014), 693.

[21]

Pietro Mazzoni and John W Krakauer. 2006. An implicit plan overrides an explicit strategy during visuomotor adaptation. The Journal of neuroscience 26, 14 (2006), 3642--3645.

[22]

W. A. McNeely. 1993. Robotic graphics: a new approach to force feedback for virtual reality. In Virtual Reality Annual International Symposium, 1993., 1993 IEEE. 336--341.

Digital Library

[23]

Jean-Marie Normand, Elias Giannopoulos, Bernhard Spanlang, and Mel Slater. 2011. Multisensory stimulation can induce an illusion of larger belly size in immersive virtual reality. PloS one 6, 1 (2011), e16128.

[24]

Tabitha C. Peck, Sofia Seinfeld, Salvatore M. Aglioti, and Mel Slater. 2013. Putting yourself in the skin of a black avatar reduces implicit racial bias. Consciousness and Cognition 22, 3 (2013), 779 -- 787.

[25]

Daniel Perez-Marcos, Massimiliano Solazzi, Will Steptoe, Oyewole Oyekoya, Antonio Frisoli, Tim Weyrich, Anthony Steed, Franco Tecchia, Mel Slater, and Maria V. Sanchez-Vives. 2012a. A Fully Immersive Set-up for Remote Interaction and Neurorehabilitation based on Virtual Body Ownership. Frontiers in Neurology 3, 110 (2012), 1--9.

[26]

Daniel Perez-Marcos, Massimiliano Solazzi, Will Steptoe, Wole Oyekoya, Antonio Frisoli, Tim Weyrich, Anthony Steed, Franco Tecchia, Mel Slater, and Maria V Sanchez-Vives. 2012b. A fully immersive set-up for remote interaction and neurorehabilitation based on virtual body ownership. Frontiers in neurology 3 (2012), 110.

[27]

Valeria I. Petkova and H. Henrik Ehrsson. 2008. If I Were You: Perceptual Illusion of Body Swapping. PLoS ONE 3, 12 (12 2008), 1--9.

[28]

Sharif Razzaque, Zachariah Kohn, and Mary C Whitton. 2001. Redirected walking. In Proceedings of EUROGRAPHICS. Citeseer.

[29]

Reza Shadmehr, Maurice A Smith, and John W Krakauer. 2010. Error correction, sensory prediction, and adaptation in motor control. Annual review of neuroscience 33 (2010), 89--108.

[30]

Sotaro Shimada, Yuan Qi, and Kazuo Hiraki. 2010. Detection of visual feedback delay in active and passive self-body movements. Experimental brain research 201, 2 (2010), 359--364.

[31]

Mel Slater, Daniel Perez Marcos, Henrik Ehrsson, and Maria Sanchez-Vives. 2008. Towards a digital body: the virtual arm illusion. Frontiers in Human Neuroscience 2 (2008), 6.

[32]

Mel Slater, Daniel Perez Marcos, Henrik Ehrsson, and Maria Sanchez-Vives. 2009. Inducing illusory ownership of a virtual body. Frontiers in Neuroscience 3 (2009), 29.

[33]

Anthony Steed, Sebastian Frlston, Maria Murcia Lopez, Jason Drummond, Ye Pan, and David Swapp. 2016a. An 'In the Wild'; Experiment on Presence and Embodiment Using Consumer Virtual Reality Equipment. IEEE Transactions on Visualization and Computer Graphics 22, 4 (April 2016), 1406--1414.

Digital Library

[34]

A. Steed, Y. Pan, F. Zisch, and W. Steptoe. 2016b. The impact of a self-avatar on cognitive load in immersive virtual reality. In 2016 IEEE Virtual Reality (VR). 67--76.

[35]

Manos Tsakiris. 2010. My body in the brain: A neurocognitive model of body-ownership. Neuropsychologia 48, 3 (2010), 703 -- 712. The Sense of Body.

[36]

Hermann von Helmholtz and James Powell Cocke Southall. 2005. Treatise on physiological optics. Vol. 3. Courier Corporation.

[37]

Y. Yuan and A. Steed. 2010. Is the rubber hand illusion induced by immersive virtual reality?. In 2010 IEEE Virtual Reality Conference (VR). 95--102.

Digital Library

Cited By

Yu HDu SKurien Avan Wyk BLiu Q(2024)The Sense of Agency in Human–Machine Interaction SystemsApplied Sciences10.3390/app1416732714:16(7327)Online publication date: 20-Aug-2024
https://doi.org/10.3390/app14167327
Lebrun FHaliyo SAuvray MGueorguiev DBailly G(2024)Study of the Impact of Visual and Haptic Sensory Sensitivities on the Detection of Visuo-Haptic Illusions in Virtual RealityProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649803(1-15)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649803
Person THanamitsu NHynds DWakisaka SIsobe KMochizuki LMizuguchi TMinamizawa K(2024)The Malleable-Self Experience: Transforming Body Image by Integrating Visual and Whole-Body Haptic StimuliACM SIGGRAPH 2024 Emerging Technologies10.1145/3641517.3664385(1-2)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641517.3664385
Show More Cited By

Index Terms

Malleable Embodiment: Changing Sense of Embodiment by Spatial-Temporal Deformation of Virtual Human Body
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Are Embodied Avatars Harmful to our Self-Experience? The Impact of Virtual Embodiment on Body Awareness
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Virtual Reality (VR) allows us to replace our visible body with a virtual self-representation (avatar) and to explore its effects on our body perception. While the feeling of owning and controlling a virtual body is widely researched, how VR affects the ...
Effects of Third-Person Locomotion Techniques on Sense of Embodiment in Virtual Reality
MUM '24: Proceedings of the International Conference on Mobile and Ubiquitous Multimedia
Virtual Reality (VR) has enabled novel ways to study embodiment and understand how a virtual avatar may be treated as part of a person’s body. These studies mainly employ virtual bodies perceived from a first-person perspective, given that VR has a ...
Evaluating the Sense of Embodiment through Out-of-Body Experience and Tactile Feedback
VRCAI '22: Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Out-of-body experience (OBE) is generated by sensory disintegration. In virtual reality (VR), we can provide OBE to people by switching the first-person perspective (1PP) to the third-person perspective (3PP). Generally, 1PP is the choice for high body ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
1,292
Total Downloads

Downloads (Last 12 months)103
Downloads (Last 6 weeks)15

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu HDu SKurien Avan Wyk BLiu Q(2024)The Sense of Agency in Human–Machine Interaction SystemsApplied Sciences10.3390/app1416732714:16(7327)Online publication date: 20-Aug-2024
https://doi.org/10.3390/app14167327
Lebrun FHaliyo SAuvray MGueorguiev DBailly G(2024)Study of the Impact of Visual and Haptic Sensory Sensitivities on the Detection of Visuo-Haptic Illusions in Virtual RealityProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649803(1-15)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649803
Person THanamitsu NHynds DWakisaka SIsobe KMochizuki LMizuguchi TMinamizawa K(2024)The Malleable-Self Experience: Transforming Body Image by Integrating Visual and Whole-Body Haptic StimuliACM SIGGRAPH 2024 Emerging Technologies10.1145/3641517.3664385(1-2)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641517.3664385
Boban LBoulic RHerbelin B(2024)In Case of Doubt, One Follows One's Self: The Implicit Guidance of the Embodied Self-AvatarIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337204230:5(2109-2118)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372042
Qiu YHe XLi ZPeng ZHuang YYu X(2024)Wearable Sensors for Motion and Electrophysiological Signal Tracking in XRKorean Journal of Chemical Engineering10.1007/s11814-024-00227-wOnline publication date: 20-Jul-2024
https://doi.org/10.1007/s11814-024-00227-w
Boban LStrauss LDecroix HHerbelin BBoulic R(2023)Unintentional synchronization with self-avatar for upper- and lower-body movementsFrontiers in Virtual Reality10.3389/frvir.2023.10735494Online publication date: 23-Feb-2023
https://doi.org/10.3389/frvir.2023.1073549
Halbhuber DKocur MKalus AAngermeyer KSchwind VHenze N(2023)Understanding the Effects of Perceived Avatar Appearance on Latency Sensitivity in Full-Body Motion-Tracked Virtual RealityProceedings of Mensch und Computer 202310.1145/3603555.3603580(1-15)Online publication date: 3-Sep-2023
https://dl.acm.org/doi/10.1145/3603555.3603580
Kodama DMizuho THatada YNarumi THirose MWard JMcGill MMarky K(2023)Effect of Weight Adjustment in Virtual Co-embodiment During Collaborative TrainingProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582703(86-97)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582703
Döllinger NWolf EBotsch MLatoschik MWienrich C(2023)Are Embodied Avatars Harmful to our Self-Experience? The Impact of Virtual Embodiment on Body AwarenessProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580918(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580918
Döllinger NBeck MWolf EMal DBotsch MLatoschik MWienrich C(2023)“If It’s Not Me It Doesn’t Make a Difference” - The Impact of Avatar Personalization on user Experience and Body Awareness in Virtual Reality2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00063(483-492)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00063
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents