More Web Proxy on the site http://driver.im/

research-article

Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences

Authors:

Adalberto L. Simeone,

Eduardo Velloso,

Hans GellersenAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 3307 - 3316

https://doi.org/10.1145/2702123.2702389

Published: 18 April 2015 Publication History

Abstract

Experiencing Virtual Reality in domestic and other uncontrolled settings is challenging due to the presence of physical objects and furniture that are not usually defined in the Virtual Environment. To address this challenge, we explore the concept of Substitutional Reality in the context of Virtual Reality: a class of Virtual Environments where every physical object surrounding a user is paired, with some degree of discrepancy, to a virtual counterpart. We present a model of potential substitutions and validate it in two user studies. In the first study we investigated factors that affect participants' suspension of disbelief and ease of use. We systematically altered the virtual representation of a physical object and recorded responses from 20 participants. The second study investigated users' levels of engagement as the physical proxy for a virtual object varied. From the results, we derive a set of guidelines for the design of future Substitutional Reality experiences.

Supplementary Material

suppl.mov (pn1357-file3.mp4)

Supplemental video

Download
80.93 MB

MP4 File (p3307-simeone.mp4)

Download
188.29 MB

References

[1]

Barbagli, F., Salisbury, K., Ho, C., Spence, C., and Tan, H. Z. Haptic discrimination of force direction and the influence of visual information. ACM TAP 3, 2 (Apr. 2006), 125--135.

Digital Library

[2]

Carlin, A. S., Hoffman, H. G., and Weghorst, S. Virtual reality and tactile augmentation in the treatment of spider phobia: a case report. Behav. Res. Ther. 35, 2 (1997), 153--158.

[3]

Cosco, F., Garre, C., Bruno, F., Muzzupappa, M., and Otaduy, M. A. Visuo-haptic mixed reality with unobstructed tool-hand integration. IEEE TVCG 19, 1 (2013), 159--172.

Digital Library

[4]

e Silva, A. d. S., and Delacruz, G. C. Hybrid reality games reframed potential uses in educational contexts. SAGE GAC 1, 3 (2006), 231--251.

[5]

Gibson, J. J. The theory of affordances. Perceiving, Acting and Knowing (1977).

[6]

Hinckley, K., Pausch, R., Goble, J. C., and Kassell, N. F. Passive real-world interface props for neurosurgical visualization. In Proc. CHI '94, 452--458.

Digital Library

[7]

Hoffmann, H. Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In Proc. VR '98, 59--63.

Digital Library

[8]

Insko, B. E. Passive haptics significantly enhances virtual environments. PhD thesis, UNC, 2001.

Digital Library

[9]

Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., et al. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proc. UIST '11, 559--568.

Digital Library

[10]

Kanade, T., Rander, P., and Narayanan, P. Virtualized reality: Constructing virtual worlds from real scenes. IEEE Multimedia 4, 1 (1997), 34--47.

Digital Library

[11]

Knoerlein, B., Székely, G., and Harders, M. Visuo-haptic collaborative augmented reality ping-pong. In Proc. ACE '07, 91--94.

Digital Library

[12]

Kohli, L., Whitton, M. C., and Brooks, F. Redirected touching: The effect of warping space on task performance. In Proc. 3DUI '12, 105--112.

[13]

Kotranza, A., and Lok, B. Virtual human+ tangible interface= mixed reality human an initial exploration with a virtual breast exam patient. In Proc. VR '08, 99--106.

[14]

Kushner, D. Virtual reality's moment. IEEE Spectrum 51, 1 (Jan. 2014), 34--37.

[15]

Kwon, E., Kim, G. J., and Lee, S. Effects of sizes and shapes of props in tangible augmented reality. In Proc. ISMAR '09, 201--202.

Digital Library

[16]

Matsuoka, Y., Allin, S. J., and Klatzky, R. L. The tolerance for visual feedback distortions in a virtual environment. Physiol. Behav. 77, 4 (2002), 651--655.

[17]

McNeely, W. A. Robotic graphics: a new approach to force feedback for virtual reality. In Proc. VR '93, 336--341.

Digital Library

[18]

Milgram, P., and Kishino, F. A taxonomy of mixed reality visual displays. IEICE Trans. Inf.& Syst. 77, 12 (1994), 1321--1329.

[19]

Milgram, P., Takemura, H., Utsumi, A., and Kishino, F. Augmented reality: A class of displays on the reality-virtuality continuum. In Proc. SPIE 2351 (1995), 282--292.

[20]

Reda, K., Febretti, A., Knoll, A., Aurisano, J., Leigh, J., Johnson, A. E., Papka, M. E., and Hereld, M. Visualizing large, heterogeneous data in hybrid-reality environments. IEEE CGA 33, 4 (2013), 38--48.

Digital Library

[21]

Robertson, G., Czerwinski, M., and Van Dantzich, M. Immersion in desktop virtual reality. In Proc. UIST '97, 11--19.

Digital Library

[22]

Slater, M., Usoh, M., and Steed, A. Taking steps: The influence of a walking technique on presence in virtual reality. ACM TOCHI 2, 3 (Sept. 1995), 201--219.

Digital Library

[23]

Steinicke, F., Bruder, G., Kohli, L., Jerald, J., and Hinrichs, K. Taxonomy and implementation of redirection techniques for ubiquitous passive haptic feedback. In Cyberworlds '08, 217--223.

Digital Library

[24]

Suzuki, K., Wakisaka, S., and Fujii, N. Substitutional reality system: a novel experimental platform for experiencing alternative reality. Sci. Rep. 2 (2012).

[25]

Tachi, S., Maeda, T., Hirata, R., and Hoshino, H. A construction method of virtual haptic space. In Proc. ICAT '94, 131--138.

[26]

Usoh, M., Arthur, K., Whitton, M. C., Bastos, R., Steed, A., Slater, M., and Brooks Jr, F. P. Walking > walking-in-place > flying, in virtual environments. In Proc. SIGGRAPH '99, 359--364.

Digital Library

[27]

Williams, B., Narasimham, G., Rump, B., McNamara, T. P., Carr, T. H., Rieser, J., and Bodenheimer, B. Exploring large virtual environments with an hmd when physical space is limited. In Proc. APGV '07, 41--48.

Digital Library

Cited By

Mora PGarcia CIvorra EOrtega MAlcañiz M(2024)Virtual Experience Toolkit: An End-to-End Automated 3D Scene Virtualization Framework Implementing Computer Vision TechniquesSensors10.3390/s2412383724:12(3837)Online publication date: 13-Jun-2024
https://doi.org/10.3390/s24123837
Seo SJung WKim Y(2024)3D Hand Motion Generation for VR Interactions Using a Haptic Data GloveMultimodal Technologies and Interaction10.3390/mti80700628:7(62)Online publication date: 15-Jul-2024
https://doi.org/10.3390/mti8070062
Liang JLi X(2024)Construction of Emergency Rescue Virtual Exercise Platform Based on AIGC PerspectiveProceedings of the 2024 Guangdong-Hong Kong-Macao Greater Bay Area International Conference on Education Digitalization and Computer Science10.1145/3686424.3686477(312-316)Online publication date: 26-Jul-2024
https://dl.acm.org/doi/10.1145/3686424.3686477
Show More Cited By

Index Terms

Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Haptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...
Reality jockey: lifting the barrier between alternate realities through audio and haptic feedback
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present Reality Jockey, a system that confuses the participant's perception of the reality by mixing in a recorded past-reality. The participant will be immersed in a spatialized 3D sound environment that is a mix of sounds from the reality and from ...
Physical hand interaction for controlling multiple virtual objects in virtual reality
IWISC '18: Proceedings of the 3rd International Workshop on Interactive and Spatial Computing

Immersive virtual reality systems often strive to support realistic physical interaction through direct hand control, but it is not often possible to configure the physical environment to exactly match the virtual environment. We study methods that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Commission

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

269
Total Citations
View Citations
3,751
Total Downloads

Downloads (Last 12 months)470
Downloads (Last 6 weeks)29

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mora PGarcia CIvorra EOrtega MAlcañiz M(2024)Virtual Experience Toolkit: An End-to-End Automated 3D Scene Virtualization Framework Implementing Computer Vision TechniquesSensors10.3390/s2412383724:12(3837)Online publication date: 13-Jun-2024
https://doi.org/10.3390/s24123837
Seo SJung WKim Y(2024)3D Hand Motion Generation for VR Interactions Using a Haptic Data GloveMultimodal Technologies and Interaction10.3390/mti80700628:7(62)Online publication date: 15-Jul-2024
https://doi.org/10.3390/mti8070062
Liang JLi X(2024)Construction of Emergency Rescue Virtual Exercise Platform Based on AIGC PerspectiveProceedings of the 2024 Guangdong-Hong Kong-Macao Greater Bay Area International Conference on Education Digitalization and Computer Science10.1145/3686424.3686477(312-316)Online publication date: 26-Jul-2024
https://dl.acm.org/doi/10.1145/3686424.3686477
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Jiang HSong LWeng DSun ZLi HDongye XZhang ZCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)In Situ 3D Scene Synthesis for Ubiquitous Embodied InterfacesProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681616(3666-3675)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681616
Yokoyama TIzumi KFushimi TOchiai Y(2024)Floating on the Boundary: Perceptions of Reality in a Half-Digital Half-Physical BunnyProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36642177:4(1-10)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3664217
Adiwangsa MSweetser P(2024)Investigating Potential Augmentation of Home Objects to Facilitate ExercisingCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663728(195-198)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3663728
Seo HYi JBalan RLee Y(2024)GradualReality: Enhancing Physical Object Interaction in Virtual Reality via Interaction State-Aware BlendingProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676463(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676463
Streli PRichardson MBotros FMa SWang RHolz C(2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676330
Cannavò APacchiotti SRetta NTerzoli MSpallone RLamberti F(2024)Passive Haptics and Conversational Avatars for Interacting with Ancient Egypt Remains in High-Fidelity Virtual Reality ExperiencesJournal on Computing and Cultural Heritage 10.1145/364800317:2(1-28)Online publication date: 17-Apr-2024
https://dl.acm.org/doi/10.1145/3648003
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents