More Web Proxy on the site http://driver.im/

research-article

Public Access

Towards virtual reality infinite walking: dynamic saccadic redirection

Authors:

Morgan Mcguire,

Arie KaufmanAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 37, Issue 4

Article No.: 67, Pages 1 - 13

https://doi.org/10.1145/3197517.3201294

Published: 30 July 2018 Publication History

Abstract

Redirected walking techniques can enhance the immersion and visual-vestibular comfort of virtual reality (VR) navigation, but are often limited by the size, shape, and content of the physical environments.

We propose a redirected walking technique that can apply to small physical environments with static or dynamic obstacles. Via a head- and eye-tracking VR headset, our method detects saccadic suppression and redirects the users during the resulting temporary blindness. Our dynamic path planning runs in real-time on a GPU, and thus can avoid static and dynamic obstacles, including walls, furniture, and other VR users sharing the same physical space. To further enhance saccadic redirection, we propose subtle gaze direction methods tailored for VR perception.

We demonstrate that saccades can significantly increase the rotation gains during redirection without introducing visual distortions or simulator sickness. This allows our method to apply to large open virtual spaces and small physical environments for room-scale VR. We evaluate our system via numerical simulations and real user studies.

Supplementary Material

MP4 File (067-183.mp4)

Download
243.72 MB

MP4 File (a67-sun.mp4)

Download
302.43 MB

References

[1]

Rachel Albert, Anjul Patney, David Luebke, and Joohwan Kim. 2017. Latency Requirements for Foveated Rendering in Virtual Reality. ACM Trans. Appl. Percept. 14, 4. Article 25 (2017), 13 pages.

Digital Library

[2]

Richard Andersson, Linnea Larsson, Kenneth Holmqvist, Martin Stridh, and Marcus Nyström. 2017. One algorithm to rule them all? An evaluation and discussion of ten eye movement event-detection algorithms. Behavior Research Methods 49, 2 (2017), 616--637.

[3]

Elena Arabadzhiyska, Okan Tarhan Tursun, Karol Myszkowski, Hans-Peter Seidel, and Piotr Didyk. 2017. Saccade Landing Position Prediction for Gaze-contingent Rendering. ACM Trans. Graph. 36, 4, Article 50 (2017), 12 pages.

Digital Library

[4]

Mahdi Azmandian, Timofey Grechkin, Mark Bolas, and Evan Suma. 2015. Physical Space Requirements for Redirected Walking: How Size and Shape Affect Performance. In Eurographics Symposium on Virtual Environments (2015). The Eurographics Association, Kyoto, Japan, 93--100.

Digital Library

[5]

Mahdi Azmandian, Timofey Grechkin, Mark Bolas, and Evan Suma. 2016a. Automated Path Prediction for Redirected Walking Using Navigation Meshes. In IEEE Symposium on 3D User Interfaces. 63--66.

[6]

Mahdi Azmandian, Timofey Grechkin, Mark Bolas, and Evan Suma. 2016b. The redirected walking toolkit: a unified development platform for exploring large virtual environments. In 2016 IEEE 2nd Workshop on Everyday Virtual Reality (WEVR). 9--14.

[7]

Mahdi Azmandian, Timofey Grechkin, and Evan Suma Rosenberg. 2017. An evaluation of strategies for two-user redirected walking in shared physical spaces. In 2017 IEEE Virtual Reality (VR). 91--98.

[8]

Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016c. A Demonstration of Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS '16). ACM, New York, NY, USA, 501--504.

Digital Library

[9]

A. Terry Bahill, Michael R. Clark, and Lawrence Stark. 1975. The main sequence, a tool for studying human eye movements. Mathematical Biosciences 24, 3-4 (1975). 191--204.

[10]

Reynold Bailey, Ann McNamara, Nisha Sudarsanam, and Cindy Grimm. 2009. Subtle Gaze Direction. ACM Trans. Graph. 28, 4, Article 100 (2009), 14 pages.

Digital Library

[11]

Benjamin Bolte and Markus Lappe. 2015. Subliminal Reorientation and Repositioning in Immersive Virtual Environments using Saccadic Suppression. IEEE TVCG 21, 4 (2015), 545--552.

[12]

Thomas Booth, Srinivas Sridharan, Ann McNamara, Cindy Grimm, and Reynold Bailey. 2013. Guiding Attention in Controlled Real-world Environments. In SAP '13. 75--82.

Digital Library

[13]

Bruce Bridgeman, Derek Hendry, and Lawrence Stark. 1975. Failure to detect displacement of the visual world during saccadic eye movements. Vision Research 15, 6 (1975), 719 -- 722.

[14]

David C. Burr, M. Concetta Morrone, John Ross, and others. 1994. Selective suppression of the magnocellular visual pathway during saccadic eye movements. Nature 371, 6497 (1994), 511--513.

[15]

Haiwei Chen and Henry Fuchs. 2017. Supporting Free Walking in a Large Virtual Environment: Imperceptible Redirected Walking with an Immersive Distractor. In Proceedings of the Computer Graphics International Conference (CGI '17). ACM, New York, NY, USA, Article 22, 6 pages.

Digital Library

[16]

Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3718--3728.

Digital Library

[17]

Mark R. Diamond, John Ross, and Maria C. Morrone. 2000. Extraretinal control of saccadic suppression. The Journal of Neuroscience 20, 9 (2000), 3449--3455.

[18]

Zhi-Chao Dong, Xiao-Ming Fu, Chi Zhang, Kang Wu, and Ligang Liu. 2017. Smooth Assembled Mappings for Large-scale Real Walking. ACM Trans. Graph. 36, 6, Article 211 (2017), 13 pages.

Digital Library

[19]

Andrew T Duchowski and Arzu Çöltekin. 2007. Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 3, 4 (2007), 6.

Digital Library

[20]

Andrew T. Duchowski, Nathan Cournia, and Hunter Murphy. 2004. Gaze-contingent displays: A review. CyberPsychology & Behavior 7, 6 (2004), 621--634.

[21]

Andrew T. Duchowski, Donald H. House, Jordan Gestring, Rui I. Wang, Krzysztof Krejtz, Izabela Krejtz, Radosław Mantiuk, and Bartosz Bazyluk. 2014. Reducing Visual Discomfort of 3D Stereoscopic Displays with Gaze-contingent Depth-of-field. In Proceedings of the ACM Symposium on Applied Perception (SAP '14). ACM, New York, NY, USA, 39--46.

Digital Library

[22]

Leon A. Gatys, Matthias Kümmerer, Thomas Wallis, and Matthias Bethge. 2017. Guiding human gaze with convolutional neural networks. ArXiv e-prints (2017). arXiv:cs.CV/1712.06492

[23]

Timofey Grechkin, Jerald Thomas, Mahdi Azmandian, Mark Bolas, and Evan Suma. 2016. Revisiting Detection Thresholds for Redirected Walking: Combining Translation and Curvature Gains. In Proceedings of the ACM Symposium on Applied Perception (SAP '16). ACM, New York, NY, USA, 113--120.

Digital Library

[24]

Steve Grogorick, Michael Stengel, Elmar Eisemann, and Marcus Magnor. 2017. Subtle Gaze Guidance for Immersive Environments. In SAP '17. Article 4, 7 pages.

Digital Library

[25]

Brian Guenter, Mark Finch, Steven Drucker, Desney Tan, and John Snyder. 2012. Foveated 3D Graphics. ACM Trans. Graph. 31, 6 (2012), 164:1--164:10.

Digital Library

[26]

Peng Han, Daniel R Saunders, Russell L Woods, and Gang Luo. 2013. Trajectory prediction of saccadic eye movements using a compressed exponential model. Journal of vision 13, 8 (2013), 27--27.

[27]

Eric Hodgson and Eric Bachmann. 2013. Comparing Four Approaches to Generalized Redirected Walking: Simulation and Live User Data. TVCG 19, 4 (2013), 634--643.

Digital Library

[28]

J. Johanna Hopp and Albert F Fuchs. 2004. The characteristics and neuronal substrate of saccadic eye movement plasticity. Progress in Neurobiology 72, 1 (2004), 27 -- 53.

[29]

Michael R. Ibbotson and Shaun L. Cloherty. 2009. Visual Perception: Saccadic Omission - Suppression or Temporal Masking? Current Biology 19, 12 (2009), R493--R496.

[30]

David E. Jacobs, Orazio Gallo, Emily A. Cooper, Kari Pulli, and Marc Levoy. 2015. Simulating the Visual Experience of Very Bright and Very Dark Scenes. ACM Trans. Graph. 34, 3, Article 25 (2015), 15 pages.

Digital Library

[31]

Robert S Kennedy, Norman E Lane, Kevin S Berbaum, and Michael G Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology 3, 3 (1993), 203--220.

[32]

Eike Langbehn, Gerd Bruder, and Frank Steinicke. 2016. Subliminal Reorientation and Repositioning in Virtual Reality During Eye Blinks. In Proc. of Spatial User Interaction. 213--213.

Digital Library

[33]

Eike Langbehn, Frank Steinicke, Markus Lappe, Gregory F. Welch, and Gerd Bruder. 2018. In the Blink of an Eye: Leveraging Blink-Induced Suppression for Imperceptible Position and Orientation Redirection in Virtual Reality. ACM Trans. Graph. 37, 4, Article 66 (2018).

Digital Library

[34]

Marc Levoy and Ross Whitaker. 1990. Gaze-directed volume rendering. ACM SIGGRAPH Computer Graphics 24, 2 (1990), 217--223.

Digital Library

[35]

Wenxun Li and Leonard Matin. 1990. The influence of saccade length on the saccadic suppression of displacement detection. Perception & Psychophysics 48, 5 (1990), 453--458.

[36]

David Luebke and Benjamin Hallen. 2001. Perceptually driven simplification for inter-active rendering. In Rendering Techniques 2001. Springer, 223--234.

Digital Library

[37]

Ethel Matin. 1974. Saccadic suppression: a review and an analysis. Psychological bulletin 81, 12 (1974), 899.

[38]

George W. McConkie and Lester C. Loschky. 2002. Perception onset time during fixations in free viewing. Behavior Research Methods, Instruments, & Computers 34, 4 (2002), 481--490.

[39]

Ann McNamara, Reynold Bailey, and Cindy Grimm. 2008. Improving Search Task Performance Using Subtle Gaze Direction. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (APGV '08). ACM, New York, NY, USA, 51--56.

Digital Library

[40]

Ann McNamara, Reynold Bailey, and Cindy Grimm. 2009. Search Task Performance Using Subtle Gaze Direction with the Presence of Distractions. ACM Trans. Appl. Percept. 6, 3 (2009), 17:1--17:19.

Digital Library

[41]

Ann McNamara, Thomas Booth, Srinivas Sridharan, Stephen Caffey, Cindy Grimm, and Reynold Bailey. 2012. Directing Gaze in Narrative Art. In Proceedings of the ACM Symposium on Applied Perception (SAP '12). ACM, New York, NY, USA, 63--70.

Digital Library

[42]

J. Nocedal and S. Wright. 2006. Numerical Optimization. Springer New York.

[43]

Anjul Patney. 2017. Perceptual Insights into Foveated Virtual Reality. In NVIDIA GPU Technology Conference 2017 Talks. San Jose, California.

[44]

Anjul Patney, Marco Salvi, Joohwan Kim, Anton Kaplanyan, Chris Wyman, Nir Benty, David Luebke, and Aaron Lefohn. 2016. Towards Foveated Rendering for Gaze-tracked Virtual Reality. ACM Trans. Graph. 35, 6 (2016), 179:1--179:12.

Digital Library

[45]

Tabitha C Peck, Henry Fuchs, and Mary C Whitton. 2010. Improved redirection with distractors: A large-scale-real-walking locomotion interface and its effect on navigation in virtual environments. In Virtual Reality Conference. IEEE, 35--38.

Digital Library

[46]

Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze + Pinch Interaction in Virtual Reality. In Proc. of Spatial User Interaction (SUI '17). 99--108.

Digital Library

[47]

Sharif Razzaque. 2005. Redirected Walking. Ph.D. Dissertation. Chapel Hill, NC, USA. Advisor(s) Brooks, Jr., Fredrick P. AAI3190299.

Digital Library

[48]

Sharif Razzaque, Zachariah Kohn, and Mary C. Whitton. 2001. Redirected walking. In Proc. of Eurographics, Vol. 9. Manchester, UK, 105--106.

[49]

Sharif Razzaque, David Swapp, Mel Slater, Mary C. Whitton, and Anthony Steed. 2002. Redirected Walking in Place. In EGVE '02. 123--130.

Digital Library

[50]

Stephen M. Reder. 1973. On-line monitoring of eye-position signals in contingent and noncontingent paradigms. Behavior Research Methods 5, 2 (1973), 218--228.

[51]

William H. Ridder III and Alan Tomlinson. 1997. A comparison of saccadic and blink suppression in normal observers. Vision Research 37, 22 (1997), 3171--3179.

[52]

John Ross, M. Concetta Morrone, Michael E. Goldberg, and David C. Burr. 2001. Changes in visual perception at the time of saccades. Trends in Neurosciences 24, 2 (2001), 113--121.

[53]

Srinivas Sridharan and Reynold Bailey. 2015. Automatic Target Prediction and Subtle Gaze Guidance for Improved Spatial Information Recall. In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception (SAP '15). 99--106.

Digital Library

[54]

Srinivas Sridharan, James Pieszala, and Reynold Bailey. 2015. Depth-based Subtle Gaze Guidance in Virtual Reality Environments. In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception (SAP '15). ACM, New York, NY, USA, 132--132.

Digital Library

[55]

Frank Steinicke, Gerd Bruder, Jason Jerald, Harald Frenz, and Markus Lappe. 2008. Analyses of Human Sensitivity to Redirected Walking. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (VRST '08). ACM, New York, NY, USA, 149--156.

Digital Library

[56]

Frank Steinicke, Gerd Bruder, Jason Jerald, Harald Frenz, and Markus Lappe. 2010. Estimation of Detection Thresholds for Redirected Walking Techniques. IEEE TVCG 16, 1 (2010), 17--27.

Digital Library

[57]

Evan A. Suma, D. Krum, and Mark Bolas. 2013. Redirected Walking in Mixed Reality Training Applications. In Human Walking in Virtual Environments: Perception, Technology, and Applications. Springer, 319--331.

[58]

Qi Sun, Li-Yi Wei, and Arie Kaufman. 2016. Mapping Virtual and Physical Reality. ACM Trans. Graph. 35, 4, Article 64 (2016), 12 pages.

Digital Library

[59]

Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks, Jr. 1999. Walking > Walking-in-place > Flying, in Virtual Environments. In SIGGRAPH '99. 359--364.

Digital Library

[60]

Peter Vincent and Ritchie Brannan. 2017. S7797 Tobii Eye Tracked Foveated Rendering for VR and Desktop. (2017).

[61]

Mounia Ziat, Vincent Hayward, C. Elaine Chapman, Marc O. Ernst, and Charles Lenay. 2010. Tactile suppression of displacement. Experimental Brain Research 206, 3 (2010), 299--310.

Cited By

Jeon SJung JPark JLee I(2025)F-RDW: Redirected Walking With Forecasting Future PositionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337608031:4(1970-1984)Online publication date: Apr-2025
https://doi.org/10.1109/TVCG.2024.3376080
Lee C(2025)Identification of the difference threshold for sequential curvature gain variations of redirected walkingVirtual Reality10.1007/s10055-025-01099-z29:1Online publication date: 31-Jan-2025
https://dl.acm.org/doi/10.1007/s10055-025-01099-z
Lu YHu YFeng HDuan PShen X(2025)Generating reconstructable collaborative virtual environments via graph matching for mixed reality remote collaborationThe Visual Computer10.1007/s00371-024-03761-0Online publication date: 15-Feb-2025
https://doi.org/10.1007/s00371-024-03761-0
Show More Cited By

Index Terms

Towards virtual reality infinite walking: dynamic saccadic redirection
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Mapping virtual and physical reality

Real walking offers higher immersive presence for virtual reality (VR) applications than alternative locomotive means such as walking-in-place and external control gadgets, but needs to take into consideration different room sizes, wall shapes, and ...
A Quantitative Analysis of Redirected Walking in Virtual Reality Using Saccadic Eye Movements
Advances in Visual Computing
Abstract
In this work we investigated redirected walking in virtual reality using saccadic eye movements to determine when to rotate the participant in their virtual environment. We tested participants by placing them into a virtual environment where they ...
Real walking on a virtual campus: a VR-based multimedia visualization and interaction system
ICCSP '19: Proceedings of the 3rd International Conference on Cryptography, Security and Privacy

The rapid development of virtual reality (VR) provides a revolutionary way for multimedia data visualization and interaction. Instead of sitting on a chair and playing with a controller, real walking gives the most natural experience when exploring the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 37, Issue 4

August 2018

1670 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3197517

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 July 2018

Published in TOG Volume 37, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

170
Total Citations
View Citations
5,040
Total Downloads

Downloads (Last 12 months)757
Downloads (Last 6 weeks)114

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jeon SJung JPark JLee I(2025)F-RDW: Redirected Walking With Forecasting Future PositionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337608031:4(1970-1984)Online publication date: Apr-2025
https://doi.org/10.1109/TVCG.2024.3376080
Lee C(2025)Identification of the difference threshold for sequential curvature gain variations of redirected walkingVirtual Reality10.1007/s10055-025-01099-z29:1Online publication date: 31-Jan-2025
https://dl.acm.org/doi/10.1007/s10055-025-01099-z
Lu YHu YFeng HDuan PShen X(2025)Generating reconstructable collaborative virtual environments via graph matching for mixed reality remote collaborationThe Visual Computer10.1007/s00371-024-03761-0Online publication date: 15-Feb-2025
https://doi.org/10.1007/s00371-024-03761-0
Torrens PKim R(2024)Using Immersive Virtual Reality to Study Road-Crossing Sustainability in Fleeting Moments of Space and TimeSustainability10.3390/su1603132716:3(1327)Online publication date: 4-Feb-2024
https://doi.org/10.3390/su16031327
Hertzmann A(2024)Toward a theory of perspective perception in picturesJournal of Vision10.1167/jov.24.4.2324:4(23)Online publication date: 25-Apr-2024
https://doi.org/10.1167/jov.24.4.23
Krauß VSaeghe PBoden AKhamis MMcGill MGugenheimer JNebeling M(2024)What Makes XR Dark? Examining Emerging Dark Patterns in Augmented and Virtual Reality through Expert Co-DesignACM Transactions on Computer-Human Interaction10.1145/366034031:3(1-39)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3660340
Groth CMagnor MGrogorick SEisemann MDidyk P(2024)Cybersickness Reduction via Gaze-Contingent Image DeformationACM Transactions on Graphics10.1145/365813843:4(1-14)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658138
Geslain BJartoux BBailly G(2024)The Visuo-Haptic Illusions ToolkitProceedings of the 35th International Francophone Conference on Human-Computer Interaction10.1145/3650104.3652905(1-6)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3650104.3652905
Lougiakis CMandilaras TKatifori AGanias GIoannidis IRoussou M(2024)Effects of Different Tracker-driven Direction Sources on Continuous Artificial Locomotion in VRProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687735(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687735
Lee HWeidner FSidenmark LGellersen H(2024)Snap, Pursuit and Gain: Virtual Reality Viewport Control by GazeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642838(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642838
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents