A Community-Based Exploration Into Gesture-driven Locomotion Control in Virtual Reality
Authors: 
Emilie Arendttorp, 
Selma Auala, 
Heike Winschiers-Theophilus, 
Kasper Rodil, Samkao MagotAuthors Info & Claims
Pages 180 - 189
Abstract
Gesture-based control in virtual reality applications provides a more natural interaction but at the same time brings about new challenges in regards to implementing actions such as locomotion. In an effort to maintain a user-driven approach to the design of more intuitive and natural control gestures, we have run an exploratory study with a rural partner community in Southern Africa. We conducted one gesture elicitation session, which informed the implementation of a locomotion control gesture, which was evaluated after a second elicitation session. The findings will guide application specific implementations and further research to confirm user approval and minimized cybersickness.
References
[1]
Roland Aigner, Daniel Wigdor, Hrvoje Benko, Michael Haller, David Lindbauer, Alexandra Ion, Shengdong Zhao, and JTKV Koh. 2012. Understanding mid-air hand gestures: A study of human preferences in usage of gesture types for hci. Microsoft Research TechReport MSR-TR-2012-111 2 (2012), 30.
[2]
Emilie Maria Nybo Arendttorp, Kasper Rodil, Heike Winschiers-Theophilus, and Christof Magoath. 2022. Overcoming Legacy Bias: Re-Designing Gesture Interactions in Virtual Reality With a San Community in Namibia. In CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3491102.3517549
[3]
Emilie Maria Nybo Arendttorp, Heike Winschiers-Theophilus, Kasper Rodil, Freja B. K. Johansen, Mads Rosengreen Jørgensen, Thomas K. K. Kjeldsen, and Samkao Magot. 2023. Grab It, While You Can: A VR Gesture Evaluation of a Co-Designed Traditional Narrative by Indigenous People. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 308, 13 pages. https://doi.org/10.1145/3544548.3580894
[4]
Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016. Point & Teleport Locomotion Technique for Virtual Reality. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (Austin, Texas, USA) (CHI PLAY ’16). Association for Computing Machinery, New York, NY, USA, 205–216. https://doi.org/10.1145/2967934.2968105
[5]
Johnell O Brooks, Richard R Goodenough, Matthew C Crisler, Nathan D Klein, Rebecca L Alley, Beatrice L Koon, William C Logan Jr, Jennifer H Ogle, Richard A Tyrrell, and Rebekkah F Wills. 2010. Simulator sickness during driving simulation studies. Accident analysis & prevention 42, 3 (2010), 788–796.
[6]
Polona Caserman, Augusto Garcia-Agundez, Alvar Gámez Zerban, and Stefan Göbel. 2021. Cybersickness in current-generation virtual reality head-mounted displays: systematic review and outlook. Virtual Reality 25, 4 (2021), 1153–1170.
[7]
Jeremy Clifton and Stephen Palmisano. 2019. Comfortable Locomotion in VR: Teleportation is Not a Complete Solution. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 60, 2 pages. https://doi.org/10.1145/3359996.3364722
[8]
Noah Coomer, Sadler Bullard, William Clinton, and Betsy Williams-Sanders. 2018. Evaluating the Effects of Four VR Locomotion Methods: Joystick, Arm-Cycling, Point-Tugging, and Teleporting. In Proceedings of the 15th ACM Symposium on Applied Perception (Vancouver, British Columbia, Canada) (SAP ’18). Association for Computing Machinery, New York, NY, USA, Article 7, 8 pages. https://doi.org/10.1145/3225153.3225175
[9]
Andreea Danielescu and David Piorkowski. 2022. Iterative Design of Gestures During Elicitation: Understanding the Role of Increased Production. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 558, 14 pages. https://doi.org/10.1145/3491102.3501962
[10]
Perfuse Entertainment. 2017. Golf It!https://store.steampowered.com/app/571740/Golf_It/ Last accessed 12 May, 2023.
[11]
Fireproof Games. 2020. The Room VR: A Dark Matter. https://store.steampowered.com/app/1104380/The_Room_VR_A_Dark_Matter/ Last accessed 12 May, 2023.
[12]
Ian Hamilton. 2020. New Oculus Quest Hand Tracking Experiments Include Addams Family’s ’Thing’. https://www.uploadvr.com/quest-hand-tracking-walking/ Last accessed 18 May, 2023.
[13]
David Heaney. 2023. Meta Interaction SDK Gets Hand Tracking Teleport Gesture With Demo Game. https://www.uploadvr.com/meta-interaction-sdk-hand-tracking-teleport/ Last accessed 18 May, 2023.
[14]
Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. Most people are not WEIRD. Nature 466, 7302 (2010), 29–29.
[15]
Freja B. K. Johansen, Thomas K. K. Kjeldsen, Mads Rosengren Jørgensen, Samkao Magot, April Magot, Shorty Kandjengo, Heike Winschiers-Theophilus, Emilie Maria Nybo Arendttorp, and Kasper Rodil. 2022. Hunting with the Ju/’hoansi in the Kalahari: A Co-Created VR Gesture Application. In Adjunct Proceedings of the 2022 Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI ’22). Association for Computing Machinery, New York, NY, USA, Article 32, 2 pages. https://doi.org/10.1145/3547522.3547715
[16]
Eike Langbehn, Paul Lubos, and Frank Steinicke. 2018. Evaluation of Locomotion Techniques for Room-Scale VR: Joystick, Teleportation, and Redirected Walking. In Proceedings of the Virtual Reality International Conference - Laval Virtual (Laval, France) (VRIC ’18). Association for Computing Machinery, New York, NY, USA, Article 4, 9 pages. https://doi.org/10.1145/3234253.3234291
[17]
Joseph J. LaViola. 2000. A Discussion of Cybersickness in Virtual Environments. SIGCHI Bull. 32, 1 (jan 2000), 47–56. https://doi.org/10.1145/333329.333344
[18]
Joseph J LaViola Jr, Ernst Kruijff, Ryan P McMahan, Doug Bowman, and Ivan P Poupyrev. 2017. 3D user interfaces: theory and practice. Addison-Wesley Professional, Boston, MA, USA.
[19]
Shaimaa Lazem, Danilo Giglitto, Makuochi Samuel Nkwo, Hafeni Mthoko, Jessica Upani, and Anicia Peters. 2022. Challenges and paradoxes in decolonising HCI: A critical discussion. Computer Supported Cooperative Work (CSCW) 31, 2 (2022), 159–196.
[20]
James Liu, Hirav Parekh, Majed Al-Zayer, and Eelke Folmer. 2018. Increasing Walking in VR Using Redirected Teleportation. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 521–529. https://doi.org/10.1145/3242587.3242601
[21]
Siyi Liu, Gun Lee, Yi Li, Thammathip Piumsomboon, and Barrett Ens. 2021. Force-Based Foot Gesture Navigation in Virtual Reality. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (Osaka, Japan) (VRST ’21). Association for Computing Machinery, New York, NY, USA, Article 72, 3 pages. https://doi.org/10.1145/3489849.3489945
[22]
Free Lives. 2019. GORN. https://store.steampowered.com/app/578620/GORN/ Last accessed 12 May, 2023.
[23]
Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, MC Schraefel, and Jacob O Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. interactions 21, 3 (2014), 40–45.
[24]
Thiago M Porcino, Esteban Clua, Daniela Trevisan, Cristina N Vasconcelos, and Luis Valente. 2017. Minimizing cyber sickness in head mounted display systems: design guidelines and applications. In 2017 IEEE 5th international conference on serious games and applications for health (SeGAH). IEEE, Perth, WA, Australia, 1–6. https://doi.org/10.1109/SeGAH.2017.7939283
[25]
Aniruddha Prithul, Jiwan Bhandari, Walker Spurgeon, and Eelke Folmer. 2022. Evaluation of Hands-Free Teleportation in VR. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (Online, CA, USA) (SUI ’22). Association for Computing Machinery, New York, NY, USA, Article 5, 6 pages. https://doi.org/10.1145/3565970.3567683
[26]
Ananth N Ramaseri Chandra, Fatima El Jamiy, and Hassan Reza. 2022. A Systematic Survey on Cybersickness in Virtual Environments. Computers 11, 4 (2022), 51.
[27]
James T Reason and Joseph John Brand. 1975. Motion sickness.Academic press, Cambridge, Massachusetts, USA.
[28]
Bernhard E. Riecke, David Clement, Ashu Adhikari, Denise Quesnel, Daniel Zielasko, and Markus von der Heyde. 2022. HyperJumping in Virtual Vancouver: Combating Motion Sickness by Merging Teleporting and Continuous VR Locomotion in an Embodied Hands-Free VR Flying Paradigm. In ACM SIGGRAPH 2022 Immersive Pavilion (Vancouver, BC, Canada) (SIGGRAPH ’22). Association for Computing Machinery, New York, NY, USA, Article 7, 2 pages. https://doi.org/10.1145/3532834.3536211
[29]
Vertical Robot. 2019. Red Matter. https://www.oculus.com/experiences/quest/2180753588712484/?locale=da_DK Last accessed 12 May, 2023.
[30]
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2021. Controlling teleportation-based locomotion in virtual reality with hand gestures: a comparative evaluation of two-handed and one-handed techniques. Electronics 10, 6 (2021), 715.
[31]
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. AnyGesture: Arbitrary One-Handed Gestures for Augmented, Virtual, and Mixed Reality Applications. Applied Sciences 12, 4 (2022), 1888.
[32]
Alexander Schäfer, Gerd Reis, and Didier Stricker. 2022. Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures. In Virtual Reality and Mixed Reality, Gabriel Zachmann, Mariano Alcañiz Raya, Partrick Bourdot, Maud Marchal, Jeanine Stefanucci, and Xubo Yang (Eds.). Springer International Publishing, Cham, 191–205.
[33]
Jonas Schjerlund, Kasper Hornbæk, and Joanna Bergström. 2021. Ninja Hands: Using Many Hands to Improve Target Selection in VR. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 130, 14 pages. https://doi.org/10.1145/3411764.3445759
[34]
Jan-Philipp Stauffert, Florian Niebling, and Marc Erich Latoschik. 2020. Latency and cybersickness: Impact, causes, and measures. A review. Frontiers in Virtual Reality 1 (2020), 582204.
[35]
Superbright. 2020. In Death: Unchained. https://www.oculus.com/experiences/quest/2334376869949242/ Last accessed 12 May, 2023.
[36]
SUPERHOT Team. 2016. SUPERHOT. https://store.steampowered.com/app/322500/SUPERHOT/ Last accessed 12 May, 2023.
[37]
Toast. 2019. Richie’s Plank Experience. https://www.oculus.com/experiences/quest/1642239225880682/ Last accessed 12 May, 2023.
[38]
Chun-Miao Tseng, Po-Yu Chen, Shih Chin Lin, Yu-Wei Wang, Yu-Hsin Lin, Mu-An Kuo, Neng-Hao Yu, and Mike Y. Chen. 2022. HeadWind: Enhancing Teleportation Experience in VR by Simulating Air Drag during Rapid Motion. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 518, 11 pages. https://doi.org/10.1145/3491102.3501890
[39]
Valve. 2020. Half-Life: Alyx. https://store.steampowered.com/app/546560/HalfLife_Alyx/ Last accessed 12 May, 2023.
[40]
Panagiotis Vogiatzidakis and Panayiotis Koutsabasis. 2018. Gesture elicitation studies for mid-air interaction: A review. Multimodal Technologies and Interaction 2, 4 (2018), 65.
[41]
WarpFrog. 2018. Blade and Sorcery. https://store.steampowered.com/app/578620/GORN/ Last accessed 12 May, 2023.
[42]
Huiyue Wu, Weizhou Luo, Neng Pan, Shenghuan Nan, Yanyi Deng, Shengqian Fu, and Liuqingqing Yang. 2019. Understanding freehand gestures: a study of freehand gestural interaction for immersive VR shopping applications. Human-centric Computing and Information Sciences 9, 1 (2019), 1–26.
[43]
Run Yu and Doug A Bowman. 2018. Force push: Exploring expressive gesture-to-force mappings for remote object manipulation in virtual reality. Frontiers in ICT 5 (2018), 25.
Index Terms
- A Community-Based Exploration Into Gesture-driven Locomotion Control in Virtual Reality
Recommendations
Grab It, While You Can: A VR Gesture Evaluation of a Co-Designed Traditional Narrative by Indigenous People
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsRecent developments in Virtual Reality (VR) applications, such as hand gesture tracking, provide new opportunities to create embodied user experiences. Numerous gesture elicitation studies have been conducted. However, in most instances they lack ...
Effects of Third-Person Locomotion Techniques on Sense of Embodiment in Virtual Reality
MUM '24: Proceedings of the International Conference on Mobile and Ubiquitous MultimediaVirtual Reality (VR) has enabled novel ways to study embodiment and understand how a virtual avatar may be treated as part of a person’s body. These studies mainly employ virtual bodies perceived from a first-person perspective, given that VR has a ...
Evaluation of immersive virtual reality locomotion mechanisms
IHC '20: Proceedings of the 19th Brazilian Symposium on Human Factors in Computing SystemsMotion sickness is one of the most common issues that affects the user experience in immersive virtual reality environments. In general, a user feels motion sickness because the brain perceives a movement but his/her body is not actually moving. In ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2023
343 pages
ISBN:9798400708879
DOI:10.1145/3628096
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 30 January 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
AfriCHI 2023
AfriCHI 2023: 4th African Human Computer Interaction Conference
November 27 - December 1, 2023
East London, South Africa
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 63Total Downloads
- Downloads (Last 12 months)63
- Downloads (Last 6 weeks)5
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format