[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Two-In-One: A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement

Published: 08 July 2022 Publication History

Abstract

Virtual Reality (VR) applications often require users to perform actions with two hands when performing tasks and interacting with objects in virtual environments. Although bimanual interactions in VR can resemble real-world interactions—thus increasing realism and improving immersion—they can also pose significant accessibility challenges to people with limited mobility, such as for people who have full use of only one hand. An opportunity exists to create accessible techniques that take advantage of users’ abilities, but designers currently lack structured tools to consider alternative approaches. To begin filling this gap, we propose Two-In-One, a design space that facilitates the creation of accessible methods for bimanual interactions in VR from unimanual input. Our design space comprises two dimensions, bimanual interactions and computer assistance, and we provide a detailed examination of issues to consider when creating new unimanual input techniques that map to bimanual interactions in VR. We used our design space to create three interaction techniques that we subsequently implemented for a subset of bimanual interactions and received user feedback through a video elicitation study with 17 people with limited mobility. Our findings explore complex tradeoffs associated with autonomy and agency and highlight the need for additional settings and methods to make VR accessible to people with limited mobility.

References

[1]
2020. SpecialEffect: The Gamers' Charity.
[2]
MW 2002. WalkinVRDriver.
[3]
K. Ahuja, E. Ofek, M. Gonzalez-Franco, C. Holz, and A. D. Wilson. 2021. CoolMoves: User motion accentuation in virtual reality. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 5, 1–23.
[4]
M. Annett. 1970. A classification of hand preference by association analysis. British Journal of Psychology 61, 303–321.
[5]
V. Braun and V. Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 77–101.
[6]
F. Brudy, C. Holz, R. Rädle, C. J. Wu, S. Houben, C. N. Klokmose, and N. Marquardt. 2019. Cross-device taxonomy: Survey, opportunities and challenges of interactions spanning across multiple devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–28.
[7]
W. Buxton and B. Myers. 1986. A study in two-handed input. ACM SIGCHI Bulletin 17, 321–326.
[8]
F. Cai and M. D. Rijke. 2016. A survey of query auto completion in information retrieval. Foundations and Trends® in Information Retrieval 10, 273–363.
[9]
S. K. Card, J. D. Mackinlay, and G. G. Robertson. 1990. The design space of input devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 117–124.
[10]
S. K. Card, J. D. Mackinlay, and G. G. Robertson. 1991. A morphological analysis of the design space of input devices. ACM Transactions on Information Systems (TOIS) 9, 99–122.
[11]
T. A. Charity. 2020. Able Gamers.
[12]
B. David-John, C. Peacock, T. Zhang, T. S. Murdison, H. Benko, and T. R. Jonker. 2021. Towards gaze-based prediction of the intent to interact in virtual reality. In ACM Symposium on Eye Tracking Research and Applications. 1–7.
[13]
K. Gerling, P. Dickinson, K. Hicks, L. Mason, A. L. Simeone, and K. Spiel. 2020. Virtual reality games for people using wheelchairs. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.
[14]
K. Gerling and K. Spiel. 2021. A critical examination of virtual reality technology in the context of the minority body. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
[15]
M. Gonzalez-Franco, B. Cohn, E. Ofek, D. Burin, and A. Maselli. 2020. The self-avatar follower effect in virtual reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 18–25.
[16]
Y. Guiard. 1987. Asymmetric division of labor in human skilled bimanual action: The Kinematic Chain as a model. Journal of Motor Behavior 19, 486–517.
[17]
Game Accessibility Guidelines. 2020
[18]
K. Y. Haaland, P. K. Mutha, J. K. Rinehart, M. Daniels, B. Cushnyr, and J. C. Adair. 2012. Relationship between arm usage and instrumental activities of daily living after unilateral stroke. Archives of Physical Medicine and Rehabilitation 93, 1957–1962.
[19]
K. Hinckley, M. Czerwinski, and M. Sinclair. 1998. Interaction and modeling techniques for desktop two-handed input. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. 49–58.
[20]
K. Hinckley, R. Pausch, D. Proffitt, J. Patten, and N. Kassell. 1997. Cooperative bimanual action. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems. 27–34.
[21]
K. Hinckley, J. Pierce, M. Sinclair, and E. Horvitz. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology. 91–100.
[22]
T. Hirzle, J. Gugenheimer, F. Geiselhart, A. Bulling, and E. Rukzio. 2019. A design space for gaze interaction on head-mounted displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
[23]
E. Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 159–166.
[24]
P. Kabbash, W. Buxton, and A. Sellen. 1994. Two-handed input in a compound task. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 417–423.
[25]
S. Kim, J. Zhao, Y. Tian, and S. Chandra. 2021. Code prediction by feeding trees to transformers. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE. 150–162.
[26]
J.-C. Lévesque, D. Laurendeau, and M. Mokhtari. 2013. An asymmetric bimanual gestural interface for immersive virtual environments. In International Conference on Virtual, Augmented and Mixed Reality, Springer. 192–201.
[27]
R. L. Franz, S. Junuzovic, and M. Mott. 2021. Nearmi: A framework for designing point of interest techniques for VR users with limited mobility. In The 23rd International ACM SIGACCESS Conference on Computers and Accessibility. 1–14.
[28]
C. E. Lang, K. J. Waddell, J. W. Klaesner, and M. D. Bland. 2017. A method for quantifying upper limb performance in daily life using accelerometers. JOVE (Journal of Visualized Experiments), E55673.
[29]
S. I. E. LLC. 2020. Accessibility Options for The Last of Us Part II.
[30]
Sony Interactive Entertainment. 2020. Accessibility Options for The Last of Us Part II.
[31]
B. J. McNely. 2013. Visual research methods and communication design. In Proceedings of the 31st ACM International Conference on Design of Communication. 123–132.
[32]
M. E. Michielsen, R. W. Selles, H. J. Stam, G. M. Ribbers, and J. B. Bussmann. 2012. Quantifying nonuse in chronic stroke patients: A study into paretic, nonparetic, and bimanual upper-limb use in daily life. Archives of Physical Medicine and Rehabilitation 93, 1975–1981.
[33]
M. Mott, E. Cutrell, M. G. Franco, C. Holz, E. Ofek, R. Stoakley, and M. R. Morris. 2019. Accessible by design: An opportunity for virtual reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 451–454.
[34]
M. E. Mott, J. Tang, S. K. Kane, E. Cutrell, and M. R. Morris. 2020. “I just went into it assuming that I wouldn't be able to have the full experience”: Understanding the accessibility of VR for people with limited mobility. In Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’20). New York: ACM Press.
[35]
R. C. Oldfield. 1971. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9, 97–113.
[36]
A. Olteanu, F. Diaz, and G. Kazai. 2020. When are search completion suggestions problematic? Proceedings of the ACM on Human-Computer Interaction 4, 1–25.
[37]
M. Osumi, A. Ichinose, M. Sumitani, N. Wake, Y. Sano, A. Yozu, S. Kumagaya, Y. Kuniyoshi, and S. Morioka. 2016. Restoring movement representation and alleviating phantom limb pain through short-term neurorehabilitation with a virtual reality system. European Journal of Pain 21, 140–147.
[38]
K. Pfeuffer, J. Alexander, M. K. Chong, and H. Gellersen. 2014. Gaze-Touch: Combining gaze with multi-touch for interaction on the same surface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. 509–518.
[39]
A. Sears, M. Young, and J. Feng. 2003. Physical Disabilities and Computing Technologies: An Analysis of Impairments. CRC Press.
[40]
Valve 2020. Half-Life: Alyx.
[41]
A. Vega-Gonzalez and M. H. Granat. 2005. Continuous monitoring of upper-limb activity in a free-living environment. Archives of Physical Medicine and Rehabilitation 86, 541–548.
[42]
M. Veit, A. Capobianco, and D. Bechmann, 2008. Consequence of two-handed manipulation on speed, precision and perception on spatial input task in 3D modelling applications. J. UCS 14, 3174–3187.
[43]
W3C 2020. XR Accessibility User Requirements, J. S. Joshue O'Connor, Jason White, Scott Hollier, Michael Cooper Ed.
[44]
J. O. Wobbrock, S. K. Kane, K. Z. Gajos, S. Harada, and J. Froehlich. 2011. Ability-based design: Concept, principles and examples. ACM Transactions on Accessible Computing (TACCESS) 3, 1–27.
[45]
A. S. Won, J. Bailenson, J. Lee, and J. Lanier. 2015. Homuncular flexibility in virtual reality. Journal of Computer-Mediated Communication 20, 241–259.
[46]
Q. Yang, A. Steinfeld, C. Ros, and J. Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[47]
K.-P. Yee. 2004. Two-handed interaction on a tablet display. In CHI'04 Extended Abstracts on Human Factors in Computing Systems. 1493–1496.
[48]
Y. Zhang, M. Pahud, C. Holz, H. Xia, G. Laput, M. Mcguffin, X. Tu, A. Mittereder, F. Su, and W. Buxton. 2019. Sensing posture-aware pen+touch interaction on tablets. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Cited By

View all
  • (2024)Research on Visual and Interactive Evaluation Methods for Space Design Based on Virtual Reality TechnologyApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-14219:1Online publication date: 7-Jun-2024
  • (2024)Design and Evaluation of an Automatic Text Simplification Prototype with Deaf and Hard-of-hearing ReadersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675645(1-18)Online publication date: 27-Oct-2024
  • (2024)Hand Me This: Exploring the Effects of Gaze-driven Animations and Hand Representations in Users’ Sense of Presence and EmbodimentProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656362(1-7)Online publication date: 4-Jun-2024
  • Show More Cited By

Index Terms

  1. Two-In-One: A Design Space for Mapping Unimanual Input into Bimanual Interactions in VR for Users with Limited Movement

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Accessible Computing
      ACM Transactions on Accessible Computing  Volume 15, Issue 3
      September 2022
      281 pages
      ISSN:1936-7228
      EISSN:1936-7236
      DOI:10.1145/3544005
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 08 July 2022
      Online AM: 08 March 2022
      Accepted: 01 January 2022
      Revised: 01 November 2021
      Received: 01 July 2021
      Published in TACCESS Volume 15, Issue 3

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Accessibility
      2. bimanual
      3. interaction techniques
      4. input techniques
      5. movement limitations
      6. virtual reality

      Qualifiers

      • Research-article
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)420
      • Downloads (Last 6 weeks)28
      Reflects downloads up to 28 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Research on Visual and Interactive Evaluation Methods for Space Design Based on Virtual Reality TechnologyApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-14219:1Online publication date: 7-Jun-2024
      • (2024)Design and Evaluation of an Automatic Text Simplification Prototype with Deaf and Hard-of-hearing ReadersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675645(1-18)Online publication date: 27-Oct-2024
      • (2024)Hand Me This: Exploring the Effects of Gaze-driven Animations and Hand Representations in Users’ Sense of Presence and EmbodimentProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656362(1-7)Online publication date: 4-Jun-2024
      • (2024)A Virtual Reality Scene Taxonomy: Identifying and Designing Accessible Scene-Viewing TechniquesACM Transactions on Computer-Human Interaction10.1145/363514231:2(1-44)Online publication date: 5-Feb-2024
      • (2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633349(1-16)Online publication date: 11-Feb-2024
      • (2024)Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642884(1-19)Online publication date: 11-May-2024
      • (2024)Playing on Hard Mode: Accessibility, Difficulty and Joy in Video Game Adoption for Gamers with DisabilitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642804(1-17)Online publication date: 11-May-2024
      • (2024)From Teleportation to Climbing: A Review of Locomotion Techniques in the Most Used Commercial Virtual Reality ApplicationsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2372151(1-21)Online publication date: 8-Jul-2024
      • (2024)Transformative Virtual Reality Games for Adaptive Sports Training: Exploring the Perceptions of Individuals with Mobility ImpairmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2311970(1-13)Online publication date: 13-Feb-2024
      • (2024)BibliographyHuman-Computer Interaction10.1016/B978-0-44-314096-9.00015-4(391-429)Online publication date: 2024
      • Show More Cited By

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media