More Web Proxy on the site http://driver.im/

short-paper

Freehand grasping in mixed reality: analysing variation during transition phase of interaction

Authors:

Maadh Al-Kalbani,

Maite Frutos-Pascual,

Ian WilliamsAuthors Info & Claims

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

Pages 110 - 114

https://doi.org/10.1145/3136755.3136776

Published: 03 November 2017 Publication History

Abstract

This paper presents an assessment of the variability in freehand grasping of virtual objects in an exocentric mixed reality environment. We report on an experiment covering 480 grasp based motions in the transition phase of interaction to determine the level of variation to the grasp aperture. Controlled laboratory conditions were used where 30 right-handed participants were instructed to grasp and move an object (cube or sphere) using a single medium wrap grasp from a starting location (A) to a target location (B) in a controlled manner. We present a comprehensive statistical analysis of the results showing the variation in grasp change during this phase of interaction. In conclusion we detail recommendations for freehand virtual object interaction design notably that considerations should be given to the change in grasp aperture over the transition phase of interaction.

References

[1]

Maadh Al-Kalbani, Ian Williams, and Maite Frutos-Pascual. 2016. Analysis of Medium Wrap Freehand Virtual Object Grasping in Exocentric Mixed Reality. In Mixed and Augmented Reality (ISMAR), 2016 IEEE International Symposium on. IEEE, 84–93.

[2]

Maadh Al-Kalbani, Ian Williams, and Maite Frutos-Pascual. 2016. Improving freehand placement for grasping virtual objects via dual view visual feedback in mixed reality. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology. ACM, 279–282.

Digital Library

[3]

Chiara Bozzacchi and Fulvio Domini. 2015. Lack of depth constancy for grasping movements in both virtual and real environments. Journal of neurophysiology 114, 4 (2015), 2242–2248.

[4]

I. M. Bullock, T. Feix, and A. M. Dollar. 2013. Finding small, versatile sets of human grasps to span common objects. Proceedings - IEEE International Conference on Robotics and Automation (2013), 1068–1075.

[5]

Zhongting Chen and Jeffrey A Saunders. 2016. Automatic adjustments toward unseen visual targets during grasping movements. Experimental brain research 234, 7 (2016), 2091–2103.

[6]

T. Feix, I. M. Bullock, and A. M. Dollar. 2014. Analysis of Human Grasping Behavior: Correlating Tasks, Objects and Grasps. IEEE Transactions on Haptics 7, 3 (2014), 311–323.

[7]

T. Feix, R. Pawlik, H. B. Schmiedmayer, J. Romero, and D. Kragi. 2009. A comprehensive grasp taxonomy. Robotics, Science and Systems Conference: Workshop on Understanding the Human Hand for Advancing Robotic Manipulation (2009), 2–3.

[8]

AM Gordon. 1994. Development of the reach to grasp movement. Advances in psychology 105 (1994), 37–56.

[9]

D. Holz, S. Ullrich, M. Wolter, and T. Kuhlen. 2008. Multi-Contact Grasp Interaction for Virtual Environments. Journal of Virtual Reality and Broadcasting 5, 7 (2008), 101–112.

[10]

G. Hough, I. Williams, and C. Athwal. 2015. Fidelity and plausibility of bimanual interaction in mixed reality. IEEE TVCG 21, 12 (2015), 1377–1389.

Digital Library

[11]

Christine L MacKenzie and Thea Iberall. 1994. The grasping hand. Vol. 104. Elsevier.

[12]

Alessio Malizia and Andrea Bellucci. 2012. The artificiality of natural user interfaces. Commun. ACM 55, 3 (2012), 36–38.

Digital Library

[13]

Kerstin Stockmeier, Heinrich Horton, and Volker H Franz. 2003. How do we grasp (virtual) objects in three-dimensional space? Journal of Vision 3, 9 (2003), 383–383.

[14]

Tamara Supuk, Tadej Bajd, and Gregorij Kurillo. 2011. Assessment of reach-tograsp trajectories toward stationary objects. Clinical biomechanics 26, 8 (2011), 811–818.

[15]

S. Suzuki, H. Suzuki, and M. Sato. 2014. Grasping a virtual object with a bare hand. ACM SIGGRAPH 2014 Posters (2014), 1–1.

Digital Library

[16]

Matthew Turk. 2014. Multimodal interaction: A review. Pattern Recognition Letters 36 (2014), 189–195.

Digital Library

Cited By

Blaga AFrutos-Pascual MCreed CWilliams I(2024)VR-Grasp: A Human Grasp Taxonomy for Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351719(1-17)Online publication date: 26-May-2024
https://doi.org/10.1080/10447318.2024.2351719
Wang HHou WCao YYang B(2024)Exploring the Relationship Between the Interactive Range of Objects and the Performance of Freehand Grasping Interaction in Glasses-Free 3D ScenesHCI International 2024 Posters10.1007/978-3-031-61950-2_17(147-158)Online publication date: 7-Jun-2024
https://doi.org/10.1007/978-3-031-61950-2_17
Dalia Blaga AFrutos-Pascual MCreed CWilliams I(2021)Freehand Grasping: An Analysis of Grasping for Docking Tasks in Virtual Reality2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00102(749-758)Online publication date: Mar-2021
https://doi.org/10.1109/VR50410.2021.00102
Show More Cited By

Index Terms

Freehand grasping in mixed reality: analysing variation during transition phase of interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input
  2. Interaction design
    1. Empirical studies in interaction design

Recommendations

Improving freehand placement for grasping virtual objects via dual view visual feedback in mixed reality
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

This paper presents a first study into the use of dual view visual feedback in an exocentric MR environment for assisting freehand grasping of virtual objects. Recent work has highlighted problems associated with user errors in freehand grasping, via an ...
The Gesture Authoring Space: Authoring Customised Hand Gestures for Grasping Virtual Objects in Immersive Virtual Environments
MuC '22: Proceedings of Mensch und Computer 2022

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without additional hardware. ...
Real-time 3D video avatar in mixed reality: an implementation for immersive telecommunication
Symposium: virtual reality simulation

This article presents an implementation of a real-time dynamic 3D avatar from multiview cameras for immersive telecommunication. Immersive telecommunication is a new challenging field that enables a user to share a virtual space with remote participants,...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

November 2017

676 pages

ISBN:9781450355438

DOI:10.1145/3136755

General Chairs:
Edward Lank
University of Waterloo, Canada
,
Alessandro Vinciarelli
University of Glasgow, UK
,
Program Chairs:
Eve Hoggan
Aarhus University, Denmark
,
Sriram Subramanian
University of Sussex, UK
,
Stephen A. Brewster
University of Glasgow, UK

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ICMI '17

Sponsor:

SIGCHI

ICMI '17: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 13 - 17, 2017

Glasgow, UK

Acceptance Rates

ICMI '17 Paper Acceptance Rate 65 of 149 submissions, 44%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
230
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Blaga AFrutos-Pascual MCreed CWilliams I(2024)VR-Grasp: A Human Grasp Taxonomy for Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351719(1-17)Online publication date: 26-May-2024
https://doi.org/10.1080/10447318.2024.2351719
Wang HHou WCao YYang B(2024)Exploring the Relationship Between the Interactive Range of Objects and the Performance of Freehand Grasping Interaction in Glasses-Free 3D ScenesHCI International 2024 Posters10.1007/978-3-031-61950-2_17(147-158)Online publication date: 7-Jun-2024
https://doi.org/10.1007/978-3-031-61950-2_17
Dalia Blaga AFrutos-Pascual MCreed CWilliams I(2021)Freehand Grasping: An Analysis of Grasping for Docking Tasks in Virtual Reality2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00102(749-758)Online publication date: Mar-2021
https://doi.org/10.1109/VR50410.2021.00102
Al-Kalbani MFrutos-Pascual MWilliams I(2019)Virtual Object Grasping in Augmented Reality: Drop Shadows for Improved Interaction2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games)10.1109/VS-Games.2019.8864596(1-8)Online publication date: Sep-2019
https://doi.org/10.1109/VS-Games.2019.8864596

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents