More Web Proxy on the site http://driver.im/

research-article

Microgesture detection for remote interaction with mobile devices

Authors:

Stephan MeyerAuthors Info & Claims

MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Pages 783 - 790

https://doi.org/10.1145/2957265.2961865

Published: 06 September 2016 Publication History

Abstract

The rise of smart rings enables for ubiquitous control of computers that are wearable or mobile. We developed a ring interface using a 9 DOF IMU for detecting microgestures that can be executed while performing another task that involve hands, e.g. riding a bicycle. For the gesture classification we implemented 4 classifiers that run on the Android operating system without the need of clutch events. In a user study, we compared the success of 4 classifiers in a cycling scenario. We found that Random Forest (RF) works better for microgesture detection on Android than Dynamic Time Warping (DTW), K-Nearest-Neighbor (KNN), and than a Threshold (TH)-based approach as it has the best detection rate while it runs in real-time on Android. This work shell encourages other researchers to develop further mobile applications for using remote microgesture control in encumbered contexts.

References

[1]

Gilles Bailly, Jörg Müller, Michael Rohs, Daniel Wigdor, and Sven Kratz. 2012. ShoeSense: A New Perspective on Gestural Interaction and Wearable Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1239--1248.

Digital Library

[2]

Masaaki Fukumoto and Yoshinobu Tonomura. 1997. "Body Coupled FingerRing": Wireless Wearable Keyboard. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '97). ACM, New York, NY, USA, 147--154.

Digital Library

[3]

Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: Appropriating the Body As an Input Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 453--462.

Digital Library

[4]

Bruce Howard and Susie Howard. 2001. Light-glove: Wrist-Worn Virtual Typing and Pointing. In Proceedings of the 5th IEEE International Symposium on Wearable Computers (ISWC '01). IEEE Computer Society, Washington, DC, USA, 172--173. http://dl.acm.org/citation.cfm?id=580581.856559

Digital Library

[5]

Howell Istance, Richard Bates, Aulikki Hyrskykari, and Stephen Vickers. 2008. Snap Clutch, a Moded Approach to Solving the Midas Touch Problem. In Proceedings of the 2008 Symposium on Eye Tracking Research; Applications (ETRA '08). ACM, New York, NY, USA, 221--228.

Digital Library

[6]

Robert J. K. Jacob. 1990. What You Look at is What You Get: Eye Movement-based Interaction Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 11--18.

Digital Library

[7]

Lei Jing, Zixue Cheng, and Wang Junbo. 2011. A recognition method for one-stroke finger gestures using a MEMS 3D accelerometer. IEICE transactions on information and systems 94.5, 1062--1072.

[8]

Hamed Ketabdar, Peyman Moghadam, and Mehran Roshandel. 2012. Pingu: A New Miniature Wearable Device for Ubiquitous Computing Environments. 2014 Eighth International Conference on Complex, Intelligent and Software Intensive Systems 0 (2012), 502--506.

Digital Library

[9]

David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D Interactions Anywhere Using a Wrist-worn Gloveless Sensor. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 167--176.

Digital Library

[10]

Jun Rekimoto. 2001. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. In Proceedings of the 5th IEEE International Symposium on Wearable Computers (ISWC '01). IEEE Computer Society, Washington, DC, USA, 21--. http://dl.acm.org/citation.cfm?id=580581.856565

Digital Library

[11]

T. Scott Saponas. 2009. Enabling Always-available Input: Through On-body Interfaces. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHIEA '09). ACM, New York, NY, USA, 3117--3120.

Digital Library

[12]

Koji Tsukadaa and Michiaki Yasumurab. 2001. Ubifinger: Gesture input device for mobile use. In Proceedings of Ubicomp. 11.

[13]

A. Vardy, J. Robinson, and Li-Te Cheng. 1999. The WristCam as input device. In Wearable Computers, 1999. Digest of Papers. The Third International Symposium on. 199--202.

Digital Library

[14]

Katia Vega and Hugo Fuks. 2013. Beauty Technology As an Interactive Computing Platform. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (ITS '13). ACM, New York, NY, USA, 357--360.

Digital Library

[15]

MarkWeiser. 1991. The computer for the 21st century. Scientific american 265, 3 (1991), 94--104.

[16]

Katrin Wolf, Anja Naumann, Michael Rohs, and Jörg Müller. 2011. Taxonomy of Microinteractions: Defining Microgestures Based on Ergonomic and Scenario-dependent Requirements. In Proceedings of the 13th IFIP TC 13 International Conference on Human-computer Interaction - Volume Part I (INTERACT'11). Springer-Verlag, Berlin, Heidelberg, 559--575. http://dl.acm.org/citation.cfm?id=2042053.2042111

Digital Library

[17]

Katrin Wolf, Robert Schleicher, Sven Kratz, and Michael Rohs. 2013. Tickle: A Surface-independent Interaction Technique for Grasp Interfaces. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 185--192.

Digital Library

Cited By

Joshi NAbtahi PSodhi RBartov NRushing JCollins CVogel DGlueck M(2023)Transferable Microgestures Across Hand Posture and Location Constraints: Leveraging the Middle, Ring, and Pinky FingersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606713(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606713
Sharma ASalchow-Hömmen CMollyn VNittala AHedderich MKoelle MSeel TSteimle J(2023)SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger MicrogesturesACM Transactions on Computer-Human Interaction10.1145/356989430:3(1-40)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3569894
Bilius LVatavu R(2023)“I Could Wear It All of the Time, Just Like My Wedding Ring:” Insights into Older People’s Perceptions of Smart RingsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585771(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585771
Show More Cited By

Index Terms

Microgesture detection for remote interaction with mobile devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Ergonomic characteristics of gestures for front- and back-of-tablets interaction with grasping hands
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

The thumb and the fingers have different flexibility, and thus, gestures performed on the back of a held tablet are suggested to be different from ones performed on the touchscreen with the thumb of grasping hands. APIs for back-of-device gesture ...
Real-time 3D hand-computer interaction: optimization and complexity reduction
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

This paper presents a low-cost method for enabling 3D hand-computer interaction. The method, accompanied by a system, uses the frame capturing functionality of a single consumer-grade webcam. Our recent work has been focused on examining and realizing a ...
µGlyph: a Microgesture Notation
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

In the active field of hand microgestures, microgesture descriptions are typically expressed informally and are accompanied by images, leading to ambiguities and contradictions. An important step in moving the field forward is a rigorous basis for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

September 2016

664 pages

ISBN:9781450344135

DOI:10.1145/2957265

General Chairs:
Fabio Paternò
CNR-ISTI, Italy
,
Kaisa Väänänen
Tampere University of Technology, Finland
,
Program Chairs:
Karen Church
Intercom, USA
,
Jonna Häkkilä
University of Lapland, Finland
,
Antonio Krüger
DFKI, Germany
,
Marcos Serrano
University of Toulouse, France

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 September 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '16

Sponsor:

SIGCHI

MobileHCI '16: 18th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 6 - 9, 2016

Florence, Italy

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
329
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Joshi NAbtahi PSodhi RBartov NRushing JCollins CVogel DGlueck M(2023)Transferable Microgestures Across Hand Posture and Location Constraints: Leveraging the Middle, Ring, and Pinky FingersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606713(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606713
Sharma ASalchow-Hömmen CMollyn VNittala AHedderich MKoelle MSeel TSteimle J(2023)SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger MicrogesturesACM Transactions on Computer-Human Interaction10.1145/356989430:3(1-40)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3569894
Bilius LVatavu R(2023)“I Could Wear It All of the Time, Just Like My Wedding Ring:” Insights into Older People’s Perceptions of Smart RingsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585771(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585771
Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Martinez Avila JHazzard AGreenhalgh CBenford SMcPherson A(2023)The Stretchy Strap: supporting encumbered interaction with guitarsJournal of New Music Research10.1080/09298215.2023.227483252:1(19-40)Online publication date: 10-Nov-2023
https://doi.org/10.1080/09298215.2023.2274832
Vatavu RBilius L(2021)GestuRING: A Web-based Tool for Designing Gesture Input with Rings, Ring-Like, and Ring-Ready DevicesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474780(710-723)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474780
Sapkota SRam AZhao S(2021)Ubiquitous Interactions for Heads-Up Computing: Understanding Users’ Preferences for Subtle Interaction Techniques in Everyday SettingsProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472035(1-15)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472035
Sharma AHedderich MBhardwaj DFruchard BMcIntosh JNittala AKlakow DAshbrook DSteimle JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)SoloFinger: Robust Microgestures while Grasping Everyday ObjectsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445197(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445197
Xiao YHe R(2018)The Handlebar as an Input Field: Evaluating Finger Gestures Designed for Bicycle RidersAdvances in Human Aspects of Transportation10.1007/978-3-319-93885-1_59(648-659)Online publication date: 28-Jun-2018
https://doi.org/10.1007/978-3-319-93885-1_59
Colley AInget VRantala IHäkkilä JHenze NWoźniak PVäänänen KWilliamson JSchneegass S(2017)Investigating interaction with a ring form factorProceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia10.1145/3152832.3152870(107-111)Online publication date: 26-Nov-2017
https://dl.acm.org/doi/10.1145/3152832.3152870
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents