More Web Proxy on the site http://driver.im/

research-article

BackHand: Sensing Hand Gestures via Back of the Hand

Authors:

Kuan-Ting Chou,

Wei-Luan Tseng,

Mike Y. ChenAuthors Info & Claims

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Pages 557 - 564

https://doi.org/10.1145/2807442.2807462

Published: 05 November 2015 Publication History

Abstract

In this paper, we explore using the back of hands for sensing hand gestures, which interferes less than glove-based approaches and provides better recognition than sensing at wrists and forearms. Our prototype, BackHand, uses an array of strain gauge sensors affixed to the back of hands, and applies machine learning techniques to recognize a variety of hand gestures. We conducted a user study with 10 participants to better understand gesture recognition accuracy and the effects of sensing locations. Results showed that sensor reading patterns differ significantly across users, but are consistent for the same user. The leave-one-user-out accuracy is low at an average of 27.4%, but reaches 95.8% average accuracy for 16 popular hand gestures when personalized for each participant. The most promising location spans the 1/8~1/4 area between the metacarpophalangeal joints (MCP, the knuckles between the hand and fingers) and the head of ulna (tip of the wrist).

Supplementary Material

MP4 File (p557.mp4)

Download
36.68 MB

References

[1]

1. 2002. The effect of hand preference on hand anthropometric measurements in healthy individuals. Annals of Anatomy - Anatomischer Anzeiger 184, 3 (2002), 257--265.

[2]

2. 2015. Data Gloves -- 5DT . http://www.5dt.com/?page_id=34. (2015).

[3]

3. 2015. Thalmic Labs. Myo. https://www.thalmic.com/en/myo/. (2015).

[4]

4. Grigore C. Burdea and Philippe Coiffet. 2003. Virtual Reality Technology (2 ed.). John Wiley & Sons, Inc., New York, NY, USA.

Digital Library

[5]

5. Chih-Chung Chang and Chih-Jen Lin. 2011. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2 (2011), 27:1--27:27. Issue 3. Software available at http://www.csie.ntu.edu.tw/?cjlin/libsvm.

Digital Library

[6]

6. Artem Dementyev and Joseph A. Paradiso. 2014. WristFlex: Low-power Gesture Input with Wrist-worn Pressure Sensors. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). 161--166.

Digital Library

[7]

7. T. Deyle, S. Palinko, E.S. Poole, and T. Starner. 2007. Hambone: A Bio-Acoustic Gesture Interface. In Wearable Computers, 2007 11th IEEE International Symposium on. 3--10.

Digital Library

[8]

8. L. Dipietro, A.M. Sabatini, and P. Dario. 2008. A Survey of Glove-Based Systems and Their Applications. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on 38, 4 (July 2008), 461--482.

Digital Library

[9]

9. Rui Fukui, Masahiko Watanabe, Tomoaki Gyota, Masamichi Shimosaka, and Tomomasa Sato. 2011. Hand Shape Classification with a Wrist Contour Sensor: Development of a Prototype Device. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp '11). 311--314.

Digital Library

[10]

10. N.Y.Y. Kevin, S. Ranganath, and D. Ghosh. 2004. Trajectory modeling in gesture recognition using CyberGloves reg; and magnetic trackers. In TENCON 2004. 2004 IEEE Region 10 Conference, Vol. A. 571--574 Vol. 1.

[11]

11. David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D Interactions Anywhere Using a Wrist-worn Gloveless Sensor. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). 167--176.

Digital Library

[12]

12. Yoon Sang Kim, Byung Seok Soh, and Sang-Goog Lee. 2005. A new wearable input device: SCURRY. Industrial Electronics, IEEE Transactions on 52, 6 (Dec 2005), 1490--1499.

[13]

13. Joseph J. LaViola, Jr. 1999. A Survey of Hand Posture and Gesture Recognition Techniques and Technology. Technical Report.

[14]

14. Pranav Mistry and Pattie Maes. 2009. SixthSense: A Wearable Gestural Interface. In ACM SIGGRAPH ASIA 2009 Sketches (SIGGRAPH ASIA '09). Article 11, 1 pages.

Digital Library

[15]

15. J.K. Perng, Brian Fisher, S. Hollar, and K.S.J. Pister. 1999. Acceleration sensing glove (ASG). In Wearable Computers, 1999. Digest of Papers. The Third International Symposium on. 178--180.

Digital Library

[16]

16. Jun Rekimoto. 2001. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. In Proceedings of the 5th IEEE International Symposium on Wearable Computers (ISWC '01). 21--.

Digital Library

[17]

17. T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, and James A. Landay. 2009. Enabling Always-available Input with Muscle-computer Interfaces. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). 167--176.

Digital Library

[18]

18. Koji Tsukada and Michiaki Yasumura. 2001. Ubi-Finger: Gesture Input Device for Mobile Use. In Ubicomp 2001 Informal Companion Proceedings. Citeseer, 11.

[19]

19. D. Way and J. Paradiso. 2014. A Usability User Study Concerning Free-Hand Microgesture and Wrist-Worn Sensors. In Wearable and Implantable Body Sensor Networks (BSN), 2014 11th International Conference on. 138--142.

Digital Library

Cited By

Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Lee CZhang RAgarwal DYu TGunda VLopez OKim JYin SDong BLi KSakashita MGuimbretiere FZhang C(2024)EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642910(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642910
Alemu MLin YShull P(2024)EchoGest: Soft Ultrasonic Waveguides Based Sensing Skin for Subject-Independent Hand Gesture RecognitionIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2024.341413632(2366-2375)Online publication date: 2024
https://doi.org/10.1109/TNSRE.2024.3414136
Show More Cited By

Index Terms

BackHand: Sensing Hand Gestures via Back of the Hand
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

WristFlex: low-power gesture input with wrist-worn pressure sensors
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

In this paper we present WristFlex, an always-available on-body gestural interface. Using an array of force sensitive resistors (FSRs) worn around the wrist, the interface can distinguish subtle finger pinch gestures with high accuracy (>80 %) and ...
CuffLink: A Wristband to Grab and Release Data Between Devices
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

We present CuffLink, a wristband designed to let users transfer files between devices intuitively using grab and release hand gestures. We propose to use ultrasonic transceivers to enable device selection through pointing and employ force-sensitive ...
3D-position estimation for hand gesture interface using a single camera
HCII'11: Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II

The hand gesture interface is the state of the art technology to provide the better human-computer interaction. This paper proposes two methods to estimate the 3D-position of the hand for hand gesture interface using a single camera. By using the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

November 2015

686 pages

ISBN:9781450337793

DOI:10.1145/2807442

General Chair:
Celine Latulipe
UNC Charlotte, USA
,
Program Chairs:
Bjoern Hartmann
UC Berkeley, USA
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '15

Sponsor:

UIST '15: The 28th Annual ACM Symposium on User Interface Software and Technology

November 11 - 15, 2015

NC, Charlotte, USA

Acceptance Rates

UIST '15 Paper Acceptance Rate 70 of 297 submissions, 24%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
1,405
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)8

Reflects downloads up to 17 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cheng WChan L(2024)BodyTouchProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314267:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631426
Lee CZhang RAgarwal DYu TGunda VLopez OKim JYin SDong BLi KSakashita MGuimbretiere FZhang C(2024)EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a WristbandProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642910(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642910
Alemu MLin YShull P(2024)EchoGest: Soft Ultrasonic Waveguides Based Sensing Skin for Subject-Independent Hand Gesture RecognitionIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2024.341413632(2366-2375)Online publication date: 2024
https://doi.org/10.1109/TNSRE.2024.3414136
Jomyo SFurui AMatsumoto TTsunoda TTsuji T(2024)Finger-Tapping Motion Recognition Based on Skin Surface Deformation Using Wrist-Mounted Piezoelectric Film SensorsIEEE Sensors Journal10.1109/JSEN.2024.338633324:11(17876-17884)Online publication date: 1-Jun-2024
https://doi.org/10.1109/JSEN.2024.3386333
Allen BGarrad MCifuentes C(2024)Synergistic Orthopaedic Fatigue Tracking Glove: SOFT Glove2024 10th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob)10.1109/BioRob60516.2024.10719854(767-772)Online publication date: 1-Sep-2024
https://doi.org/10.1109/BioRob60516.2024.10719854
Sharma ASalchow-Hömmen CMollyn VNittala AHedderich MKoelle MSeel TSteimle J(2023)SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger MicrogesturesACM Transactions on Computer-Human Interaction10.1145/356989430:3(1-40)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3569894
Waghmare ABen Taleb YChatterjee INarendra APatel S(2023)Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581422(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581422
Niijima AKubo Y(2023)Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle StimulationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581192(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581192
Guo KZhou HJing SDu HLuo PHou JLi X(2023)PianoWatch: An Intelligent Piano Understanding and Evaluation System Using Smartwatch2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SECON58729.2023.10287516(222-230)Online publication date: 11-Sep-2023
https://doi.org/10.1109/SECON58729.2023.10287516
Lang MStrobel CWeckesser FLanglois DKasneci EKozlíková BKrone M(2023)A multimodal smartwatch-based interaction concept for immersive environmentsComputers & Graphics10.1016/j.cag.2023.10.010117(85-95)Online publication date: Dec-2023
https://doi.org/10.1016/j.cag.2023.10.010
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents