Demonstration of Finger Tracking Using Capacitive Sensing with a Ring
Pages 140 - 141
Abstract
In this demo paper, we present a demonstrator for a ring-based finger tracking approach. The demonstrator consists of a ring-shaped interaction device, called PeriSense, utilizing capacitive sensing in order to enable finger tracking. The motion of the finger wearing the ring and the adjacent fingers is sensed by measuring the capacitive proximity between the electrodes and the human skin. To map the capacitive measurements to the finger angles, we apply a regression model based on long short-term memory (LSTM). A virtual 3D hand model renders simultaneous the predicted finger angles.
References
[1]
Tobias Grosse-Puppendahl, Christian Holz, Gabe A. Cohn, Raphael Wimmer, Oskar Bechtold, Steve Hodges, Matthew S. Reynolds, and Joshua R. Smith. 2017. Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 10. https://doi.org/10.1145/3025453.3025808
[2]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-term Memory. Neural computation 9 (12 1997), 1735--80. https://doi.org/10.1162/neco.1997.9.8.1735
[3]
Christopher-Eyk Hrabia, Katrin Wolf, and Mathias Wilhelm. 2013. Whole Hand Modeling Using 8 Wearable Sensors: Biomechanics for Hand Pose Prediction. In Proceedings of the 4th Augmented Human International Conference (AH '13). ACM, New York, NY, USA, 21--28.
[4]
C. K. Jha and A. L. Chakraborty. 2018. A Fiber Bragg Grating Strain Sensor-Based Glove to Accurately Measure the Bend Angle of the Finger Flexed at the Proximal Interphalangeal Joints. In 2018 IEEE SENSORS. 1--4. https://doi.org/10.1109/ICSENS.2018.8589898
[5]
Keras. 2019. Deep Learning for humans. https://www.keras.io
[6]
David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D Interactions Anywhere Using a Wrist-Worn Gloveless Sensor. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 167--176.
[7]
Ultraleap Ltd. 2019. Leap Motion Website. https://www.leapmotion.com
[8]
Gabyong Park, Taejin Ha, and Woontack Woo. 2014. Hand Tracking with a Near-Range Depth Camera for Virtual Object Manipulation in an Wearable Augmented Reality. In Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments (Lecture Notes in Computer Science), Randall Shumaker and Stephanie Lackey (Eds.). Springer International Publishing, 396--405.
[9]
Tensorflow. 2019. Tensorflow Website. https://www.tensorflow.org
[10]
Mathias Wilhelm, Jan-Peter Lechler, Daniel Krakowczyk, and Sahin Albayrak. 2020. Ring-based Finger Tracking Using Capacitive Sensors and Long Short-Term Memory. In 25th International Conference on Intelligent User Interfaces (IUI '20). ACM, New York, NY, USA. https://doi.org/10.1145/3377325.3377535
Index Terms
- Demonstration of Finger Tracking Using Capacitive Sensing with a Ring
Recommendations
Ring-based finger tracking using capacitive sensors and long short-term memory
IUI '20: Proceedings of the 25th International Conference on Intelligent User InterfacesWe present a ring-shaped interaction device, called PeriSense, utilizing capacitive sensing in order to enable finger tracking. The finger angles and its adjacent fingers are sensed by measuring capacitive proximity between electrodes and human skin. To ...
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human InteractionThe natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Flexible Non-contact Capacitive Sensing for Hand Gesture Recognition
Intelligent Robotics and ApplicationsAbstractHand gesture recognition has become a popular research topic of human machine interface (HMI), and effective wearable sensor is an important component in the loop of hand gesture recognition system. In this paper, we introduce a flexible non-...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
March 2020
153 pages
ISBN:9781450375139
DOI:10.1145/3379336
Copyright © 2020 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
- SIGAI: ACM Special Interest Group on Artificial Intelligence
- SIGCHI: Specialist Interest Group in Computer-Human Interaction of the ACM
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 March 2020
Check for updates
Author Tags
Qualifiers
- Demonstration
- Research
- Refereed limited
Funding Sources
Conference
IUI '20
Sponsor:
- SIGAI
- SIGCHI
IUI '20: 25th International Conference on Intelligent User Interfaces
March 17 - 20, 2020
Cagliari, Italy
Acceptance Rates
Overall Acceptance Rate 746 of 2,811 submissions, 27%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 164Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 15 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in