Flexible Non-contact Capacitive Sensing for Hand Gesture Recognition
Pages 611 - 621
Abstract
Hand gesture recognition has become a popular research topic of human machine interface (HMI), and effective wearable sensor is an important component in the loop of hand gesture recognition system. In this paper, we introduce a flexible non-contact capacitive wristband that can be used to detect both wrist and finger gestures. To demonstrate the effectiveness and performance of the designed prototype, nine wrist gestures and ten finger gestures were selected. Five subjects participated in the experiment. To validate the importance of considering spacial relationship among channels, especially when discriminating intricate finger gestures, CNN was implemented and compared with LDA. In the wrist gesture recognition task, LDA achieved the average accuracy of 98.38%, and CNN achieved the average accuracy of 99.81%. In the finger gesture recognition task, LDA achieved the average accuracy of 90.04%, and CNN achieved the average accuracy of 95.54%. This study suggested that the designed flexible non-contact capacitive wristband could be used as an alternative for hand gesture recognition, and considering spacial relationship among channels on different measuring location yields better recognition result.
References
[1]
Xie R and Cao J Accelerometer-based hand gesture recognition by neural network and similarity matching IEEE Sens. J. 2016 16 11 4537-4545
[2]
Xu, Z., Xiang, C., Wang, W.H., Yang, J., Wang, K.: Hand gesture recognition and virtual game control based on 3d accelerometer and EMG sensors. In: Proceedings of the 2009 International Conference on Intelligent User Interfaces, pp. 401–406. Association for Computing Machinery, Sanibel Island, Florida, USA (2009).
[3]
Vidovic, M.M., Hwang, H., Amsuss, S., Hahne, J.M., Farina, D., Muller, K.: Improving the robustness of myoelectric pattern recognition for upper limb prostheses by covariate shift adaptation. IEEE Trans. Neural Syst. Rehabil. Eng. 24(9), 961–970 (2016).
[4]
Wu L, Zhang X, Wang K, Chen X, and Chen X Improved high-density myoelectric pattern recognition control against electrode shift using data augmentation and dilated convolutional neural network IEEE Trans. Neural Syst. Rehab. Eng. 2020 28 12 2637-2646
[5]
Yuan G, Liu X, Yan Q, Qiao S, Wang Z, and Yuan L Hand gesture recognition using deep feature fusion network based on wearable sensors IEEE Sens. J. 2021 21 1 539-547
[6]
Chen X et al. A wearable hand rehabilitation system with soft gloves IEEE Trans. Ind. Inf. 2021 17 2 943-952
[7]
Liang, X., Heidari, H., Dahiya, R.: Wearable capacitive-based wrist-worn gesture sensing system. In: 2017 New Generation of CAS (NGCAS), pp. 181–184. IEEE, Genova, Italy (2017).
[8]
Zhang Y, Liu B, and Liu Z Recognizing hand gestures with pressure-sensor-based motion sensing IEEE Trans. Biomed. Circuits Syst. 2019 13 6 1425-1436
[9]
Zheng E, Wang L, Wei K, and Wang Q A noncontact capacitive sensing system for recognizing locomotion modes of transtibial amputees IEEE Trans. Biomed. Eng. 2014 61 12 2911-2920
[10]
Zheng E, Mai J, Liu Y, and Wang Q Forearm motion recognition with noncontact capacitive sensing Front. Neurorobotics 2018 12 47
[11]
Zhu, Y., Jiang, S., Shull, P.B.: Wrist-worn hand gesture recognition based on barometric pressure sensing. In: 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 181–184. IEEE, Las Vegas, NV, USA (2018).
[12]
Jiang, W., Yin, Z.: Human activity recognition using wearable sensors by deep convolutional neural networks. In: ACM International Conference on Multimedia, pp. 1307–1310. Association for Computing Machinery, New York (2015).
Index Terms
- Flexible Non-contact Capacitive Sensing for Hand Gesture Recognition
Index terms have been assigned to the content through auto-classification.
Recommendations
Capacitive Sensing Based On-board Hand Gesture Recognition with TinyML
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable ComputersAlthough hand gesture recognition has been widely explored with sensing modalities like IMU, electromyography and camera, it is still a challenge of those modalities to provide a compact, power-efficient on-board inferencing solution. In this work, we ...
Capacitive Sensing 3D-printed Wristband for Enriched Hand Gesture Recognition
WearSys '17: Proceedings of the 2017 Workshop on Wearable Systems and ApplicationsIn this work, we design a wearable-form hand gesture recognition system using capacitive sensing technique. Our proposed system includes a 3D printed wristband, capacitive sensors arrays in a flexible circuit board, a low-cost micro-controller unit and ...
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human InteractionThe natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Oct 2021
833 pages
ISBN:978-3-030-89094-0
DOI:10.1007/978-3-030-89095-7
- Editors:
- Xin-Jun Liu,
- Zhenguo Nie,
- Jingjun Yu,
- Fugui Xie,
- Rui Song
© Springer Nature Switzerland AG 2021.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 22 October 2021
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 01 Jan 2025