A Real-time Device-free Head Motion Recognition Framework for Family Care Robots
Authors: 
Xiaoyu Wang, Tao WangAuthors Info & Claims
Pages 212 - 219
Abstract
In this paper, we propose a practical framework to realize accurate, real-time head motion recognition without wearing a device on user's head, which is essential for interaction between human and family care robot system. Most of the previous work has focused on the estimation of head poses rather than the identification of specific head motions, which are more useful in human-robot interaction. Based on the results of the head pose estimation, we define eight head motions which contain most of the head movements we use in daily life and design a finite state machine(FSM) to identify these motions. Our framework shows excellent accuracy and low latency in real-world test. Besides, we set a group of thresholds that can be easily changed for the duration and intensity of different motion definition, so that it can be adjusted according to the needs in future applications. This framework is robust with great potential for domestic caring in an ageless aging society.
References
[1]
Adrian Bulat and Georgios Tzimiropoulos. 2017. How Far are We from Solving the 2D & 3D Face Alignment Problem? (and a Dataset of 230,000 3D Facial Landmarks). (2017).
[2]
T.F. Cootes, Chris Taylor, D.H. Cooper, and Jim Graham. 1995. Active Shape Models-Their Training and Application. Computer Vision and Image Understanding 61 (01 1995), 38âĂrŞ59. https://doi.org/10.1006/cviu.1995.1004
[3]
Piotr DollÃąr, Peter Welinder, and Pietro Perona. 2010. Cascaded Pose Regression. Proceedings / CVPR, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (06 2010). https://doi.org/10.1109/CVPR.2010.5540094
[4]
Kazutoshi Hida, Shunsuke Yano, Izumi Koyanagi, Minoru Akino, Toshitaka Seki, and Yoshinobu Iwasaki. 2008. Surgical Treatment of Cervical Spondylosis in the Elderly: Surgical Outcomes, Risk Factors, and Complications. Neurologia medico-chirurgica 48 (10 2008), 377--82; discussion 382. https://doi.org/10.2176/nmc.48.377
[5]
Jeffrey Huang, Xuhui Shao, and Harry Wechsler. 1998. Face pose discrimination using support vector machines (SVM). In International Conference on Pattern Recognition.
[6]
Vahid Kazemi and Josephine Sullivan. 2014. One Millisecond Face Alignment with an Ensemble of Regression Trees. https://doi.org/10.13140/2.1.1212.2243
[7]
Amit Kumar, Azadeh Alavi, and Rama Chellappa. 2017. KEPLER: Keypoint and Pose Estimation of Unconstrained Faces by Learning Efficient H-CNN Regressors. In IEEE International Conference on Automatic Face & Gesture Recognition.
[8]
Donghoon Lee, Hyunsin Park, and Chang Yoo. 2015. Face alignment using cascade Gaussian process regression trees. 4204--4212. https://doi.org/10.1109/CVPR.2015.7299048
[9]
Lin Liang, Rong Xiao, Fang Wen, and Jian Sun. 2008. Face Alignment Via Component-Based Discriminative Search. Proc. of European Conf. on Computer Vision, 72--85. https://doi.org/10.1007/978-3-540-88688-4_6
[10]
Sujitha Martin, Cuong Tran, Ashish Tawari, Jade Kwan, and Mohan Trivedi. 2012. Optical flow based head movement and gesture analysis in automotive environment. Conference Record - IEEE Conference on Intelligent Transportation Systems, 882--887. https://doi.org/10.1109/ITSC.2012.6338909
[11]
Sharma Mohit, Dragan Ahmetovic, A LÃąszlÃş, Kris Jeni, and Kris Kitani. 2018. Recognizing Visual Signatures of Spontaneous Head Gestures. https://doi.org/10.1109/WACV.2018.00050
[12]
Nina Rudigkeit, Marion Gebhard, and Axel Graeser. 2015. An Analytical Approach for Head Gesture Recognition with Motion Sensors. https://doi.org/10.1109/ICSensT.2015.7933064
[13]
Nataniel Ruiz, Eunji Chong, and James Rehg. 2018. Fine-Grained Head Pose Estimation Without Keypoints. 2155--215509. https://doi.org/10.1109/CVPRW.2018.00281
[14]
Nataniel Ruiz and James Rehg. 2017. Dockerface: an easy to install and use Faster R-CNN face detector in a Docker container. (08 2017).
[15]
Yen-Yu Lin Yung-Yu Chuang Tsun-Yi Yang, Yi-Ting Chen. 2019. FSA-Net: Learning Fine-Grained Structure Aggregation for Head Pose Estimation from a Single Image. (2019).
[16]
Y Wu, K Akiyama, K Kitani, L Jeni, and Y Mukaigawa. 2016. Head gesture recognition in spontaneous human conversa- tions: A benchmark. (2016).
[17]
Sun Yi, Xiaogang Wang, and Xiaoou Tang. 2013. Deep Convolutional Network Cascade for Facial Point Detection. In IEEE Conference on Computer Vision & Pattern Recognition.
[18]
Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. 2016. Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks. IEEE Signal Processing Letters 23 (04 2016). https://doi.org/10.1109/LSP.2016.2603342
[19]
Zhenqiu Zhang, Yuxiao Hu, Liu Ming, and Thomas Huang. 2006. Head Pose Estimation in Seminar Room Using Multi View Face Detectors. In International Evaluation Conference on Classification of Events.
[20]
Jingbo Zhao and Robert Allison. 2017. Real-time head gesture recognition on head-mounted displays using cascaded hidden Markov models. https://doi.org/10.1109/SMC.2017.8122975
Index Terms
- A Real-time Device-free Head Motion Recognition Framework for Family Care Robots
Recommendations
Device-free gesture tracking using acoustic signals
MobiCom '16: Proceedings of the 22nd Annual International Conference on Mobile Computing and NetworkingDevice-free gesture tracking is an enabling HCI mechanism for small wearable devices because fingers are too big to control the GUI elements on such small screens, and it is also an important HCI mechanism for medium-to-large size mobile devices because ...
Low-latency combined eye and head tracking system for teleoperating a robotic head in real-time
ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & ApplicationsWe have developed a low-latency combined eye and head tracker suitable for teleoperating a remote robotic head in real-time. Eye and head movements of a human (wizard) are tracked and replicated by the robot with a latency of 16.5 ms. The tracking is ...
A real-time head nod and shake detector
PUI '01: Proceedings of the 2001 workshop on Perceptive user interfacesHead nods and head shakes are non-verbal gestures used often to communicate intent, emotion and to perform conversational functions. We describe a vision-based system that detects head nods and head shakes in real time and can act as a useful and basic ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2019
246 pages
ISBN:9781450376402
DOI:10.1145/3371238
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 October 2019
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICCSE'19
ICCSE'19: The 4th International Conference on Crowd Science and Engineering
October 18 - 21, 2019
Jinan, China
Acceptance Rates
ICCSE'19 Paper Acceptance Rate 35 of 92 submissions, 38%;
Overall Acceptance Rate 92 of 247 submissions, 37%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 80Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)2
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in