Abstract
The recognition of hand gestures is still a challenging task in real-life scenarios, especially when the hardware is restricted to a cheap optical camera. The first step in such systems is to find at least one hand that can be tracked in order to identify postures or gestures. We propose a robust and real-time method that is able to reliably detect the hand in various environments to initialize hand-gesture communication. It is based on an innovative combination of different sources of information (colour, motion, trajectory) and a dynamic hand-wave gesture commencing hand tracking and hand gesture recognition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
During the hand-wave gesture, it can be assumed that the hand is presented with fingers pointing upwards.
- 2.
Keep in mind that the vector magnitudes are often close to zero for inner hand parts.
References
Premaratne, P.: Human Computer Interaction Using Hand Gestures. Springer, Singapore (2014). https://doi.org/10.1007/978-981-4585-69-9
Langmann, B., Hartmann, K., Loffeld, O.: Depth camera technology comparison and performance evaluation. In: Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods, pp. 438–444 (2012)
Triesch, J., von der Malsburg, C.: Robust classification of hand postures against complex background. In: Proceedings of 2nd International Conference on Automatic Face and Gesture Recognition, pp. 14–16, October 1996
Chen, F.-S., Fu, C.-M., Huang, C.-L.: Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis. Comput. 21(8), 745–758 (2003)
Mittal, A., Zisserman, A., Torr, P.H.: Hand detection using multiple proposals. In: BMVC, pp. 1–11 (2011)
Stergiopoulou, E., Sgouropoulos, K., Nikolaou, N., Papamarkos, N., Mitianoudis, N.: Real time hand detection in a complex background. Engin. Appl. Artif. Intell. 35, 54–70 (2014)
Deng, X., Zhang, Y., Yang, S., Tan, P., Chang, L., Yuan, Y., Wang, H.: Joint hand detection and rotation estimation using CNN. IEEE Trans. Image Process. 27(4), 1888–1900 (2018)
Bambach, S., Lee, S., Crandall, D.J., Yu, C.: Lending a hand: detecting hands and recognizing activities in complex egocentric interactions. In: IEEE International Conference on Computer Vision (ICCV), pp. 1949–1957, December 2015
Palacios, J.M., Sagüs, C., Montijano, E., Llorente, S.: Human-computer interaction based on hand gestures using RGB-D sensors. Sensors 13(9), 11842–11860 (2013)
Kawulok, M., Nalepa, J., Kawulok, J.: Skin detection and segmentation in color images. In: Celebi, M.E., Smolka, B. (eds.) Advances in Low-Level Color Image Processing. LNCVB, vol. 11, pp. 329–366. Springer, Dordrecht (2014). https://doi.org/10.1007/978-94-007-7584-8_11
Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)
Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: Bigun, J., Gustavsson, T. (eds.) SCIA 2003. LNCS, vol. 2749, pp. 363–370. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-45103-X_50
Kapur, J.N., Sahoo, P.K., Wong, A.K.: A new method for gray-level picture thresholding using the entropy of the histogram. Comput. Vis. Grap. Image Process. 29(3), 273–285 (1985)
Wang, B., Xu, J.: Accurate and fast hand-forearm segmentation algorithm based on silhouette. In: 2012 IEEE 2nd International Conference on Cloud Computing and Intelligent Systems (CCIS), vol. 2. IEEE (2012)
Chai, X., Fang, Y., Wang, K.: Robust hand gesture analysis and application in gallery browsing. In: IEEE International Conference on Multimedia and Expo, ICME 2009, pp. 938–941. IEEE (2009)
http://www1.hft-leipzig.de/strutz/Papers/RoHaDe-resources/. Accessed 13 June 2018
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Strutz, T., Leipnitz, A., Senkel, B. (2018). Robust Webcam-Based Hand Detection for Initialisation of Hand-Gesture Communication. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds) Interactive Collaborative Robotics. ICR 2018. Lecture Notes in Computer Science(), vol 11097. Springer, Cham. https://doi.org/10.1007/978-3-319-99582-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-99582-3_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99581-6
Online ISBN: 978-3-319-99582-3
eBook Packages: Computer ScienceComputer Science (R0)