Abstract
With the advent of smart devices and the massive use of smartphones, hand gesture recognition by mobile devices is being a major difficulty due to their technical specificities. To find a balance between speed and accuracy, we propose a new approach to recognize hand gestures by a smart device. This topic has some current interest and future applicability. In this paper, we present a new gesture detection framework for mobile devices based on LBP and SVM. LBP provides good texture representation properties. First, the proposed LBP on each non-overlapping blocks of a hand pose image is computed and a histogram of these LBPs is obtained. Those histograms are used as feature vectors for gesture classification as they demonstrate their robustness against compression and uniform intensity variations. The classification has been done by using Support Vector Machine (SVM). Since SVM is commonly used for pattern recognition, it is good for the explicit classification of form-dependent data, such as hand gestures. A recognition rate of approximately 93% is obtained based the enhanced NUS database I. In addition, the impact of using such a hand pose estimation task in an embedded device is studied. We conduct experiments on the speed of detection on different mobile devices. The impact of using SVM as a classifier for a gesture recognition task in an embedded device like smartphone is studied.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Manjoo, F: A Murky Road Ahead for Android, Despite Market Dominance. The New York Times. ISSN 0362-4331. Retrieved May 27 2015
Statcounter company web site. http://gs.statcounter.com/press/android-overtakes-windows-for-first-time. 3 April 2017
Cobârzan, C., Hudelist, M.A., Schoeffmann, K., Primus, M.J.: Mobile image analysis: Android vs. iOS. In: 21st International Conference on MultiMedia Modelling (MMM), pp. 99–110 (2015)
Seymour, M., Tšoeu, M.: A Mobile Application for South African Sign Language (SASL) recognition. In: IEEE Africon, pp 281–285 (2015)
Xie, C., Luan, S., Wang, H., Zhang, B.: Gesture recognition benchmark based on mobile phone. In: You, Z., Zhou, J., Wang, Y., Sun, Z., Shan, S., Zheng, W., Feng, J., Zhao, Q. (eds.) CCBR 2016. LNCS, vol. 9967, pp. 432–440. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46654-5_48
Lahiani, H., Elleuch, M., Kherallah, M.: Real time hand gesture recognition system for android devices. In: 15th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 592–597 (2015)
Lahiani, H., Elleuch, M., Kherallah, M.: Real time static hand gesture recognition system for mobile devices. J. Inf. Ass. Secur. 11, 067–076 (2016). ISSN: 1554-1010
Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on Viola-Jones algorithm for android devices. In: 13th ACS/IEEE International Conference on Computer Systems and Applications, (AICCSA) (2016)
Lahiani, H., Kherallah, M., Neji, M.: Vision based hand gesture recognition for mobile devices: a review. In: Abraham, A., Haqiq, A., Alimi, Adel M., Mezzour, G., Rokbani, N., Muda, A.K. (eds.) HIS 2016. AISC, vol. 552, pp. 308–318. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-52941-7_31
Lahiani, H., Neji, M.: Hand gesture recognition method based on HOG-LBP features for mobile devices. In: 22nd International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES), pp. 254–263 (2018)
Lahiani, H., Kherallah, M., Neji, M.: Hand gesture recognition system based on local binary pattern approach for mobile devices. In: 17th International Conference on Intelligent Systems Design and Applications (ISDA) 2017
Jin, C., Omar, Z., Jaward, M.H.: A mobile application of american sign language translation via image processing algorithms. In: 2016 IEEE Region 10 Symposium (TENSYMP), pp. 104–109 (2016)
Lahiani, H., Kherallah, M., Neji, M.: Hand pose estimation system based on a cascade approach for mobile devices. In: Abraham, A., Muhuri, Pranab Kr., Muda, A.K., Gandhi, N. (eds.) ISDA 2017. AISC, vol. 736, pp. 619–629. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-76348-4_60
Setiawardhana, R.Y. Hakkun, Baharuddin, A.: Sign language learning based on android for deaf and speech impaired people. In: 2015 International Electronics Symposium (IES) 2015, pp. 114–117 (2015)
Prasuhn, L., Oyamada, Y., Mochizuki, Y., Ishikawa, H.: A HOG-Based hand gesture recognition system on a mobile device. In: IEEE International Conference on Image Processing (ICIP), pp. 3973–3977 (2014)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Burges, J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 2, 121–167 (1998)
The NUS hand posture datasets I. https://www.ece.nus.edu.sg/stfpage/elepv/NUS-HandSet
Jamdaade, K., Khairmode, A., Kamble, S.: A comparative study between Android & iOS. Int. J. Curr. Trends Eng. Res. (IJCTER) 2(6), 495–501 (2016). e-ISSN 2455–1392
TimingLogger| Android Developers. https://developer.android.com/reference/android/util/TimingLogger.html
Logcat Command-line Tool. https://developer.android.com/studio/command-line/logcat.html
Lahiani, H., Neji, M.: Comparative study between hand pose estimation systems for mobile devices. J. Inf. Ass. Secur. 12, 218–226 (2017). ISSN: 1554-1010
Howse, J., Puttemans, S., Hua, Q., Sinha, U.: Object detection performance testing in “OpenCV 3 Blueprints”
Chandrashekar N.S., Nataraj, K.R.: NMS and Thresholding Architecture used for FPGA based Canny Edge Detector for Area Optimization. In: Proceedings of International Conference on Control, Communication and Power Engineering, pp 80-84 (2013)
Qifan, Y., Hao, T., Xuebing, Z, Yin, L., Sanfeng, Z.: Dolphin: ultrasonic-based gesture recognition on smartphone platform. In: IEEE 17th International Conference on Computational Science and Engineering, pp. 1461–1468 (2014)
Libsvm ported to Android jni environment. https://github.com/cnbuff410/Libsvm-androidjni
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Lahiani, H., Neji, M. (2019). Hand Gesture Recognition System Based on LBP and SVM for Mobile Devices. In: Nguyen, N., Chbeir, R., Exposito, E., Aniorté, P., Trawiński, B. (eds) Computational Collective Intelligence. ICCCI 2019. Lecture Notes in Computer Science(), vol 11683. Springer, Cham. https://doi.org/10.1007/978-3-030-28377-3_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-28377-3_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-28376-6
Online ISBN: 978-3-030-28377-3
eBook Packages: Computer ScienceComputer Science (R0)