Abstract
In recent facial expression recognition competitions, top approaches were using either geometric relationships that best captured facial dynamics or an accurate registration technique to develop texture features. These two methods capture two different types of facial information that is similar to how the human visual system divides information when perceiving faces. This paper discusses a framework of a fully automated comprehensive facial expression detection and classification. We study the capture of facial expressions through geometric and texture-based features, and demonstrate that a simple concatenation of these features can lead to significant improvement in facial expression classification. Each type of expression has individual differences in the commonality of facial expression features due to differences in appearance and other factors. The geometric feature tends to emphasize the facial parts that are changed from the neutral and peak expressions, which can represent the common features of the expression, thus reducing the influence of the difference in appearance and effectively eliminating the individual differences. Meanwhile, the consolidation of gradient-level normalized cross correlation and Gabor wavelet is utilized to present the texture features. We perform experiments using the well-known extended Cohn-Kanade (CK+) database, compared to the other state of the art algorithms, the proposed method achieved provide better performance with an average accuracy of 95.3%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Deepthi, S., Archana, G.S., JagathyRaj, V.P.: Facial expression recognition using artificial neural networks. OSR J. Comput. Eng. (IOSR-JCE) 8(4), 01–06 (2013). ISSN 2278–0661, ISBN2278-8727
Punitha, A., Geetha, M.K.: HMM based real time facial expression recognition. Int. J. Emerg. Technol. Adv. Eng. 3(1), 180–185 (2013)
Zhang, B., Liu, G.: Facial expression recognition using LBP and LPQ based on Gabor wavelet transform based on Gabor face image. In: IEEE International Conference on Computer and Communications (2016)
Owusu, E., Zhan, Y., Mao, Q.R.: An SVM-AdaBoost facial expression recognition system. Appl. Intell. 40(3), 536–545 (2014)
Shah, S.K., Khanna, V.: Facial expression recognition for color images using Gabor, log Gabor filters and PCA. Int. J. Comput. Appl. 113(4), 42–46 (2015)
Lajevardi, S.M., Hussain, Z.M.: Feature extraction for facial expression recognition based on hybrid face regions. Adv. Electr. Comput. Eng. 9(3), 63–67 (2009)
ELLaban, H.A., Ewees, A.A., Elsaeed, A.E.: A real-time system for facial expression recognition using support vector machines and k-nearest neighbor classifier. Int. J. Comput. Appl. 159(8), 0975–8887 (2017)
Lee, J.J, Uddin, M.Z., Kim, T.S.: Spatiotemporal human facial expression recognition using fisher independent component analysis and hidden markov model. In: 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2008, pp 2546–2549. IEEE (2008)
Sumathi, C.P., Santhanam, T., Mahadevi, M.: Automatic facial expression analysis a survey. IEEE Int. J. Comput. Sci. Eng. Surv. 3(6), 47 (2012)
Shojaeilangari, S., Yau, W.Y., Nandakumar, K., Li, J., Teoh, E.K.: Robust representation and recognition of facial emotions using extreme sparse learning. IEEE Trans. Image Process. 24, 2140–2152 (2015)
Littlewort, G., et al.: The computer expression recognition toolbox (CERT). In: IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) (2011). https://doi.org/10.1109/fg.2011.5771414
Razuri, J.G., Sundgren, D., Rahmani, R., Cardenas, A.M.: Automatic emotion recognition through facial expression analysis in merged images based on an artificial neural network. In: 12th Mexican International Conference on Artificial Intelligence, pp. 85–96 (2013). https://doi.org/10.1109/micai.2013.16
Kar, A., Mukerjee, A.: Facial expression classification using visual cues and language. In: IIT (2011). http://www.cs.berkeley.edu/*akar/se367/project/report.pdf
Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001. IEEE (2001)
Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)
Milborrow, S., Nicolls, F.: Locating facial features with an extended active shape model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88693-8_37
Milborrow, S., Nicolls, F.: Active shape models with SIFT descriptors and MARS. In: Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), vol. 2, pp. 380–387 (2014)
Li, L., Leung, M.K.H.: Integrating intensity and texture differences for robust change detection. IEEE Trans. Image Process. 2002, 105–112 (2002)
Faisal, A., Emam, H.: Automated facial expression recognition using gradient-based ternary texture patterns. Chin. J. Eng. 2013, 8 (2013). Article ID 831747
Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Trans. Pattern Anal. Mach. Intell. 21(10), 974–989 (1999)
Liu, C., Wechsler, H.: Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans. Image Process. 11(4), 467–476 (2002)
Zhu, J.X., Su, G.D., Li, Y.E.: Facial expression recognition based on Gabor feature and Adaboost. J. Optoelectron. Laser 17, 993–998 (2006)
Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs fisherfaces: recognition using class specific linear projection. IEEE. Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 27(2), 1–27 (2011)
Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete facial expression dataset for action unit and emotion-specified expression. In: Proceedings 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 94–101 (2010)
Acknowledgments
This work was supported by the Scientific Research Fund of Sichuan Provincial Education Department under Grant No. 18ZB0013, the Science and Technology Project of Dujiangyan under Grant No. 2018FW01.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Gong, Y., Yuan, Y. (2020). Facial Expression Recognition Adopting Combined Geometric and Texture-Based Features. In: Li, K., Li, W., Wang, H., Liu, Y. (eds) Artificial Intelligence Algorithms and Applications. ISICA 2019. Communications in Computer and Information Science, vol 1205. Springer, Singapore. https://doi.org/10.1007/978-981-15-5577-0_36
Download citation
DOI: https://doi.org/10.1007/978-981-15-5577-0_36
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-5576-3
Online ISBN: 978-981-15-5577-0
eBook Packages: Computer ScienceComputer Science (R0)