Abstract
Facial expression recognition is one of the hot spots in recent years, it applies in the emotional analysis, pattern recognition and interpersonal interaction. This paper introduces the recent advances and applications in facial expression recognition from the face detection, feature extraction, classification, and the ethnic expression recognition. The methods of feature extraction are divided to several different characteristic categories. Researches of classifications are based on space or time and space. What’s more, according to the facial expression recognition history and achievements, the development of ethnic facial expression recognition and the trend of facial expression recognition are given.
This work was supported in part by 985 Funding Project (3rd Phase) of Minzu University of China (Grant 9850100300107), Independent Research Funding Project of Minzu University of China (Multisource information based Research on Ethnic Relationship) and Youth Funding Project of Minzu University of China (Anthropology based multimode Ethnic Facial Information Coding Research), Beijing Municipal Public Information Resources Monitoring Project (Grant 104-00102211).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Mehrabian, A.: Communication without words. Psychology Today 2(4), 53–56 (1968)
Darwin, C.: The Expression of the Emotions in Man and Animals, pp. 88–144. John Murray, London (1872)
Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. Journal of Personality and Social Psychology 17(2), 124–129 (1971)
Ekman, P., Friesen, W.V.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Mase, K., Pentland, A.: Recognition of facial expression from optical flow. IEICE Transaction E74(10), 3474–3483 (1991)
Jiang, B., Gu, K., Yang, G.: Research progress of Facial expression recognition. Computer Science 38(4), 25–31 (2011) (in Chinese)
Wang, Y.: Face Recognition Principles, methods and technology. Science Press, Beijing (2010) (in Chinese)
Gao, J.: Analysis and recognition of facial images. Computer Science 20(9), 782–790 (1997) (in Chinese)
Essa, I.A.: Coding, analysis, interpretation, and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 757–763 (1997)
Lanitis, A., Taylor, C., Cootes, T.F.: Automatic interpretation and coding of face images using flexible models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 743–756 (2002)
Liu, S., Wang, L.: The local Gabor wavelet facial expression recognition algorithm based on automatic segmentation. Computer Science, 3040-3043 (in Chinese)
Ma, X., Yang, G., Feng, F., Ying, W., Wang, J.: Face recognition based on Gabor wavelet and two dimension principal component analysis. Computer Applications, 55–57 (2006) (in Chinese)
Ye, J., Chan, Y.: Facial expression feature extraction based on Gabor wavelet transform. Computer Engineering, 172–174 (in Chinese)
James Lien, J.-J.: Automatic recognition of facial expressions using hidden markov models and estimation of expression Intensity. Doctoral dissertation, Robotics Institute, Carnegie Mellon University (April 1998)
Mase, K.: Recognition of facial expressions for optical flow. IEICE Transactions on Special Issue on Computer Vision and Its Applications E74(10), 3474–3483 (1991)
Otsuka, T., Ohya, J.: Spotting segments displaying facial expression from image sequences using HMM. In: Proceedings of the 3rdConference on Conference on Automatic, pp. 442–447. IEEE Computer Face and Gesture Interethnic Recognition Society, USA (1998)
Jin, H., Gao, W.: Motion and applications of facial expressions based on the flow characteristics. Journal of Software 14, 2098–2105 (2003) (in Chinese)
Yang, G.: Facial expression recognition based on optical flow algorithm and HMM. Micro Computer Information, 284–286 (2008) (in Chinese)
Choudhury, T.A.: Pentland Motion field histograms for robust modeling of facial expressions. In: Proceeding of the 15th ICIP, USA, vol. 2, pp. 929–932 (2000)
Shinohara, Y., Otsu, N.: Facial expression recognition using fisher weight maps. In: Proceedings of the Sixth IEEE Conference on Automatic Face and Gesture Recognition, pp. 499–504. IEEE Computer Society, USA (2004)
Zhu, Y., DeSilva, L.C., et al.: Using moment invariants and HMM in facial expression recognition. Pattern Recognition Letters 23(1-3), 83–91 (2002)
Mao, X., Xue, Y.: Human emotional interaction. Science Press (2011) (in Chinese)
Yeasin, M., Bullot, B., Sharma, R.: From facial expression to level of interest: a spatio-temporal approach. In: Proceedings of Interethnic Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 922–927. IEEE Computer Society, Washington, DC (2004)
Zhou, X., Xu, B., Wang, Y., Huang, X.: The real-time facial expression recognition based on Boost improved embedded hidden Markov model. Computer Science, 175–178, 190 (2005) (in Chinese)
Liu, X., Wang, D., Zhang, L.: Face Recognition based on singular value decomposition and Hidden Markov Model. Computer Science, 340–344 (2003) (in Chinese)
Tian, Y., Takeo, K., Cohn, J.F.: Recognizing Facial Actions by Combining Geometric Features and Regional Appearance Patterns. Carnegie Mellon University, Pittsburgh (2001)
Sebe, N., Cohen, I., Garg, A., et al.: Emotion recognition using a Cauchy naive Bayes classifier. In: Proceedings of the 16th Interethnic Conference on Pattern Recognition, vol. 1, pp. 17–20. IEEE Computer Society, Washington, DC (2002)
Shan, C., Gong, S., McOwan, P.: Dynamic facial expression recognition using a Bayesian temporal manifold manifold model. In: Proceedings of the 17th British Machine Vision Conference, pp. 84–89. The British Machine Vision Association, Edinburgh (2006)
Cohen, I., Sebe, N., et al.: Facial expression recognition from video sequences; temporal and static modeling. Computer Vision and Image Understanding, 160–187 (2003)
Osuna, E., Freund, R.: Training Support Vector Machines: an Application to Face Detection. In: Proc. of Computer Vision and Pattern Recognition, pp. 130–136. IEEE Computer Society, San Juan (1997)
Ma, Y., Ding, X.-Q.: Face detection based on hierarchical support vector machine. Tsinghua University (Natural Science Edition) 43(1), 35–3810 (2003) (in Chinese)
Wang, Y., Ai, H., Huang, C., Wu, B.: Real-time facial expression classification, Computer-Aided Design and Computer Graphics, 1296–1300 (2005) (in Chinese)
Guo, G.D., Dyer, C.R.: Simultaneous feature selection and classifier training via linear programming:a case study for facial expression recognition. In: Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 346–352 (2003)
Chen, S., Deng, G.: Differences of facial morphology-landmarks of 15 Chinese minority ethnicities. Chinese Journal of Forensic Medicine (1999) (in Chinese)
Li, P.F., Zhang, M.-H.: Cluster analysis of eight ethnic groups’ face observed features in Northwest Yunnan. Fudan University (Natural Science) 05 (2001) (in Chinese)
Duan, X., Wang, R., Liu, H., Shi, S.: Research on Facial Features of Ethnic Minorities Based on Face Recognition. The Proceedings of Dalian Minzu University 11 (2009) (in Chinese)
Duan, X., Wang, R., Liu, X.: Minorities Features Extraction and Recognition of Human Faces. Computer Science 08 (2010) (in Chinese)
Shakhnarov, G., Viola, P., Moghaddam, B.: A unified learning frmnework for real tine face detection and classification. In: Proceedings of the Fifth Intemational Conference on Automatic Face and Gesture Recognition, pp. 16–23 (2002)
Lu, X., Jain, A.K.: Ethnicity identification from face images. Bull. Inst. Math. Acad. Sinica (33), 77–87 (2005)
Hosoi, S., Takikawa, E., Kawade, M.: Ethnicity estimation with facial images. In: Proceedings of the Sixth IEEE Interethnic Conference on Automatic Face and Gesture Recognition, vol. 110, pp. 10–16 (2004)
Zhu, M.: Study on facial expression recognition based on manifold learning. Central South University; Doctoral Thesis (2009) (in Chinese)
Ekman, P.: MicroExpression Training Tool (METT) (retrieved April 15, 2002)
Yin, L.J., Wei, X.Z., Sun, Y., et al.: A 3D facial expression database for facial behavior research. In: Proceedings of 7th International Conference on Automatic Face and Gesture Recognition, Southampton, pp. 211–216 (2006)
Lu, X.G., Jain, A.K., Colbry, D.: Matching 2.5D face scans to 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(1), 31–43 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wu, T., Fu, S., Yang, G. (2012). Survey of the Facial Expression Recognition Research. In: Zhang, H., Hussain, A., Liu, D., Wang, Z. (eds) Advances in Brain Inspired Cognitive Systems. BICS 2012. Lecture Notes in Computer Science(), vol 7366. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31561-9_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-31561-9_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31560-2
Online ISBN: 978-3-642-31561-9
eBook Packages: Computer ScienceComputer Science (R0)