Abstract
In recent years, the learning style of modern distance education has been more and more popular among the learners. However, the learner’s emotion is often ignored during the distance education learning process. In this paper, the study purpose is mainly concerned with how to effectively recognize the emotion through the way of using facial expression for the future distance education learning. We apply the method of Convolutional Neural Network (CNN) in our research. First, we introduce the structure of CNN in terms of the convolutional layers, sub-sampling layers and fully connected layers. Secondly, we propose a framework to use CNN in distance education system. Thirdly, we carry out experiment on a data set that consists of facial expression images of learners to evaluate the performance of proposed method. Finally, we get the conclusion the average accuracy of CNN to recognize the facial expression is 93.63%. The high accuracy shows the application of CNN to recognize facial expression is valuable and helpful for the teachers in the future distance education system to attain and understand the learners’ emotion state in real time, accordingly to regulate the teaching strategy in time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
O’Regan, K.: Emotion and e-learning. J. Asynchronous Learn. Netw. 7(3), 78–92 (2003)
Mehrabian, A.: Communication without words. Psychol. Today 2(4), 53–56 (1968)
Moridis, C.N., Economides, A.A.: Affective learning: empathetic agents with emotional facial and tone of voice expressions. IEEE Trans. Affect. Comput. 3(3), 260–272 (2012)
Brodny, G., Kołakowska, A., Landowska, A., Szwoch, M., Szwoch, W., Wróbel, M.R.: Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions. In: IEEE International Conference on Human System Interactions, pp. 397–404 (2016)
Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: IEEE Computer Vision and Pattern Recognition Workshops, vol. 36, pp. 94–101 (2010)
Salmam, F.Z., Madani, A., Kissi, M.: Facial expression recognition using decision trees. In: IEEE International Conference on Computer Graphics, Imaging and Visualization, pp. 125–130 (2016)
Lee, S.H., Kostas, P.K.N., Yong, M.R.: Intra-class variation reduction using training expression images for sparse representation based facial expression recognition. IEEE Trans. Affect. Comput. 5(3), 340–351 (2014)
Dahl, G.E., Yu, D., Deng, L., Acero, A.: Context-dependent pre-trained deep neural net-works for large-vocabulary speech recognition. IEEE Trans. Audio Speech Lang. Process. 20(1), 30–42 (2012)
Devlin, J., Zbib, R., Huang, Z., Lamar, T., Schwartz, R.M., Makhoul, J.: Fast and robust neural network joint models for statistical machine translation. ACL 1, 1370–1380 (2014)
Sun, Y., Liang, D., Wang, X., Tang, X.: DeepID3: face recognition with very deep neural networks. arXiv preprint arXiv:1502.00873 (2015)
Ekman, P., Rolls, E.T., Perrett, D.I., Ellis, H.D.: Facial expressions of emotion: an old controversy and new findings. Philos. Trans. R. Soc. B: Biolog. Sci. 335(1273), 63–69 (1992)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)
Fan, X., Zhang, F., Wang, H., Lu, X.: The system of face detection based on OpenCV. In: Chinese Control and Decision Conference, pp. 648–651 (2012)
Zhang, Z.Y., Lyons, M., Schuster, M., Akamatsu, S.: Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron. In: IEEE International Conference on Automatic Face and Gesture Recognition, pp. 454–459 (1998)
Shan C.F., Gong S.G., McOwan P.W.: Robust facial expression recognition using local binary patterns. In: IEEE International Conference on Image Processing, pp. 370–373 (2005)
Lv, Y., Feng, Z., Xu, C.: Facial expression recognition via deep learning. In: IEEE International Conference on Smart Computing (SMARTCOMP), pp. 303–308 (2014)
Lopes, A.T., de Aguiar, E., De Souza, A.F., Oliveira-Santos, T.: Facial expression recognition with Convolutional Neural Networks: coping with few data and the training sample order. Pattern Recognit. 61, 610–628 (2017)
Ortigosa, A., Martín, J.M., Carro, R.M.: Sentiment analysis in Facebook and its application to e-learning. Comput. Hum. Behav. 31, 527–541 (2014)
Sun, J.M., Pei, X.S., Zhou, S.S.: Facial emotion recognition in modern distant education system using SVM. In: IEEE International Conference on Machine Learning and Cybernetics, vol. 6, pp. 3545–3548 (2008)
Ashwin, T.S., Jose, J., Raghu, G., Reddy, G.R.M.: An e-learning system with multifacial emotion recognition using supervised machine learning. In: IEEE International Conference on Technology for Education, pp. 23–26 (2015)
Wang, F., Liu, Z.L., Lv, S.L., Lv, Y.P., Wu, G.B., Peng, P., Chen, F., Wang, X.F.: A natural visible and infrared facial expression database for expression recognition and emotion inference. IEEE Trans. Multimedia 12(7), 682–691 (2010)
Lv, Y., Wang, S., Shen, P.: A real-time attitude recognition by eye-tracking. In: Proceedings of International Conference on Internet Multimedia Computing and Service, pp. 170–173 (2011)
Tong, Y., Wang, Y., Zhu, Z.W., Ji, Q.: Robust facial feature tracking under varying face pose and facial expression. Pattern Recogn. 40(11), 3195–3208 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Sun, A., Li, Y., Huang, YM., Li, Q. (2018). The Exploration of Facial Expression Recognition in Distance Education Learning System. In: Wu, TT., Huang, YM., Shadiev, R., Lin, L., Starčič, A. (eds) Innovative Technologies and Learning. ICITL 2018. Lecture Notes in Computer Science(), vol 11003. Springer, Cham. https://doi.org/10.1007/978-3-319-99737-7_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-99737-7_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99736-0
Online ISBN: 978-3-319-99737-7
eBook Packages: Computer ScienceComputer Science (R0)