Abstract
Nowadays, affective computing (AC), especially affective touch, plays a significant role in the next generation of human-computer, computer-computer and human-human communications. This is because it allows more senses in human communication to be included simultaneously and interactively, enabling innovative communications both between computers and humans, and between humans and humans. In this paper, we discuss applications and methodologies that researchers, including the author, have recently achieved by utilizing affective computing, affective touch, and extended reality (XR). Our purpose is to review our research work experience and other state-of-the-art results and propose a line of research to use these results in a future work or application. To begin with, we give an overview of extensive works using affective computing and emotion recognition systems for social media. After that, we explore some recent interesting research works about affective touch. Next, augmented reality (AR)-based applications using affective touch communication and affective computing are presented. Then, we review recent virtual reality-based systems using affective touch communication and affective computing. By understanding these approaches for extended reality-based applications with affective touch communication and affective computing presented recently by leading researchers, we believe that it will encourage sustainable advancements regarding human interactions in an integrated cross-disciplinary area.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Rudovic, O., Lee, J., Dai, M., Schuller, B., Picard, R.W.: Personalized machine learning for robot perception of affect and engagement in autism therapy. Sci. Robot. 3, eaao6760 (2018)
Kerdvibulvech, C.: An innovative real-time mobile augmented reality application in arts. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017, Part II. LNCS, vol. 10325, pp. 251–260. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60928-7_22
Wu, C.-H., Huang, Y.-M., Hwang, J.-P.: Review of affective computing in education/learning: trends and challenges. Br. J. Educ. Technol. (BJET) 47(6), 1304–1323 (2016)
Poria, S., Cambria, E., Bajpai, R., Hussain, A.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fusion 37, 98–125 (2017)
Politou, E.A., Alepis, E., Patsakis, C.: A survey on mobile affective computing. Comput. Sci. Rev. 25, 79–100 (2017)
Kratzwald, B., Ilic, S., Kraus, M., Feuerriegel, S., Prendinger, H.: Deep learning for affective computing: text-based emotion recognition in decision support. Decis. Support Syst. 115, 24–35 (2018)
Zhao, S., Yao, H., Gao, Y., Ding, G., Chua, T.-S.: Predicting personalized image emotion perceptions in social networks. IEEE Trans. Affect. Comput. 9(4), 526–540 (2018)
Dai, W., Han, D., Dai, Y., Xu, D.: Emotion recognition and affective computing on vocal social media. Inf. Manage. 52(7), 777–788 (2015)
Masson, H.L., Van De Plas, S., Daniels, N., de Beeck, H.P.O.: The multidimensional representational space of observed socio-affective touch experiences. NeuroImage 175, 297–314 (2018)
Heraz, A., Clynes, M.: Recognition of emotions conveyed by touch through force-sensitive screens: observational study of humans and machine learning techniques. J. Med. Internet Res. (JMIR) Ment. Health 5(3), e10104 (2018)
Kerdvibulvech, C.: A study of interactive digital multimedia applications. In: Ho, Y.-S., Sang, J., Ro, Y.M., Kim, J., Wu, F. (eds.) PCM 2015, Part I. LNCS, vol. 9314, pp. 192–199. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24075-6_19
Cabibihan, J.-J., Chauhan, S.S.: Physiological responses to affective tele-touch during induced emotional stimuli. IEEE Trans. Affect. Comput. 8(1), 108–118 (2017)
Roberts, J.: Using affective computing for proxemic interactions in mixed-reality. In: Proceedings of the Symposium on Spatial User Interaction (SUI), p. 176 (2018)
Datcu, D., Rothkrantz, L.: Affective computing and augmented reality for car driving simulators. In: Acta Polytechnica CTU Proceedings, vol. 12, pp. 13–23 (2017)
Kerdvibulvech, C.: A novel integrated system of visual communication and touch technology for people with disabilities. In: Gervasi, O., et al. (eds.) ICCSA 2016, Part II. LNCS, vol. 9787, pp. 509–518. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42108-7_39
Delazio, A., Nakagaki, K., Klatzky, R.L., Hudson, S.E., Lehman, J.F., Sample, A.P.: Force jacket: pneumatically-actuated jacket for embodied haptic experiences. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Montreal QC, Canada, 21–26 April 2018, Paper No. 320 (2018)
Ontiveros-Hernández, N.J., Pérez-Ramírez, M., Hernández, Y.: Virtual reality and affective computing for improving learning. Res. Comput. Sci. 65, 121–131 (2013)
Pérez-Ramírez, M., Ontiveros-Hernández, N.J., Ochoa-Ortíz, C.A., Hernández-Aguilar, J.A., Zayas-Pérez, B.E.: Intelligent tutoring systems based on virtual reality for the electrical domain. Res. Comput. Sci. 122, 163–174 (2016)
Rothkrantz, L.J.M.: An affective distant learning model using avatars as user stand-in. In: CompSysTech, pp. 288–295 (2017)
Ahmed, I., Harjunen, V., Jacucci, G., Hoggan, E.E., Ravaja, N., Spapé, M.M.A.: Reach out and touch me: effects of four distinct haptic technologies on affective touch in virtual reality. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction (ICMI 2016), pp. 341–348 (2017). LNCS, vol. 9961, pp. 23–37
Ahmed, I., Harjunen, V., Jacucci, G., Ravaja, N., Spapé, Michiel M.: Total immersion: designing for affective symbiosis in a virtual reality game with haptics, biosensors, and emotive agents. In: Gamberini, L., Spagnolli, A., Jacucci, G., Blankertz, B., Freeman, J. (eds.) Symbiotic 2016. LNCS, vol. 9961, pp. 23–37. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-57753-1_3
Cooney, M., Pashami, S., Sant’Anna, A., Fan, Y., Nowaczyk, S.: Pitfalls of Affective Computing: how can the automatic visual communication of emotions lead to harm, and what can be done to mitigate such risks. In: Companion Proceedings of the the Web Conference (WWW), Lyon, France, 23–27 April 2018, pp. 1563–1566 (2018)
González-Franco, M., Ofek, E., Hinckley, K.: The uncanny valley of haptics. Sci. Robot. 3(17) (2018)
Fitzsimmons, M.: Apple’s Tim Cook: AR has the ability to amplify human performance (2018). https://www.techradar.com/news/apples-tim-cook-ar-has-the-ability-to-amplify-human-performance. Accessed 1 Apr 2019
Kerdvibulvech, C.: Hand tracking by extending distance transform and hand model in real-time. Pattern Recognit. Image Anal. 25(3), 437–441 (2015)
Acknowledgments
This research presented herein was partially supported by a research grant from the Research Center, NIDA (National Institute of Development Administration).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Kerdvibulvech, C., Guan, SU. (2019). Affective Computing for Enhancing Affective Touch-Based Communication Through Extended Reality. In: Misra, S., et al. Computational Science and Its Applications – ICCSA 2019. ICCSA 2019. Lecture Notes in Computer Science(), vol 11620. Springer, Cham. https://doi.org/10.1007/978-3-030-24296-1_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-24296-1_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-24295-4
Online ISBN: 978-3-030-24296-1
eBook Packages: Computer ScienceComputer Science (R0)