Abstract
We present our work on emotionally expressive avatars, animated virtual characters that can express emotions via facial expressions. Because these avatars are highly distinctive and easily recognizable, they may be used in a range of applications. In the first part of the paper we present their use in computer mediated communication where two or more people meet in virtual space, each represented by an avatar. Study results suggest that social interaction behavior from the real-world is readily transferred to the virtual world. Empathy is identified as a key component for creating a more enjoyable experience and greater harmony between users. In the second part of the paper we discuss the use of avatars as an assistive, educational and therapeutic technology for people with autism. Based on the results of a preliminary study, we provide pointers regarding how people with autism may overcome some of the limitations that characterize their condition.
Chapter PDF
Similar content being viewed by others
Keywords
References
Aarons, M., Gittens, T.: Autism: A social skills approach for children and adolescents. Winslow Press, Oxford (1998)
Argyle, M.: Bodily Communication, 2nd edn. Methuen, New York (1988)
Bailenson, J., Blascovich, J.: Avatars. Encyclopedia of HCI. Berkshire, pp. 64–68 (2004)
Blascovich, J.: Social influence within immersive virtual environments. In: Schroeder, R. (ed.) The Social Life of Avatars. CSCW Series, pp. 127–145. Springer, London (2002)
Cheng, Y.: An avatar representation of emotion in collaborative virtual environment technology for people with autism. PhD thesis, Leeds Metropolitan University, UK (2005)
Cobb, S., Beardon, L., Eastgate, R., Glover, T., Kerr, S., Neale, H., Parsons, S., Benford, S., Hopkins, E., Mitchell, P., Reynard, G., Wilson, J.: Applied virtual environments to support learning of social interaction skills in users with Aspergers Syndrome. Digital Creativity 13(1), 11–22 (2002)
Cooper, B., Brna, P., Martins, A.: Effective Affective in Intelligent Systems – Building on Evidence of Empathy in Teaching and Learning. In: Paiva, A. (ed.) Affective Interactions. LNCS (LNAI), vol. 1814, pp. 21–34. Springer, London (2000)
Cowell, A., Stanney, K.: Manipulation of non-verbal interaction style and demographic embodiment to increase anthropomorphic computer character credibility. International Journal of Human-Computer Studies 62, 281–306 (2005)
Dautenhahn, K., Woods, S.: Possible Connections between bullying behaviour, empathy and imitation. In: Proceedings of Second International Symposium on Imitation in Animals and Artifacts, pp. 68–77, AISB Society (2003), ISBN 1-902956-30-7
Desmet, P.M.A.: Measuring emotion: development and application of an instrument to measure emotional responses to products. In: Blythe, M.A., Monk, A.F., Overbeeke, K., Wright, P.C. (eds.) Funology: from usability to enjoyment, pp. 111–123. Kluwer, Dordrecht (2003)
Edwards, A.: Extra-ordinary human-computer interaction. Cambridge University Press, New York (1995)
Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psych. Press (1978)
Fabri, M.: Emotionally expressive avatars for collaborative virtual environments. PhD Thesis, Leeds Metropolitan University, UK (2006)
Fabri, M., Moore, D., Hobbs, D.: Mediating the Expression of Emotion in Educational CVEs. International Journal of Virtual Reality 7(2), 66–81 (2004)
Frith, U.: Autism: Explaining the Enigma. Blackwell, Oxford (1989)
Garau, M., Slater, M., Pertaub, D., Razzaque, S.: The responses of people to virtual humans in an Immersive Virtual Environment. In: Presence, vol. 14(1), pp. 104–116. MIT Press, Cambridge (2005)
Garau, M.: The Impact of Avatar Fidelity on Social Interaction in Virtual Environments. PhD Thesis, University College London (2003)
George, P., McIlhagga, M.: The communication of meaningful emotional information for children interacting with virtual actors. In: Paiva, A.M. (ed.) Affective Interactions. LNCS (LNAI), vol. 1814, pp. 35–48. Springer, Berlin (2000)
Gepner, B., Deruelle, C., Grynfeltt, S.: Motion and emotion: A novel approach to the study of face processing by young autistic children. Journal of Autism and Developmental Disorders 31, 37–45 (2001)
Gerhard, M.: A Hybrid Avatar/Agent Model for Educational Collaborative Virtual Environments. PhD Thesis, Leeds Metropolitan University, UK (2003)
Gratch, J., Marsella, S.: Evaluating a computational model of emotion. Journal of Autonomous Agents and Multi-Agent Systems 11(1), 23–43 (2005)
Hassenzahl, M.: The effect of perceived hedonic quality on product appealingness. International Journal of Human-Computer Interaction 13(4), 481–499 (2001)
Hobbs, D.J., Moore, D.J.: Human computer interaction. FTK Publishing, London (1998)
Howlin, P., Baron-Cohen, S., Hadwin, J.: Teaching Children with Autism to Mind-Read: A Practical Guide for Teachers and Parents. John Wiley and Sons, New York (1999)
Jordan, P.W.: Designing Pleasurable Products. Taylor and Francis, London (2000)
Kendon, A.: Movement coordination in social interactions. Acta Psych 32(2), 101–125 (1970)
Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction, 3rd edn., Holt, Rinehart and Winston (1992)
LaFrance, M.: Posture Mirroring and Rapport. In: Davis, M. (ed.) Interaction Rhythms: Periodicity in Communicative Behavior, pp. 279–298 (1982)
Lessiter, J., Freeman, J., Keogh, E., Davidoff, J.D.: A Cross-Media Presence Questionnaire: The ITC Sense of Presence Inventory. In: Presence, vol. 10(3), MIT Press, Cambridge (2001)
McIlhagga, M., George, P.: Communicating Meaningful Emotional Information in a Virtual World. In: Paiva, A., Martinho, C. (eds.) Proceedings of International Workshop on Affect in Interactions, Siena, Italy, pp. 150–155 (1999)
Moore, D.J., Cheng, Y., McGrath, P., Powell, N.J.: CVE technology for people with autism. Focus on Autism and Other Developmental Disabilities 20(4), 231–243 (2005)
Nichols, S.: Virtual Reality Induced Symptoms and Effects (VRISE): Methodological and Theoretical Issues. PhD Thesis, University of Nottingham, UK (1999)
Ozonoff, S., Miller, J.: Teaching Theory of Mind. Journal of Autism and Developmental Disorders 25, 415–433 (1995)
Paiva, A., Dias, J., Sobral, D., Aylett, R., Sobreperez, P., Woods, S., Zoll, C., Hall, L.: Caring for Agents and Agents that Care. In: Proceedings of International Conference on Autonomous Agents and Multi-Agent System, New York, USA (2004)
Parsons, S., Mitchell, P., Leonard, A.: Do adolescents with autistic spectrum disorders adhere to social conventions in virtual environments? Autism 9, 95–117 (2005)
Parsons, S., Mitchell, P., Leonard, A.: The use and understanding of VE by adolescents with autistic spectrum disorders. J. of Autism and Developmental Disorders 34(4), 449–466 (2004)
Picard, R.: Affective Computing. MIT Press, Cambridge (1997)
Schroeder, R., Steed, A., Axelsson, A., Heldal, I., Abelin, A., Wideström, J., Nilsson, A., Slater, M.: Collaborating in Networked Immersive Spaces. Computers and Graphics 25(5), 781–788 (2001)
Slater, M.: Measuring Presence: A Response to the Witmer and Singer Presence Questionnaire. In: Presence, vol. 8(5), pp. 560–565. MIT Press, Cambridge (1999)
Wing, L.: The Autism Spectrum Constable, London (1996)
Witmer, B.G., Singer, M.J.: Measuring Presence in Virtual Environments: a Presence Questionnaire. In: Presence, vol. 7(3), pp. 225–240. MIT Press, Cambridge (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fabri, M., Elzouki, S.Y.A., Moore, D. (2007). Emotionally Expressive Avatars for Chatting, Learning and Therapeutic Intervention. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. HCI 2007. Lecture Notes in Computer Science, vol 4552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73110-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-73110-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73108-5
Online ISBN: 978-3-540-73110-8
eBook Packages: Computer ScienceComputer Science (R0)