[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content

Intelligent Virtual Humans with Autonomy and Personality: State-of-the-Art

  • Chapter
New Advances in Virtual Humans

Part of the book series: Studies in Computational Intelligence ((SCI,volume 140))

Abstract

Intelligent virtual characters has been subject to exponential growth in the last decades and they are utilized in many applications areas such as education, training, human-computer interfaces and entertainment. In this paper, we present a state-of-the-art of virtual human mentioning about the use of intelligent decision technologies in order to build virtual human architectures. We consider various aspects such as autonomy, interaction, personification and presence. Each of these aspects comes to prominence in different applications although there is no slight distinction. This survey provides a novel insight to the current state of designing and modeling virtual humans using different decision technologies and can be used as a basis for several future directions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 103.50
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 129.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
GBP 129.99
Price includes VAT (United Kingdom)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Wikipedia-action-selection (2006), http://en.wikipedia.org/wiki/Actionselection

  2. Egges, A., Magnenat-Thalmann, N.: Emotional communicative body animation for multiple characters. In: V-Crowds 2005, Lausanne, Switzerland, pp. 31–40 (2005)

    Google Scholar 

  3. Monzani, J., Caicedo, A., Thalmann, D.: Integrating behavioural animation techniques. Computer Graphics Forum 20(3) (2001)

    Google Scholar 

  4. Romano, D., Sheppard, G., Hall, J., Miller, A., Ma, Z.: Basic: a believable, adaptable socially intelligent character for social presence. In: PRESENCE 2005, The 8th Annual International Workshop on Presence (2005)

    Google Scholar 

  5. Magnenat-Thalmann, N., Egges, A., Molet, T.: Personalised real-time idle motion synthesis. In: Pacific Graphics 2004, Seoul, Korea, pp. 121–130 (2004)

    Google Scholar 

  6. Bianchi-Berthouze, N., Kleinsmith, A., Fushimi, T.: An incremental and interactive affective posture recognition system. In: International Workshop on Adapting the Interaction Style to Affective Factors (2005)

    Google Scholar 

  7. Collins, A., Ortony, A., Clore, G.L.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)

    Google Scholar 

  8. Sobral, D., Paiva, A., Dias, J., Aylett, R.: Caring for agents and agents that care: building empathic relations with synthetic agents. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems (2004)

    Google Scholar 

  9. Zambetta, F., Paradiso, A., Abbattista, F.: Fanky: A tool for animating faces of 3d agents. In: de Antonio, A., Aylett, R.S., Ballin, D. (eds.) IVA 2001. LNCS (LNAI), vol. 2190, pp. 242–244. Springer, Heidelberg (2001)

    Google Scholar 

  10. Wyvill, G., Pearce, A., Wyvill, B., Hill, D.: Speech and expression: A computer solution to face animation. In: Graphics Interface 1986, pp. 136–140 (1986)

    Google Scholar 

  11. Karpouzis, K., Raouzaiou, A., Kollias, S.: Emotion synthesis in virtual environments. In: 6th International Conference on Enterprise Information Systems (2004)

    Google Scholar 

  12. Webpage AIML (September 2006), http://www.alicebot.org

  13. Bindiganavale, R., Schuler, W., Allbeck, J.M., Badler, N.I., Joshi, A.K., Palmer, M.: Dynamically altering agent behaviors using natural language instructions. In: Proceedings of the fourth international conference on Autonomous agents, pp. 293–300 (2000)

    Google Scholar 

  14. Volino, P., Davy, P., Bonanni, U., Magnenat-Thalmann, N., Böttcher, G., Allerkamp, D., Wolter, F.-E.: From measured physical parameters to the haptic feeling of fabric. In: Proceedings of the HAPTEX 2005 Workshop on Haptic and Tactile Perception of Deformable Objects, pp. 17–29 (2005)

    Google Scholar 

  15. Arafa, Y., Kamyab, K., Mamdani, E.: Character animation scripting languages: a comparison. In: AAMAS 2003: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 920–921 (2003)

    Google Scholar 

  16. Arbantes, G., Pereira, F.: Mpeg-4 facial animation technology: Survey, implementation, and results. IEEE Transactions on Circuits and Systems for Video Technology 9(2), 290–305 (1999)

    Article  Google Scholar 

  17. Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)

    Google Scholar 

  18. Ogi, T., Kayahara, T., Kato, M., Asayama, H., Hirose, M.: Immersive sound field simulation in multi-screen projection displays. In: Proceedings of the workshop on Virtual environments, pp. 135–142 (2003)

    Google Scholar 

  19. Churcher, G.E., Atwell, E.S., Souter, C.: Dialogue management systems: A survey and overview. Technical report, University of Leeds (1997)

    Google Scholar 

  20. Aylett, R., Luck, M.: Applying artificial intelligence to virtual reality: Intelligent virtual environments. Applied Artificial Intelligence 14(1), 3–32 (2000)

    Article  Google Scholar 

  21. Pelachaud, C., Hartmann, B., Mancini, M.: Implementing Expressive Gesture Synthesis for Embodied Conversational Agents. In: Gesture Workshop. LNCS (LNAI), pp. 188–199. Springer, Heidelberg (2005)

    Google Scholar 

  22. Lee, S.P., Badler, J.B., Badler, N.I.: Eyes alive. ACM Transactions on Graphics 21(3), 637–644 (2002)

    Google Scholar 

  23. Bartneck, C.: Integrating the occ model of emotions in embodied characters. In: Proceedings of the Workshop on Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges, Melbourne (2002)

    Google Scholar 

  24. Baxter, W., Scheib, V., Lin, M., Manocha, D.: Dab: Interactive haptic painting with 3d virtual brushes. In: Proceedings of ACM Siggraph, pp. 461–468 (2001)

    Google Scholar 

  25. Begault, D.: 3-D Sound for Virtual Reality and Multimedia. Academic Press, Cambridge (1994)

    Google Scholar 

  26. Bergamasco, M.: Manipulation and exploration of virtual objects. In: Magnenat Thalmann, N., Thalmann, D. (eds.) Artificial Life and Virtual Reality. John Wiley, Chichester (1994)

    Google Scholar 

  27. Bickmore, T., Cassell, J.: Social dialogue with embodied conversational agents. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N. (eds.) Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems. Kluwer Academic, New York (2005)

    Google Scholar 

  28. Biocca, F.: The cyborg’s dilemma: Progressive embodiment in virtual environments. Journal of Computer-Mediated Communication (1997)

    Google Scholar 

  29. Taylor, P., Black, A., Caley, R.: The architecture of the festival speech synthesis system. In: 3rd ESCA Workshop on Speech Synthesis, Australia, pp. 147–151 (1998)

    Google Scholar 

  30. Ardissono, L., Boella, G., Lesmo, L.: An agent architecture for nl dialogmodeling. In: Proc. Second Workshop on Human-Computer Conversation (1998)

    Google Scholar 

  31. Bolt, R.A.: Put-that-there: Voice and gesture at the graphics interface. In: Proceedings of SIGGRAPH, pp. 262–270 (1980)

    Google Scholar 

  32. Bordeux, C., Boulic, R., Thalmann, D.: An efficient and flexible perception pipeline for autonomous agents. In: Computer Graphics Forum (Eurographics 1999), vol. 18(3), pp. 23–30 (1999)

    Google Scholar 

  33. Bos, J., Oka, T.: Building spoken dialogue systems for believable characters. In: Proceedings of the seventh workshop on the semantics and pragmatics of dialogue, Diabruck (2003)

    Google Scholar 

  34. Brand, M.: Voice puppetry. In: Proceedings of SIGGRAPH 1999, pp. 21–28 (1999)

    Google Scholar 

  35. Brand, M., Hertzmann, A.: Style machines. In: SIGGRAPH 2000, pp. 399–407. ACM Press, New York (2000)

    Google Scholar 

  36. Bratman, N.: Intention, plans, and practical reason. Harvard University Press, Cambridge (1987)

    Google Scholar 

  37. Sadek, M.D., Bretier, P., Panaget, F.: Artimis: Natural dialogue meets rational agency. In: Pollack, M.E. (ed.) Proceedings 15th International Joint Conference on Artificial Intelligence, pp. 1030–1035 (1997)

    Google Scholar 

  38. Brooks, R.A.: How to build complete creatures rather than isolated cognitive simulators. In: VanLehn, K. (ed.) Architectures for Intelligence, pp. 225–239. Lawrence Erlbaum Assosiates, Mahwah (2001)

    Google Scholar 

  39. Lombard, M., Reich, R.D., Grabe, M.E., Bracken, C., Ditton, T.B.: Presence and television: The role of screen size. Human Communication Research 26(1), 75–98 (2000)

    Google Scholar 

  40. Cañamero, L.: Emotions for activity selection. Dept. of Computer Science Technical Report DAIMI PB 545, University of Aarhus, Denmark (2000)

    Google Scholar 

  41. Canamero, D.: Designing emotions for activity selection. Department of Computer Science, University of Aarhus (2000)

    Google Scholar 

  42. Gratch, J., Rickel, J., Andre, E., Badler, N., Cassell, J., Petajan, E.: Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems 17(4), 54–63 (2002)

    Article  Google Scholar 

  43. Chang, P.H.-M., Chien, Y.-H., Kao, E.C.-C., Soo, V.-W.: A knowledge-based scenario framework to support intelligent planning characters. LNCS, pp. 134–145. Springer, Heidelberg (2005)

    Google Scholar 

  44. Chopra-Khullar, S., Badler, N.I.: Where to look? automating attending behaviors of virtual human characters. In: AGENTS 1999: Proceedings of the third annual conference on Autonomous Agents, pp. 16–23 (1999)

    Google Scholar 

  45. Chibelushi, F.B.C.C.: Facial expression recognition: A brief tutorial overview. School of Computing, Staffordshire University (2002)

    Google Scholar 

  46. Cohen, M., Massaro, D.: Modelling coarticulation in synthetic visual speech. In: Thalmann, N.M., Thalmann, D. (eds.) Models and Techniques in Computer Animation, pp. 139–156 (1993)

    Google Scholar 

  47. Cornelius, R.: The science of emotion. Prentice Hall, New Jersey (1996)

    Google Scholar 

  48. Bailenson, J.N., Yee, N., Brave, S., Merget, D., Koslow, D.: Virtual interpersonal touch: Expressing and recognizing emotions through haptic devices. Human-Computer Interaction (in press, 2006)

    Google Scholar 

  49. Pearce, A., Hill, D., Wyvill, B.: Animating speech: an automated approach using speech synthesis by rules. The Visual Computer 3, 277–289 (1988)

    Article  Google Scholar 

  50. Downie, M., Isla, D., Burke, R., Blumberg, B.: Simhuman: A platform for real-time virtual agents with planning capabilities. In: Proceedings of IJCAI, pp. 1051–1058 (2001)

    Google Scholar 

  51. Kleiner, M., Dalenback, B.-I., Svensson, P.: Auralization - an overview. Journal of the Audio Engineering Society 41(11) (1993)

    Google Scholar 

  52. de Gelder, B.: Towards the neurobiology of emotional body language. Nature Reviews Neuroscience 7(3), 242–249 (2006)

    Article  Google Scholar 

  53. de Sevin, E., Thalmann, D.: An affective model of action selection for virtual humans. In: Proceedings of Agents that Want and Like: Motivational and Emotional Roots of Cognition and Action symposium at the Artificial Intelligence and Social Behaviors Conference, pp. 293–297 (2005)

    Google Scholar 

  54. Dinerstein, J., Egbert, P.K.: Fast multi-level adaptation for interactive autonomous characters. ACM Trans. Graph 24(2), 262–288 (2005)

    Article  Google Scholar 

  55. Traum, D., Larsson, S.: The information state approach to dialogue management. In: Smith, Kuppevelt (eds.) Current and New Directions in Discourse and Dialogue, pp. 325–353. Kluwer Academic Publishers, Dordrecht (2000)

    Google Scholar 

  56. Nakamura, S., Yamamato, E., Shikano, K.: Lip movement synthesis from speech based on hidden markov models. Speech Communication 26, 105–115 (1998)

    Article  Google Scholar 

  57. Egges, A.: Real-time animation of interactive virtual characters. PhD thesis, MIRALab, University of Geneva (2006)

    Google Scholar 

  58. Magnenat Thalmann, N., Kim, H., Egges, A., Garchery, S.: Believability and interaction in virtual worlds. In: International Multi-Media Modelling Conference. IEEE Computer Society Press, Los Alamitos (2005)

    Google Scholar 

  59. Ekman, P.: Emotion in the Human Face. Cambridge University Press, New York (1982)

    Google Scholar 

  60. Brom, C., Lukavský, J., Šerý, O., Poch, T., Šafrata, P.: Affordances and level-of-detail ai for virtual humans. In: Proceedings of Game Set and Match 2 The Netherlands, pp. 134–145 (2006)

    Google Scholar 

  61. Eva-Lotta, Rassmus, K., Calle: Supporting presence in collaborative environments by haptic force feedback. ACM Transactions on Computer-Human Interaction 7(4), 461–476 (2000)

    Article  Google Scholar 

  62. Ferguson, I.A.: TouringMachines: An Architecture for Dynamic, Rational, Mobile Agents. PhD thesis, Clare Hall, University of Cambridge (1992)

    Google Scholar 

  63. Gockley, R., Forlizzi, J., Simmons, R.: Interactions with a moody robot. In: Proceedings of Human-Robot Interaction, pp. 186–193 (2006)

    Google Scholar 

  64. Friesen, E.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press (1978)

    Google Scholar 

  65. Gadanho, S.: Learning behavior-selection by emotions and cognition in a multi-goal robot task. Journal of Machine Learning 4, 385–412 (2003)

    Article  Google Scholar 

  66. Gebhard, P.: Alma - a layered model of affect. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems, pp. 29–36 (2005)

    Google Scholar 

  67. Gillies, M., Ballin, D.: Integrating autonomous behavior and user control for believable agents. In: AAMAS 2004: Proceedings of the first international joint conference on Autonomous agents and multiagent systems (2004)

    Google Scholar 

  68. Gillies, M.F.P., Dodgson, N.A.: Eye movements and attention for behavioural animation. The Journal of Visualization and Computer Animation 13(5), 287–300 (2002)

    Article  MATH  Google Scholar 

  69. Grandstrom, B.: Multi-modal speech synthesis with applications. In: 3rd International School on Neural Nets, pp. 136–140 (1999)

    Google Scholar 

  70. McGuire, R.M., Hernandez-Rebollar, J., Starner, T., Henderson, V., Brashear, H., Ross, D.S.: Towards a one-way american sign language translator. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition (2004)

    Google Scholar 

  71. Hampson, S.: State of the art: Personality. The Psychologist 12(6), 284–290 (1999)

    Google Scholar 

  72. Heeter, C.: Being there: The subjective experience of presence. Presence: Teleoperators and Virtual Environments 1(2), 262–271 (1992)

    Google Scholar 

  73. Herrero, P., de Antonio, A.: Introducing human-like hearing perception in intelligent virtual agents. In: AAMAS 2003: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 733–740 (2003)

    Google Scholar 

  74. Heylen, D.: A closer look at gaze. In: Pelachaud, C., André, E., Kopp, S., Ruttkay, Z.M. (eds.) Creating Bonds with Embodied Conversational Agents: AAMAS Workshop (2005)

    Google Scholar 

  75. Kim, Y., Hill, R.W., Traum, D.R.: A computational model of dynamic perceptual attention for virtual humans. In: 14th Conference on Behavior Representation in Modeling and Simulation (2005)

    Google Scholar 

  76. Hogue, A., Robinson, M., Jenkin, M.R., Allison, R.S.: A vision-based head tracking system for fully immersive displays. In: Deisinger, J., Kunz, A. (eds.) 7th International Immersive Projection Technologies Workshop in conjunction with the 9th Eurographics Workshop on Virtual Environments (2003)

    Google Scholar 

  77. Hui, C., Hanqiu, S., Xiaogang, J.: Interactive haptic deformation of dynamic soft objects. In: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, pp. 255–261 (2006)

    Google Scholar 

  78. de Rosis, F., Poggi, I., Pelachaud, C.: Eye communication in a conversational 3d synthetic agent. André, E. (ed.): Special Issue of Artificial Intelligence Communications, The European Journal on Artificial Intelligence 13(3), 169–181 (2000)

    Google Scholar 

  79. Spindel, M.S., Roseman, I., Jose, P.E.: Appraisals of emotion-eliciting events: Testing a theory of discrete emotions. Personality and Social Psychology 59(5), 899–913 (1990)

    Article  Google Scholar 

  80. Isla, D.: Handling complexity in halo 2. In: VanLehn, K. (ed.) Architectures for Intelligence, Accesses September 2006. Lawrence Erlbaum Assosiates, Mahwah (2006)

    Google Scholar 

  81. Bailenson, J., Yee, N.: Virtual interpersonal touch: Haptic interaction and copresence in collaborative virtual environments. International Journal of Multimedia Tools and Applications (in press, 2006)

    Google Scholar 

  82. Champandard, A.J.: AI Game Development: Synthetic Creatures with learning and Reactive Behaviors. New Riders (2003)

    Google Scholar 

  83. James, D., Shah, M.: Gesture recognition. Technical Report, Department of Computer Science, University of Central Florida, CS-TR-93-11 (1993)

    Google Scholar 

  84. Joseph, L.: A survey of hand posture and gesture recognition techniques and technology. Technical Report CS-99-11, Brown University, Department of Computer Science (1999)

    Google Scholar 

  85. Kasper, M., Fricke, G., Steuernagel, K., Von Puttkamer, E.: A behavior-based mobile robot architecture for learning from demonstration. Robotics and Autonomous Systems 34, 153–164 (2001)

    Article  MATH  Google Scholar 

  86. Kallmann, M.: Object interaction in real-time virtual environments. PhD Thesis. EPFL, Switzerland (2002)

    Google Scholar 

  87. Magnenat-Thalmann, N., Kalra, P.: Modeling of vascular expression in facial animation. In: Proc. CA 1994, pp. 50–58. IEEE Computer Society Press, Los Alamitos (1994)

    Google Scholar 

  88. Khirsagar, S.: Facial Communication. MIRALab, University of Geneva (2003)

    Google Scholar 

  89. Kleiner, M.: Auralization: a dsp approach. In: Sound and Video Contractor (1992)

    Google Scholar 

  90. Tepper, P., Kopp, S., Cassell, J.: Content in context: Generating language and iconic gesture without a gestionary. In: Proceedings of the Workshop on Balanced Perception and Action in ECAs at AAMAS 2004 (2004)

    Google Scholar 

  91. Kopp, S., Wachsmuth, I.: A knowledge-based approach for lifelike gesture animation. In: Horn, W. (ed.) ECAI 2000 (2000)

    Google Scholar 

  92. Kopp, S., Wachsmuth, I.: Synthesizing multimodal utterances for conversational agents. IEEE Intelligent Systems 15(1), 39–52 (2004)

    Google Scholar 

  93. Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. Computer Animation and Virtual Worlds 15(1), 1–13 (2004)

    Article  Google Scholar 

  94. Kuffner, J.J., Latombe, J.C.: Fast synthetic vision, memory, and learning models for virtual humans. In: Proceedings of CA 1999: IEEE International Conference on Computer Animation (1999)

    Google Scholar 

  95. Gleicher, M., Kovar, L., Pighin, F.: Motion graphs. ACM Transactions on Graphics 21(3), 473–482 (2002)

    Google Scholar 

  96. Laban, R., Lawrence, F.C.: Embodied Conversational Agents. Plays, Inc., Boston (1974)

    Google Scholar 

  97. Lamarche, F., Donikian, S.: Automatic orchestration of behaviours through the management of resources and priority levels. In: AAMAS 2002: Proceedings of the first international joint conference on Autonomous agents and multiagent systems (2002)

    Google Scholar 

  98. Lavagetto, F., Pockaj, R.: The facial animation engine: towards a high-level interface for the design of mpeg-4 compliant animated faces. IEEE Transactions on Circuits and Systems for Video Technology 9(2), 277–289 (1999)

    Article  Google Scholar 

  99. Lazharus, R.: Emotion and Adaptation. Oxford University Press, Oxford (1991)

    Google Scholar 

  100. Lee, K.M., Nass, C.: Proceedings of the sigchi conference on human factors in computing systems. In: Proceedings of the SIGCHI conference on Human factors in computing systems, vol. 33, pp. 289–296 (2003)

    Google Scholar 

  101. Stone, M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lee, A., Bregler, C.: Speaking with hands: Creating animated conversational characters from recordings of human performance. ACM Transactions on Graphics 23(3), 506–513 (2004)

    Article  Google Scholar 

  102. Lehnert, H.: Fundamentlas of auditory virtual environment. In: Thalmann, N.M., Thalmann, D. (eds.) Artificial Life and Virtual Reality. John Wiley and Sons Ltd., Chichester (1994)

    Google Scholar 

  103. Klein, J.B.E., Lemon, O., Oka, T.: Dipper: Description and formalisation of an information-state update dialogue system architecture. In: 4th SIGdial Workshop on Discourse and Dialogue, Sapporo, Japan (2003)

    Google Scholar 

  104. Lewis, J.: Automated lip-sync: Background and techniques. The Journal of Visualization and Computer Animation 2, 118–122 (1991)

    Article  Google Scholar 

  105. Otaduy, M.A., Lin, M.C.: Introduction to haptic rendering. In: ACM Sigraph Course Notes (2005)

    Google Scholar 

  106. Becker, C., Nakasone, A., Prendinger, H., Ishizuka, M., Wachsmuth, I.: Physiologically interactive gaming with the 3d agent max. In: International Workshop on Conversational Informatics, pp. 37–42 (2005)

    Google Scholar 

  107. Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M.P.: Integrated learning for interactive synthetic characters. In: Proceedings of SIGGRAPH 2002, pp. 417–426 (2002)

    Google Scholar 

  108. Fukayama, A., Ohno, T., Mukawa, N., Sawaki, M., Hagita, N.: Messages embedded in gaze of interface agents - impression management with agent’s gaze. In: Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves (2002)

    Google Scholar 

  109. Martin, J.C., Pelachaud, C., Abrilian, S., Devillers, L., Lamolle, M., Mancini, M.: Levels of representation in the annotation of emotion for the specification of expressivity in ecas. In: Proceedings of Intelligent Virtual Agents (2005)

    Google Scholar 

  110. Silverman, B.G., Johns, M.: How emotion and personality effect the utility of alternative decisions: A terrorist target selection case study. In: Proceedings of the 10th Conference on Computer Generated Forces and Behavioral Representation (2001)

    Google Scholar 

  111. Rothkrantz, L.J.M., Pantic, M.: Automatic analysis of facial expressions: the state of the art. IEEE Transactions Pattern Analysis Machine Intelligence 22(12), 1424–1445 (2000)

    Article  Google Scholar 

  112. Renault, O., Magnenat-Thalmann, N., Thalmann, D.: A vision-based approach to behavioural animation. Journal of Visualization and Computer Animation 1(1), 18–21 (1990)

    Google Scholar 

  113. Shahabi, C., McLaughlin, M.L., Sukhatme, G.: Haptic museum. Technical Report, Information Laboratory, University of Southern California (2000)

    Google Scholar 

  114. Marsella, S., Gratch, J.: A step toward irrationality: using emotion to change belief. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 334–341 (2002)

    Google Scholar 

  115. Marsella, S., Gratch, J.: Modeling coping behavior in virtual humans: Don’t worry, be happy. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems (2003)

    Google Scholar 

  116. Mccrae, R.R., John, P.O.: An introduction to the five-factor model and its applications. Journal of Personality 60, 175–215 (1992)

    Article  Google Scholar 

  117. McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press (1992)

    Google Scholar 

  118. McTear, M.: Spoken dialogue technology: Enabling the conversational user interface. ACM Computing Survey 34(1) (2002)

    Google Scholar 

  119. Vance, J.M., Jerney, M.M.: Gesture recognition in virtual environments: A review and framework for future development. Iowa State University Human Computer Interaction, Technical Report ISU-HCI-2005-01 (2005)

    Google Scholar 

  120. Morishima, S.: Real-time talking head driven by voice and its application to communication and entertainment. In: International Conference on Auditory Visual Speech Processing (1998)

    Google Scholar 

  121. Muller, J., Pischel, M.: The agent architecture interrap: Concept and application. Technical Report RR-93-26, DFKI Saarbrucken (1993)

    Google Scholar 

  122. Nareyek, A.: Languages for programming bdi-style agents: An overview. In: Proc. of the Second International Conference on Computers and Games (2000)

    Google Scholar 

  123. Nijholt, A.: Humor and embodied conversational agents. CTIT Technical Report series No. 03-03, University of Twente, ISSN 1381-3625 (2003)

    Google Scholar 

  124. Noh, J., Neumann, U.: A survey of facial modeling and animation techniques. USC Technical Report 99-705 (1998)

    Google Scholar 

  125. Badler, N.I., Palmer, O., Bindiganavale, R.: Fast multi-level adaptation for interactive autonomous characters. Communications of ACM 42(8), 65–73 (1999)

    Article  Google Scholar 

  126. Forsyth, F., Arikan, O.: Interactive motion generation from examples. ACM Transactions on Graphics 21(3), 483–490 (2002)

    Google Scholar 

  127. Forsyth, F., Arikan, O., O’Brien, J.F.: Motion synthesis from annotations. ACM Transactions on Graphics 22(3), 402–408 (2003)

    Article  Google Scholar 

  128. Burghouts, G.J., op den Akker, H.J.A., Heylen, D.K.J., Poel, M., Nijholt, A.: An action selection architecture for an emotional agent. In: Proceedings of 16th International FLAIRS Conference, pp. 293–297 (2003)

    Google Scholar 

  129. Insko, B.E., Meehan, M.J., Whitton, M.C., Brooks Jr., F.P.: Passive haptics significantly enhances virtual environments. Computer Science Technical Report, University of North Carolina (2001)

    Google Scholar 

  130. Magnenat-Thalmann, N., Kalra, P., Mangili, A., Thalmann, D.: Simulation of facial muscle actions based on rational free form deformation. In: Proceedings Eurographics 1992, pp. 59–69 (1992)

    Google Scholar 

  131. Bianchi-Berthouze, N., De Silva, P.R.: Modeling human affective postures: an information theoretic characterization of posture features. Journal of Visualization and Computer Animation 15(3-4), 269–276 (2004)

    Google Scholar 

  132. Oudeyer, P.-Y.: The production and recognition of emotions in speech: features and algorithms. International Journal in Human-Computer Studies, special issue on Affective Computing 59(1-2), 157–183 (2003)

    Google Scholar 

  133. Magnenat-Thalmann, N., Papagiannakis, G., Kim, H.: Believability and presence in mobile mixed reality environments. In: IEEE VR 2005 Workshop on Virtuality Structures (2005)

    Google Scholar 

  134. Parke, F.: Computer generated animation faces. In: ACM Annual Conference (1972)

    Google Scholar 

  135. Pelachaud, C.: Communication and Coarticulation in Facial Animation. University of Pennsylvania (1991)

    Google Scholar 

  136. Perlin, K., Goldberg, A.: Improv: A system for scripting interactive actors in virtual worlds. In: Computer Graphics. Annual Conference Series, vol. 30, pp. 205–216 (1996)

    Google Scholar 

  137. Peters, C., O’Sullivan, C.: Synthetic vision and memory for autonomous virtual humans. Computer Graphis Forum 21(4) (2002)

    Google Scholar 

  138. Peters, C., Sullivan, C.: Bottom-up visual attention for virtual human animation. In: CASA 2003: Proceedings of the 16th International Conference on Computer Animation and Social Agents (2003)

    Google Scholar 

  139. Picard, R.W.: Affective computing. MIT Press, Cambridge (1997)

    Google Scholar 

  140. Pinho, M., Bowman, D., Freitas, C.: Cooperative object manipulation in immersive virtual environments: Framework and techniques. In: Proceedings of ACM Virtual Reality Software and Technology, pp. 171–178 (2002)

    Google Scholar 

  141. Plutchik, R.: A general psychoevolutionary theory of emotion. In: Plutchik, R., Kellerman, H. (eds.) Emotion: Theory, research, and experience, vol. 1, pp. 2–33 (1980)

    Google Scholar 

  142. Cassell, J., Sullivan, J., Prevost, S., Churchill, E.: Embodied Conversational Agents. MIT Press, Cambridge (2000)

    Google Scholar 

  143. Soar Project. University of michigan. project homepage Accessed (September 2006), http://sitemaker.umich.edu/soar

  144. Rabie, T.F., Terzopoulos, D.: Active perception in virtual humans. In: Vision Interface 2000 Montreal, Canada (2000)

    Google Scholar 

  145. Reynolds, C.W.: Flocks, herds, and schools: a distributed behavioral model. In: SIGGRAPH 1987 Conference Proceedings, vol. 21(4), pp. 25–34 (1987)

    Google Scholar 

  146. Rickel, J., Johnson, W.L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13, 343–382 (1999)

    Article  Google Scholar 

  147. Ruttkay, Z., Noot, H.: Variations in gesturing and speech by gestyle. International Journal of Human-Computer Studies, Special Issue on Subtle Expressivity for Characters and Robots 62(2), 211–229 (2005)

    Google Scholar 

  148. Becker, C., Kopp, S., Wachsmuth, I.: Simulating the emotion dynamics of a multimodal conversational agent. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS 2004. LNCS (LNAI), vol. 3068, pp. 154–165. Springer, Heidelberg (2004)

    Google Scholar 

  149. Magnenat-Thalmann, N., Kshirsagar, S., Garchery, S.: Feature point based mesh deformation applied to mpeg-4 facial animation. In: Proceedings of the IFIP DEFORM 2000 Workshop and AVATARS 2000 Workshop on Deformable Avatars, pp. 23–34 (2000)

    Google Scholar 

  150. Pelachaud, C., Pasquariello, S.: Greta: A simple facial animation engine. In: 6th Online World Conference on Soft Computing in Industrial Appications (2001)

    Google Scholar 

  151. Salisbury, K., Conti, F., Barbagli, F.: Passive haptics significantly enhances virtual environments. Computer Science Technical Report, University of North Carolina 24(2), 24–32 (2004)

    Google Scholar 

  152. Savioja, L.: Modeling Techniques for Virtual Acoustics. PhD thesis, Helsinki University of Technology (1999)

    Google Scholar 

  153. Schroder, M.: Emotional speech synthesis: A review. In: Proceedings of Eurospeech 2001 (2001)

    Google Scholar 

  154. Catizone, R., Setzer, A., Wilks, Y.: State of the art in dialogue management (2002)

    Google Scholar 

  155. Sheridan, T.B.: Musings on telepresence and virtual presence. Presence-Connect 1, 120–126 (1992)

    Google Scholar 

  156. Badler, N., Bindiganavale, R., Bourne, J., Palmer, M., Shi, J., Schuler, W.: A parameterized action representation for virtual agents. In: Workshop on Embodied Conversational Characters (1998)

    Google Scholar 

  157. Slater, M.: A note on presence terminology. Presence-Connect 3 (2003)

    Google Scholar 

  158. Slater, M., Steed, A.: A virtual presence counter. Presence 9(5), 413–434 (2000)

    Article  Google Scholar 

  159. Stead, L., Goulev, P., Evans, C., Mamdani, E.: Journal of ubiquitous computing. ACM Transactions on Graphics 8(3-4), 282–290 (2004)

    Google Scholar 

  160. Steed, A.: A survey of virtual reality literature. In Technical Report (1993)

    Google Scholar 

  161. Stronks, J.J.S.: Friendship relations with embodied conversational agents: Integrating social psychology in eca design. Master Thesis, Faculty of Computer Science, University of Twente (2002)

    Google Scholar 

  162. Sturman, D.J., Zeltzer, D.: A survey of glove-based input. IEEE Computer Graphics and Applications 14(1), 30–39 (1994)

    Article  Google Scholar 

  163. Wardhani, A., Su, W., Pham, B.: High-level control posture of story characters based on personality and emotion. In: Pisan, Y. (ed.) Proceedings IE 2005, The Second Australasian Interactive entertainment conference, pp. 179–186 (2005)

    Google Scholar 

  164. Sutherland, I.: A head-mounted three-dimensional display. In: Proceedings of the Fall Joint Computer Conference, vol. 33, pp. 757–764 (1968)

    Google Scholar 

  165. Shin, S.Y., Kim, T., Park, S.: Rhythmic-motion synthesis based on motion-beat analysis. ACM Transactions on Graphics 22(3), 392–401 (2003)

    Article  Google Scholar 

  166. Tang, T.W., Wan, R.: Integrated learning for interactive synthetic characters. In: WSCG - Short Papers, pp. 137–144 (2002)

    Google Scholar 

  167. Garcia-Rojas, A., Gutierrez, M., Thalmann, D., Vexo, F.: Multimodal authoring tool for populating a database of emotional reactive actions. In: Renals, S., Bengio, S. (eds.) MLMI 2005. LNCS, vol. 3869, pp. 206–217. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  168. Noser, H., Renault, O., Thalmann, D., Magnenat Thalmann, N.: Navigation for digital actors based on synthetic vision memory and learning. Computers and Graphics 19(1), 7–19 (1995)

    Article  Google Scholar 

  169. Blumberg, B., Todd, P., Maes, P.: No bad dogs: Ethological lessons for learning in hamsterdam. In: Proceedings of the 4th International Conference on the Simulation of Adaptive Behavior (1996)

    Google Scholar 

  170. Tollmar, K., Demirdjian, D., Darrell, T.: Navigating in virtual environments using a vision-based interface. In: Proceedings of the third Nordic conference on Human-computer interaction, pp. 113–120 (2004)

    Google Scholar 

  171. Tomlinson, B., Blumberg, B.: Alphawolf: Social learning, emotion and development in autonomous virtual agents. In: First GSFC/JPL Workshop on Radical Agent Concepts (2002)

    Google Scholar 

  172. Tomlinson, B.: From linear to interactive animation: how autonomous characters change the process and product of animating. ACM Computers in Entertainment 3(1) (2005)

    Google Scholar 

  173. Rickel, J., Marsella, S., Gratch, J., Hill, R., Traum, D., Swartout, W.: Toward a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems 17(4), 32–38 (2002)

    Article  Google Scholar 

  174. TRINDIKIT (September 2006), http://www.ling.gu.se/projekt/trindi/trindikit/index.html

  175. Trung, H.B.: Multimodal dialogue management - state of the art. Human Media Interaction Department, University of Twente (2006)

    Google Scholar 

  176. Funkhouser, T., Tsingos, N., Jot, J.M.: Survey of methods for modeling sound propagation in interactive virtual environment systems. Presence and Teleoperation (2003)

    Google Scholar 

  177. Tu, X., Terzopoulos, D.: Artificial fishes: physics, locomotion, perception, behavior. In: Proceedings SIGGRAPH 1994, vol. 21(4), pp. 43–50 (1994)

    Google Scholar 

  178. Tu, X., Terzopoulos, D.: Perceptual modeling for the behavioral animation of fishes. In: Proc. Pacific Graphics 1994, pp. 165–178. World Scientific, Singapore (1994)

    Google Scholar 

  179. Turk, M.: Gesture recognition. In: Stanney, K. (ed.) Handbook of Virtual Environments: Design, Implementation and Applications, pp. 113–120. Lawrence Erlbaum Associates, Mahwah (2002)

    Google Scholar 

  180. Schuemie, M.J., Straaten, P., van der Krijn, M., van der Mast, C.: Research on presence in virtual reality: A survey. Presence-Connect 4(2), 183–202 (2001)

    Google Scholar 

  181. van Waveren, J.M.P.: The quake 3 arena bot. Master thesis. Faculty ITS, University of Technology Delft (2001)

    Google Scholar 

  182. Cassell, J., Stocky, T., Bickmore, T., Gao, Y., Nakano, Y., Ryokai, K., Tversky, D., Vaucelle, C., Vilhjálmsson, H.: MACK: Media lab autonomous conversational kiosk. In: Proceedings of Imagina 2002 (2002)

    Google Scholar 

  183. Veldhuis, J.: Expressing personality through head node and eye gaze. In: 5th Twente Student Conference on IT (2006)

    Google Scholar 

  184. Ververidis, D., Kotropoulos, C.: Emotional speech recognition: Resources, features, and methods. Speech Communication 48 (2006)

    Google Scholar 

  185. Cassell, J., Vilhjálmsson, H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH (2001)

    Google Scholar 

  186. Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., Yan, H.: Embodiment in conversational interfaces: Rea. In: Proceedings of the CHI 1999 Conference (1999)

    Google Scholar 

  187. Mascardi, D.A.V., Demergasso, D.: Languages for programming bdi-style agents: An overview. In: WOA 2005 (2005)

    Google Scholar 

  188. Väänänen, R.: Parametrization, auralization, and authoring of room acoustics for virtual reality applications. In: Electrical and Communications Engineering (2003)

    Google Scholar 

  189. Vosinakis, S., Panayiotopoulos, T.: Simhuman: A platform for real-time virtual agents with planning capabilities. In: Proceedings of the 3rd International Workshop on Intelligent Virtual Agents (2001)

    Google Scholar 

  190. Wang, F., Mckenzie, E.: Virtual life in virtual environments. CSG report ECS-CSG-44-98, Institute for Computing Systems Architecture, University of Edinburgh (1998)

    Google Scholar 

  191. Waters, K., Levergood, T.: Decface: A system for synthetic face applications. Multimedia Tools and Applications 1(4), 349–366 (1988)

    Article  Google Scholar 

  192. Weizenbaum, J.: Eliza-a computer program for the study of natural language communication between man and machine. ACM Computing Survey 9(1), 36–45 (1966)

    Google Scholar 

  193. Whissel, C.M.: The dictionary of affect in language. In: Plutchik, R., Kellerman, H. (eds.) Emotion: Theory, research, and experience. The measurement of emotions, vol. 4 (1980)

    Google Scholar 

  194. Wikipedia-Behaviour (accessed September 2006), http://en.wikipedia.org/wiki/behaviour

  195. William, K.D., McNeely, W.A.: Six degrees-of-freedom haptic rendering using voxel sampling. In: ACM Sigraph Course Notes, pp. 401–408 (1999)

    Google Scholar 

  196. Wilson, I.: The artificial emotion engine, driving emotional behaviour. Artificial Intelligence and Interactive Entertainment (2000)

    Google Scholar 

  197. Wooldridge, M.: Reasoning about rational agents. MIT Press, Cambridge (2000)

    MATH  Google Scholar 

  198. Woolridge, M.: An Introduction to MultiAgent Systems. John Wiley and Sons, Chichester (2002)

    Google Scholar 

  199. Wang, T., Li, Y., Shum, H.Y.: Motion texture: a two-level statistical model for character motion synthesis. ACM Transactions on Graphics 21(3), 465–472 (2002)

    Google Scholar 

  200. Chang, Y., Ezzat, T.: Transferable videorealistic speech animation. In: ACM Siggraph/Eurographics Symposium on Computer Animation, Los Angeles, pp. 21–28 (2005)

    Google Scholar 

  201. Turunen, M., Wilks, Y., Catizone, R.,: Companions consortium: State of the art papers. 2 (2006)

    Google Scholar 

  202. Zhang, M.: Overview of speech recognition and related machine learning techniques. Technical Report, CS-TR-01/15 (2001)

    Google Scholar 

  203. Chi, D.M., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Siggraph 2000, Computer Graphics Proceedings (2000)

    Google Scholar 

  204. Badler, N., Allbeck, J., Zhao, L., Byun, M.: Representing and parameterizing agent behaviors. In: Computer Animation, pp. 133–143 (2002)

    Google Scholar 

  205. Zhao, W., Madhavan, V.: Virtual assembly operations with grasp and verbal interaction. In: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, pp. 245–254 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Nadia Magnenat-Thalmann Lakhmi C. Jain Nikhil Ichalkaranje

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kasap, Z., Magnenat-Thalmann, N. (2008). Intelligent Virtual Humans with Autonomy and Personality: State-of-the-Art. In: Magnenat-Thalmann, N., Jain, L.C., Ichalkaranje, N. (eds) New Advances in Virtual Humans. Studies in Computational Intelligence, vol 140. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79868-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-79868-2_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-79867-5

  • Online ISBN: 978-3-540-79868-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics