Abstract
Intelligent virtual characters has been subject to exponential growth in the last decades and they are utilized in many applications areas such as education, training, human-computer interfaces and entertainment. In this paper, we present a state-of-the-art of virtual human mentioning about the use of intelligent decision technologies in order to build virtual human architectures. We consider various aspects such as autonomy, interaction, personification and presence. Each of these aspects comes to prominence in different applications although there is no slight distinction. This survey provides a novel insight to the current state of designing and modeling virtual humans using different decision technologies and can be used as a basis for several future directions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Wikipedia-action-selection (2006), http://en.wikipedia.org/wiki/Actionselection
Egges, A., Magnenat-Thalmann, N.: Emotional communicative body animation for multiple characters. In: V-Crowds 2005, Lausanne, Switzerland, pp. 31–40 (2005)
Monzani, J., Caicedo, A., Thalmann, D.: Integrating behavioural animation techniques. Computer Graphics Forum 20(3) (2001)
Romano, D., Sheppard, G., Hall, J., Miller, A., Ma, Z.: Basic: a believable, adaptable socially intelligent character for social presence. In: PRESENCE 2005, The 8th Annual International Workshop on Presence (2005)
Magnenat-Thalmann, N., Egges, A., Molet, T.: Personalised real-time idle motion synthesis. In: Pacific Graphics 2004, Seoul, Korea, pp. 121–130 (2004)
Bianchi-Berthouze, N., Kleinsmith, A., Fushimi, T.: An incremental and interactive affective posture recognition system. In: International Workshop on Adapting the Interaction Style to Affective Factors (2005)
Collins, A., Ortony, A., Clore, G.L.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)
Sobral, D., Paiva, A., Dias, J., Aylett, R.: Caring for agents and agents that care: building empathic relations with synthetic agents. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems (2004)
Zambetta, F., Paradiso, A., Abbattista, F.: Fanky: A tool for animating faces of 3d agents. In: de Antonio, A., Aylett, R.S., Ballin, D. (eds.) IVA 2001. LNCS (LNAI), vol. 2190, pp. 242–244. Springer, Heidelberg (2001)
Wyvill, G., Pearce, A., Wyvill, B., Hill, D.: Speech and expression: A computer solution to face animation. In: Graphics Interface 1986, pp. 136–140 (1986)
Karpouzis, K., Raouzaiou, A., Kollias, S.: Emotion synthesis in virtual environments. In: 6th International Conference on Enterprise Information Systems (2004)
Webpage AIML (September 2006), http://www.alicebot.org
Bindiganavale, R., Schuler, W., Allbeck, J.M., Badler, N.I., Joshi, A.K., Palmer, M.: Dynamically altering agent behaviors using natural language instructions. In: Proceedings of the fourth international conference on Autonomous agents, pp. 293–300 (2000)
Volino, P., Davy, P., Bonanni, U., Magnenat-Thalmann, N., Böttcher, G., Allerkamp, D., Wolter, F.-E.: From measured physical parameters to the haptic feeling of fabric. In: Proceedings of the HAPTEX 2005 Workshop on Haptic and Tactile Perception of Deformable Objects, pp. 17–29 (2005)
Arafa, Y., Kamyab, K., Mamdani, E.: Character animation scripting languages: a comparison. In: AAMAS 2003: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 920–921 (2003)
Arbantes, G., Pereira, F.: Mpeg-4 facial animation technology: Survey, implementation, and results. IEEE Transactions on Circuits and Systems for Video Technology 9(2), 290–305 (1999)
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)
Ogi, T., Kayahara, T., Kato, M., Asayama, H., Hirose, M.: Immersive sound field simulation in multi-screen projection displays. In: Proceedings of the workshop on Virtual environments, pp. 135–142 (2003)
Churcher, G.E., Atwell, E.S., Souter, C.: Dialogue management systems: A survey and overview. Technical report, University of Leeds (1997)
Aylett, R., Luck, M.: Applying artificial intelligence to virtual reality: Intelligent virtual environments. Applied Artificial Intelligence 14(1), 3–32 (2000)
Pelachaud, C., Hartmann, B., Mancini, M.: Implementing Expressive Gesture Synthesis for Embodied Conversational Agents. In: Gesture Workshop. LNCS (LNAI), pp. 188–199. Springer, Heidelberg (2005)
Lee, S.P., Badler, J.B., Badler, N.I.: Eyes alive. ACM Transactions on Graphics 21(3), 637–644 (2002)
Bartneck, C.: Integrating the occ model of emotions in embodied characters. In: Proceedings of the Workshop on Workshop on Virtual Conversational Characters: Applications, Methods, and Research Challenges, Melbourne (2002)
Baxter, W., Scheib, V., Lin, M., Manocha, D.: Dab: Interactive haptic painting with 3d virtual brushes. In: Proceedings of ACM Siggraph, pp. 461–468 (2001)
Begault, D.: 3-D Sound for Virtual Reality and Multimedia. Academic Press, Cambridge (1994)
Bergamasco, M.: Manipulation and exploration of virtual objects. In: Magnenat Thalmann, N., Thalmann, D. (eds.) Artificial Life and Virtual Reality. John Wiley, Chichester (1994)
Bickmore, T., Cassell, J.: Social dialogue with embodied conversational agents. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N. (eds.) Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems. Kluwer Academic, New York (2005)
Biocca, F.: The cyborg’s dilemma: Progressive embodiment in virtual environments. Journal of Computer-Mediated Communication (1997)
Taylor, P., Black, A., Caley, R.: The architecture of the festival speech synthesis system. In: 3rd ESCA Workshop on Speech Synthesis, Australia, pp. 147–151 (1998)
Ardissono, L., Boella, G., Lesmo, L.: An agent architecture for nl dialogmodeling. In: Proc. Second Workshop on Human-Computer Conversation (1998)
Bolt, R.A.: Put-that-there: Voice and gesture at the graphics interface. In: Proceedings of SIGGRAPH, pp. 262–270 (1980)
Bordeux, C., Boulic, R., Thalmann, D.: An efficient and flexible perception pipeline for autonomous agents. In: Computer Graphics Forum (Eurographics 1999), vol. 18(3), pp. 23–30 (1999)
Bos, J., Oka, T.: Building spoken dialogue systems for believable characters. In: Proceedings of the seventh workshop on the semantics and pragmatics of dialogue, Diabruck (2003)
Brand, M.: Voice puppetry. In: Proceedings of SIGGRAPH 1999, pp. 21–28 (1999)
Brand, M., Hertzmann, A.: Style machines. In: SIGGRAPH 2000, pp. 399–407. ACM Press, New York (2000)
Bratman, N.: Intention, plans, and practical reason. Harvard University Press, Cambridge (1987)
Sadek, M.D., Bretier, P., Panaget, F.: Artimis: Natural dialogue meets rational agency. In: Pollack, M.E. (ed.) Proceedings 15th International Joint Conference on Artificial Intelligence, pp. 1030–1035 (1997)
Brooks, R.A.: How to build complete creatures rather than isolated cognitive simulators. In: VanLehn, K. (ed.) Architectures for Intelligence, pp. 225–239. Lawrence Erlbaum Assosiates, Mahwah (2001)
Lombard, M., Reich, R.D., Grabe, M.E., Bracken, C., Ditton, T.B.: Presence and television: The role of screen size. Human Communication Research 26(1), 75–98 (2000)
Cañamero, L.: Emotions for activity selection. Dept. of Computer Science Technical Report DAIMI PB 545, University of Aarhus, Denmark (2000)
Canamero, D.: Designing emotions for activity selection. Department of Computer Science, University of Aarhus (2000)
Gratch, J., Rickel, J., Andre, E., Badler, N., Cassell, J., Petajan, E.: Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems 17(4), 54–63 (2002)
Chang, P.H.-M., Chien, Y.-H., Kao, E.C.-C., Soo, V.-W.: A knowledge-based scenario framework to support intelligent planning characters. LNCS, pp. 134–145. Springer, Heidelberg (2005)
Chopra-Khullar, S., Badler, N.I.: Where to look? automating attending behaviors of virtual human characters. In: AGENTS 1999: Proceedings of the third annual conference on Autonomous Agents, pp. 16–23 (1999)
Chibelushi, F.B.C.C.: Facial expression recognition: A brief tutorial overview. School of Computing, Staffordshire University (2002)
Cohen, M., Massaro, D.: Modelling coarticulation in synthetic visual speech. In: Thalmann, N.M., Thalmann, D. (eds.) Models and Techniques in Computer Animation, pp. 139–156 (1993)
Cornelius, R.: The science of emotion. Prentice Hall, New Jersey (1996)
Bailenson, J.N., Yee, N., Brave, S., Merget, D., Koslow, D.: Virtual interpersonal touch: Expressing and recognizing emotions through haptic devices. Human-Computer Interaction (in press, 2006)
Pearce, A., Hill, D., Wyvill, B.: Animating speech: an automated approach using speech synthesis by rules. The Visual Computer 3, 277–289 (1988)
Downie, M., Isla, D., Burke, R., Blumberg, B.: Simhuman: A platform for real-time virtual agents with planning capabilities. In: Proceedings of IJCAI, pp. 1051–1058 (2001)
Kleiner, M., Dalenback, B.-I., Svensson, P.: Auralization - an overview. Journal of the Audio Engineering Society 41(11) (1993)
de Gelder, B.: Towards the neurobiology of emotional body language. Nature Reviews Neuroscience 7(3), 242–249 (2006)
de Sevin, E., Thalmann, D.: An affective model of action selection for virtual humans. In: Proceedings of Agents that Want and Like: Motivational and Emotional Roots of Cognition and Action symposium at the Artificial Intelligence and Social Behaviors Conference, pp. 293–297 (2005)
Dinerstein, J., Egbert, P.K.: Fast multi-level adaptation for interactive autonomous characters. ACM Trans. Graph 24(2), 262–288 (2005)
Traum, D., Larsson, S.: The information state approach to dialogue management. In: Smith, Kuppevelt (eds.) Current and New Directions in Discourse and Dialogue, pp. 325–353. Kluwer Academic Publishers, Dordrecht (2000)
Nakamura, S., Yamamato, E., Shikano, K.: Lip movement synthesis from speech based on hidden markov models. Speech Communication 26, 105–115 (1998)
Egges, A.: Real-time animation of interactive virtual characters. PhD thesis, MIRALab, University of Geneva (2006)
Magnenat Thalmann, N., Kim, H., Egges, A., Garchery, S.: Believability and interaction in virtual worlds. In: International Multi-Media Modelling Conference. IEEE Computer Society Press, Los Alamitos (2005)
Ekman, P.: Emotion in the Human Face. Cambridge University Press, New York (1982)
Brom, C., Lukavský, J., Šerý, O., Poch, T., Šafrata, P.: Affordances and level-of-detail ai for virtual humans. In: Proceedings of Game Set and Match 2 The Netherlands, pp. 134–145 (2006)
Eva-Lotta, Rassmus, K., Calle: Supporting presence in collaborative environments by haptic force feedback. ACM Transactions on Computer-Human Interaction 7(4), 461–476 (2000)
Ferguson, I.A.: TouringMachines: An Architecture for Dynamic, Rational, Mobile Agents. PhD thesis, Clare Hall, University of Cambridge (1992)
Gockley, R., Forlizzi, J., Simmons, R.: Interactions with a moody robot. In: Proceedings of Human-Robot Interaction, pp. 186–193 (2006)
Friesen, E.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press (1978)
Gadanho, S.: Learning behavior-selection by emotions and cognition in a multi-goal robot task. Journal of Machine Learning 4, 385–412 (2003)
Gebhard, P.: Alma - a layered model of affect. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multi Agent Systems, pp. 29–36 (2005)
Gillies, M., Ballin, D.: Integrating autonomous behavior and user control for believable agents. In: AAMAS 2004: Proceedings of the first international joint conference on Autonomous agents and multiagent systems (2004)
Gillies, M.F.P., Dodgson, N.A.: Eye movements and attention for behavioural animation. The Journal of Visualization and Computer Animation 13(5), 287–300 (2002)
Grandstrom, B.: Multi-modal speech synthesis with applications. In: 3rd International School on Neural Nets, pp. 136–140 (1999)
McGuire, R.M., Hernandez-Rebollar, J., Starner, T., Henderson, V., Brashear, H., Ross, D.S.: Towards a one-way american sign language translator. In: Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition (2004)
Hampson, S.: State of the art: Personality. The Psychologist 12(6), 284–290 (1999)
Heeter, C.: Being there: The subjective experience of presence. Presence: Teleoperators and Virtual Environments 1(2), 262–271 (1992)
Herrero, P., de Antonio, A.: Introducing human-like hearing perception in intelligent virtual agents. In: AAMAS 2003: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 733–740 (2003)
Heylen, D.: A closer look at gaze. In: Pelachaud, C., André, E., Kopp, S., Ruttkay, Z.M. (eds.) Creating Bonds with Embodied Conversational Agents: AAMAS Workshop (2005)
Kim, Y., Hill, R.W., Traum, D.R.: A computational model of dynamic perceptual attention for virtual humans. In: 14th Conference on Behavior Representation in Modeling and Simulation (2005)
Hogue, A., Robinson, M., Jenkin, M.R., Allison, R.S.: A vision-based head tracking system for fully immersive displays. In: Deisinger, J., Kunz, A. (eds.) 7th International Immersive Projection Technologies Workshop in conjunction with the 9th Eurographics Workshop on Virtual Environments (2003)
Hui, C., Hanqiu, S., Xiaogang, J.: Interactive haptic deformation of dynamic soft objects. In: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, pp. 255–261 (2006)
de Rosis, F., Poggi, I., Pelachaud, C.: Eye communication in a conversational 3d synthetic agent. André, E. (ed.): Special Issue of Artificial Intelligence Communications, The European Journal on Artificial Intelligence 13(3), 169–181 (2000)
Spindel, M.S., Roseman, I., Jose, P.E.: Appraisals of emotion-eliciting events: Testing a theory of discrete emotions. Personality and Social Psychology 59(5), 899–913 (1990)
Isla, D.: Handling complexity in halo 2. In: VanLehn, K. (ed.) Architectures for Intelligence, Accesses September 2006. Lawrence Erlbaum Assosiates, Mahwah (2006)
Bailenson, J., Yee, N.: Virtual interpersonal touch: Haptic interaction and copresence in collaborative virtual environments. International Journal of Multimedia Tools and Applications (in press, 2006)
Champandard, A.J.: AI Game Development: Synthetic Creatures with learning and Reactive Behaviors. New Riders (2003)
James, D., Shah, M.: Gesture recognition. Technical Report, Department of Computer Science, University of Central Florida, CS-TR-93-11 (1993)
Joseph, L.: A survey of hand posture and gesture recognition techniques and technology. Technical Report CS-99-11, Brown University, Department of Computer Science (1999)
Kasper, M., Fricke, G., Steuernagel, K., Von Puttkamer, E.: A behavior-based mobile robot architecture for learning from demonstration. Robotics and Autonomous Systems 34, 153–164 (2001)
Kallmann, M.: Object interaction in real-time virtual environments. PhD Thesis. EPFL, Switzerland (2002)
Magnenat-Thalmann, N., Kalra, P.: Modeling of vascular expression in facial animation. In: Proc. CA 1994, pp. 50–58. IEEE Computer Society Press, Los Alamitos (1994)
Khirsagar, S.: Facial Communication. MIRALab, University of Geneva (2003)
Kleiner, M.: Auralization: a dsp approach. In: Sound and Video Contractor (1992)
Tepper, P., Kopp, S., Cassell, J.: Content in context: Generating language and iconic gesture without a gestionary. In: Proceedings of the Workshop on Balanced Perception and Action in ECAs at AAMAS 2004 (2004)
Kopp, S., Wachsmuth, I.: A knowledge-based approach for lifelike gesture animation. In: Horn, W. (ed.) ECAI 2000 (2000)
Kopp, S., Wachsmuth, I.: Synthesizing multimodal utterances for conversational agents. IEEE Intelligent Systems 15(1), 39–52 (2004)
Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. Computer Animation and Virtual Worlds 15(1), 1–13 (2004)
Kuffner, J.J., Latombe, J.C.: Fast synthetic vision, memory, and learning models for virtual humans. In: Proceedings of CA 1999: IEEE International Conference on Computer Animation (1999)
Gleicher, M., Kovar, L., Pighin, F.: Motion graphs. ACM Transactions on Graphics 21(3), 473–482 (2002)
Laban, R., Lawrence, F.C.: Embodied Conversational Agents. Plays, Inc., Boston (1974)
Lamarche, F., Donikian, S.: Automatic orchestration of behaviours through the management of resources and priority levels. In: AAMAS 2002: Proceedings of the first international joint conference on Autonomous agents and multiagent systems (2002)
Lavagetto, F., Pockaj, R.: The facial animation engine: towards a high-level interface for the design of mpeg-4 compliant animated faces. IEEE Transactions on Circuits and Systems for Video Technology 9(2), 277–289 (1999)
Lazharus, R.: Emotion and Adaptation. Oxford University Press, Oxford (1991)
Lee, K.M., Nass, C.: Proceedings of the sigchi conference on human factors in computing systems. In: Proceedings of the SIGCHI conference on Human factors in computing systems, vol. 33, pp. 289–296 (2003)
Stone, M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lee, A., Bregler, C.: Speaking with hands: Creating animated conversational characters from recordings of human performance. ACM Transactions on Graphics 23(3), 506–513 (2004)
Lehnert, H.: Fundamentlas of auditory virtual environment. In: Thalmann, N.M., Thalmann, D. (eds.) Artificial Life and Virtual Reality. John Wiley and Sons Ltd., Chichester (1994)
Klein, J.B.E., Lemon, O., Oka, T.: Dipper: Description and formalisation of an information-state update dialogue system architecture. In: 4th SIGdial Workshop on Discourse and Dialogue, Sapporo, Japan (2003)
Lewis, J.: Automated lip-sync: Background and techniques. The Journal of Visualization and Computer Animation 2, 118–122 (1991)
Otaduy, M.A., Lin, M.C.: Introduction to haptic rendering. In: ACM Sigraph Course Notes (2005)
Becker, C., Nakasone, A., Prendinger, H., Ishizuka, M., Wachsmuth, I.: Physiologically interactive gaming with the 3d agent max. In: International Workshop on Conversational Informatics, pp. 37–42 (2005)
Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M.P.: Integrated learning for interactive synthetic characters. In: Proceedings of SIGGRAPH 2002, pp. 417–426 (2002)
Fukayama, A., Ohno, T., Mukawa, N., Sawaki, M., Hagita, N.: Messages embedded in gaze of interface agents - impression management with agent’s gaze. In: Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves (2002)
Martin, J.C., Pelachaud, C., Abrilian, S., Devillers, L., Lamolle, M., Mancini, M.: Levels of representation in the annotation of emotion for the specification of expressivity in ecas. In: Proceedings of Intelligent Virtual Agents (2005)
Silverman, B.G., Johns, M.: How emotion and personality effect the utility of alternative decisions: A terrorist target selection case study. In: Proceedings of the 10th Conference on Computer Generated Forces and Behavioral Representation (2001)
Rothkrantz, L.J.M., Pantic, M.: Automatic analysis of facial expressions: the state of the art. IEEE Transactions Pattern Analysis Machine Intelligence 22(12), 1424–1445 (2000)
Renault, O., Magnenat-Thalmann, N., Thalmann, D.: A vision-based approach to behavioural animation. Journal of Visualization and Computer Animation 1(1), 18–21 (1990)
Shahabi, C., McLaughlin, M.L., Sukhatme, G.: Haptic museum. Technical Report, Information Laboratory, University of Southern California (2000)
Marsella, S., Gratch, J.: A step toward irrationality: using emotion to change belief. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 334–341 (2002)
Marsella, S., Gratch, J.: Modeling coping behavior in virtual humans: Don’t worry, be happy. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems (2003)
Mccrae, R.R., John, P.O.: An introduction to the five-factor model and its applications. Journal of Personality 60, 175–215 (1992)
McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press (1992)
McTear, M.: Spoken dialogue technology: Enabling the conversational user interface. ACM Computing Survey 34(1) (2002)
Vance, J.M., Jerney, M.M.: Gesture recognition in virtual environments: A review and framework for future development. Iowa State University Human Computer Interaction, Technical Report ISU-HCI-2005-01 (2005)
Morishima, S.: Real-time talking head driven by voice and its application to communication and entertainment. In: International Conference on Auditory Visual Speech Processing (1998)
Muller, J., Pischel, M.: The agent architecture interrap: Concept and application. Technical Report RR-93-26, DFKI Saarbrucken (1993)
Nareyek, A.: Languages for programming bdi-style agents: An overview. In: Proc. of the Second International Conference on Computers and Games (2000)
Nijholt, A.: Humor and embodied conversational agents. CTIT Technical Report series No. 03-03, University of Twente, ISSN 1381-3625 (2003)
Noh, J., Neumann, U.: A survey of facial modeling and animation techniques. USC Technical Report 99-705 (1998)
Badler, N.I., Palmer, O., Bindiganavale, R.: Fast multi-level adaptation for interactive autonomous characters. Communications of ACM 42(8), 65–73 (1999)
Forsyth, F., Arikan, O.: Interactive motion generation from examples. ACM Transactions on Graphics 21(3), 483–490 (2002)
Forsyth, F., Arikan, O., O’Brien, J.F.: Motion synthesis from annotations. ACM Transactions on Graphics 22(3), 402–408 (2003)
Burghouts, G.J., op den Akker, H.J.A., Heylen, D.K.J., Poel, M., Nijholt, A.: An action selection architecture for an emotional agent. In: Proceedings of 16th International FLAIRS Conference, pp. 293–297 (2003)
Insko, B.E., Meehan, M.J., Whitton, M.C., Brooks Jr., F.P.: Passive haptics significantly enhances virtual environments. Computer Science Technical Report, University of North Carolina (2001)
Magnenat-Thalmann, N., Kalra, P., Mangili, A., Thalmann, D.: Simulation of facial muscle actions based on rational free form deformation. In: Proceedings Eurographics 1992, pp. 59–69 (1992)
Bianchi-Berthouze, N., De Silva, P.R.: Modeling human affective postures: an information theoretic characterization of posture features. Journal of Visualization and Computer Animation 15(3-4), 269–276 (2004)
Oudeyer, P.-Y.: The production and recognition of emotions in speech: features and algorithms. International Journal in Human-Computer Studies, special issue on Affective Computing 59(1-2), 157–183 (2003)
Magnenat-Thalmann, N., Papagiannakis, G., Kim, H.: Believability and presence in mobile mixed reality environments. In: IEEE VR 2005 Workshop on Virtuality Structures (2005)
Parke, F.: Computer generated animation faces. In: ACM Annual Conference (1972)
Pelachaud, C.: Communication and Coarticulation in Facial Animation. University of Pennsylvania (1991)
Perlin, K., Goldberg, A.: Improv: A system for scripting interactive actors in virtual worlds. In: Computer Graphics. Annual Conference Series, vol. 30, pp. 205–216 (1996)
Peters, C., O’Sullivan, C.: Synthetic vision and memory for autonomous virtual humans. Computer Graphis Forum 21(4) (2002)
Peters, C., Sullivan, C.: Bottom-up visual attention for virtual human animation. In: CASA 2003: Proceedings of the 16th International Conference on Computer Animation and Social Agents (2003)
Picard, R.W.: Affective computing. MIT Press, Cambridge (1997)
Pinho, M., Bowman, D., Freitas, C.: Cooperative object manipulation in immersive virtual environments: Framework and techniques. In: Proceedings of ACM Virtual Reality Software and Technology, pp. 171–178 (2002)
Plutchik, R.: A general psychoevolutionary theory of emotion. In: Plutchik, R., Kellerman, H. (eds.) Emotion: Theory, research, and experience, vol. 1, pp. 2–33 (1980)
Cassell, J., Sullivan, J., Prevost, S., Churchill, E.: Embodied Conversational Agents. MIT Press, Cambridge (2000)
Soar Project. University of michigan. project homepage Accessed (September 2006), http://sitemaker.umich.edu/soar
Rabie, T.F., Terzopoulos, D.: Active perception in virtual humans. In: Vision Interface 2000 Montreal, Canada (2000)
Reynolds, C.W.: Flocks, herds, and schools: a distributed behavioral model. In: SIGGRAPH 1987 Conference Proceedings, vol. 21(4), pp. 25–34 (1987)
Rickel, J., Johnson, W.L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13, 343–382 (1999)
Ruttkay, Z., Noot, H.: Variations in gesturing and speech by gestyle. International Journal of Human-Computer Studies, Special Issue on Subtle Expressivity for Characters and Robots 62(2), 211–229 (2005)
Becker, C., Kopp, S., Wachsmuth, I.: Simulating the emotion dynamics of a multimodal conversational agent. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS 2004. LNCS (LNAI), vol. 3068, pp. 154–165. Springer, Heidelberg (2004)
Magnenat-Thalmann, N., Kshirsagar, S., Garchery, S.: Feature point based mesh deformation applied to mpeg-4 facial animation. In: Proceedings of the IFIP DEFORM 2000 Workshop and AVATARS 2000 Workshop on Deformable Avatars, pp. 23–34 (2000)
Pelachaud, C., Pasquariello, S.: Greta: A simple facial animation engine. In: 6th Online World Conference on Soft Computing in Industrial Appications (2001)
Salisbury, K., Conti, F., Barbagli, F.: Passive haptics significantly enhances virtual environments. Computer Science Technical Report, University of North Carolina 24(2), 24–32 (2004)
Savioja, L.: Modeling Techniques for Virtual Acoustics. PhD thesis, Helsinki University of Technology (1999)
Schroder, M.: Emotional speech synthesis: A review. In: Proceedings of Eurospeech 2001 (2001)
Catizone, R., Setzer, A., Wilks, Y.: State of the art in dialogue management (2002)
Sheridan, T.B.: Musings on telepresence and virtual presence. Presence-Connect 1, 120–126 (1992)
Badler, N., Bindiganavale, R., Bourne, J., Palmer, M., Shi, J., Schuler, W.: A parameterized action representation for virtual agents. In: Workshop on Embodied Conversational Characters (1998)
Slater, M.: A note on presence terminology. Presence-Connect 3 (2003)
Slater, M., Steed, A.: A virtual presence counter. Presence 9(5), 413–434 (2000)
Stead, L., Goulev, P., Evans, C., Mamdani, E.: Journal of ubiquitous computing. ACM Transactions on Graphics 8(3-4), 282–290 (2004)
Steed, A.: A survey of virtual reality literature. In Technical Report (1993)
Stronks, J.J.S.: Friendship relations with embodied conversational agents: Integrating social psychology in eca design. Master Thesis, Faculty of Computer Science, University of Twente (2002)
Sturman, D.J., Zeltzer, D.: A survey of glove-based input. IEEE Computer Graphics and Applications 14(1), 30–39 (1994)
Wardhani, A., Su, W., Pham, B.: High-level control posture of story characters based on personality and emotion. In: Pisan, Y. (ed.) Proceedings IE 2005, The Second Australasian Interactive entertainment conference, pp. 179–186 (2005)
Sutherland, I.: A head-mounted three-dimensional display. In: Proceedings of the Fall Joint Computer Conference, vol. 33, pp. 757–764 (1968)
Shin, S.Y., Kim, T., Park, S.: Rhythmic-motion synthesis based on motion-beat analysis. ACM Transactions on Graphics 22(3), 392–401 (2003)
Tang, T.W., Wan, R.: Integrated learning for interactive synthetic characters. In: WSCG - Short Papers, pp. 137–144 (2002)
Garcia-Rojas, A., Gutierrez, M., Thalmann, D., Vexo, F.: Multimodal authoring tool for populating a database of emotional reactive actions. In: Renals, S., Bengio, S. (eds.) MLMI 2005. LNCS, vol. 3869, pp. 206–217. Springer, Heidelberg (2006)
Noser, H., Renault, O., Thalmann, D., Magnenat Thalmann, N.: Navigation for digital actors based on synthetic vision memory and learning. Computers and Graphics 19(1), 7–19 (1995)
Blumberg, B., Todd, P., Maes, P.: No bad dogs: Ethological lessons for learning in hamsterdam. In: Proceedings of the 4th International Conference on the Simulation of Adaptive Behavior (1996)
Tollmar, K., Demirdjian, D., Darrell, T.: Navigating in virtual environments using a vision-based interface. In: Proceedings of the third Nordic conference on Human-computer interaction, pp. 113–120 (2004)
Tomlinson, B., Blumberg, B.: Alphawolf: Social learning, emotion and development in autonomous virtual agents. In: First GSFC/JPL Workshop on Radical Agent Concepts (2002)
Tomlinson, B.: From linear to interactive animation: how autonomous characters change the process and product of animating. ACM Computers in Entertainment 3(1) (2005)
Rickel, J., Marsella, S., Gratch, J., Hill, R., Traum, D., Swartout, W.: Toward a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems 17(4), 32–38 (2002)
TRINDIKIT (September 2006), http://www.ling.gu.se/projekt/trindi/trindikit/index.html
Trung, H.B.: Multimodal dialogue management - state of the art. Human Media Interaction Department, University of Twente (2006)
Funkhouser, T., Tsingos, N., Jot, J.M.: Survey of methods for modeling sound propagation in interactive virtual environment systems. Presence and Teleoperation (2003)
Tu, X., Terzopoulos, D.: Artificial fishes: physics, locomotion, perception, behavior. In: Proceedings SIGGRAPH 1994, vol. 21(4), pp. 43–50 (1994)
Tu, X., Terzopoulos, D.: Perceptual modeling for the behavioral animation of fishes. In: Proc. Pacific Graphics 1994, pp. 165–178. World Scientific, Singapore (1994)
Turk, M.: Gesture recognition. In: Stanney, K. (ed.) Handbook of Virtual Environments: Design, Implementation and Applications, pp. 113–120. Lawrence Erlbaum Associates, Mahwah (2002)
Schuemie, M.J., Straaten, P., van der Krijn, M., van der Mast, C.: Research on presence in virtual reality: A survey. Presence-Connect 4(2), 183–202 (2001)
van Waveren, J.M.P.: The quake 3 arena bot. Master thesis. Faculty ITS, University of Technology Delft (2001)
Cassell, J., Stocky, T., Bickmore, T., Gao, Y., Nakano, Y., Ryokai, K., Tversky, D., Vaucelle, C., Vilhjálmsson, H.: MACK: Media lab autonomous conversational kiosk. In: Proceedings of Imagina 2002 (2002)
Veldhuis, J.: Expressing personality through head node and eye gaze. In: 5th Twente Student Conference on IT (2006)
Ververidis, D., Kotropoulos, C.: Emotional speech recognition: Resources, features, and methods. Speech Communication 48 (2006)
Cassell, J., Vilhjálmsson, H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH (2001)
Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., Yan, H.: Embodiment in conversational interfaces: Rea. In: Proceedings of the CHI 1999 Conference (1999)
Mascardi, D.A.V., Demergasso, D.: Languages for programming bdi-style agents: An overview. In: WOA 2005 (2005)
Väänänen, R.: Parametrization, auralization, and authoring of room acoustics for virtual reality applications. In: Electrical and Communications Engineering (2003)
Vosinakis, S., Panayiotopoulos, T.: Simhuman: A platform for real-time virtual agents with planning capabilities. In: Proceedings of the 3rd International Workshop on Intelligent Virtual Agents (2001)
Wang, F., Mckenzie, E.: Virtual life in virtual environments. CSG report ECS-CSG-44-98, Institute for Computing Systems Architecture, University of Edinburgh (1998)
Waters, K., Levergood, T.: Decface: A system for synthetic face applications. Multimedia Tools and Applications 1(4), 349–366 (1988)
Weizenbaum, J.: Eliza-a computer program for the study of natural language communication between man and machine. ACM Computing Survey 9(1), 36–45 (1966)
Whissel, C.M.: The dictionary of affect in language. In: Plutchik, R., Kellerman, H. (eds.) Emotion: Theory, research, and experience. The measurement of emotions, vol. 4 (1980)
Wikipedia-Behaviour (accessed September 2006), http://en.wikipedia.org/wiki/behaviour
William, K.D., McNeely, W.A.: Six degrees-of-freedom haptic rendering using voxel sampling. In: ACM Sigraph Course Notes, pp. 401–408 (1999)
Wilson, I.: The artificial emotion engine, driving emotional behaviour. Artificial Intelligence and Interactive Entertainment (2000)
Wooldridge, M.: Reasoning about rational agents. MIT Press, Cambridge (2000)
Woolridge, M.: An Introduction to MultiAgent Systems. John Wiley and Sons, Chichester (2002)
Wang, T., Li, Y., Shum, H.Y.: Motion texture: a two-level statistical model for character motion synthesis. ACM Transactions on Graphics 21(3), 465–472 (2002)
Chang, Y., Ezzat, T.: Transferable videorealistic speech animation. In: ACM Siggraph/Eurographics Symposium on Computer Animation, Los Angeles, pp. 21–28 (2005)
Turunen, M., Wilks, Y., Catizone, R.,: Companions consortium: State of the art papers. 2 (2006)
Zhang, M.: Overview of speech recognition and related machine learning techniques. Technical Report, CS-TR-01/15 (2001)
Chi, D.M., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Siggraph 2000, Computer Graphics Proceedings (2000)
Badler, N., Allbeck, J., Zhao, L., Byun, M.: Representing and parameterizing agent behaviors. In: Computer Animation, pp. 133–143 (2002)
Zhao, W., Madhavan, V.: Virtual assembly operations with grasp and verbal interaction. In: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, pp. 245–254 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kasap, Z., Magnenat-Thalmann, N. (2008). Intelligent Virtual Humans with Autonomy and Personality: State-of-the-Art. In: Magnenat-Thalmann, N., Jain, L.C., Ichalkaranje, N. (eds) New Advances in Virtual Humans. Studies in Computational Intelligence, vol 140. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79868-2_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-79868-2_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-79867-5
Online ISBN: 978-3-540-79868-2
eBook Packages: EngineeringEngineering (R0)