Abstract
State-of-the-art computer graphics can give autonomous agents a compelling appearance as animated virtual characters. Typically the agents are directly responsible for controlling their graphical representation, but this places too much burden on the agents that already deal with difficult high-level tasks such as dialog planning. This paper presents work, done in the context of an interactive language and culture training system, on a new kind of engine that fits between the high level cognitive agent models and the animated graphics that represent them. This is a social engine that generates socially appropriate nonverbal behavior based on rules reflecting social norms. Similar to modular physics engines, the social engine introduces a re-usable component that can heighten believability of animated agents in games and simulations with relatively little effort.
Chapter PDF
Similar content being viewed by others
References
Bailenson, J., Blascovich, J.: Avatars. In: Bainbridge, W.S. (ed.) Encyclopedia of Human-Computer Interaction. pp. 64–68, Berkshire Publishing Group (2004)
Cassell, J., Bickmore, T.: Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents. In: User Modeling and User-Adapted Interaction, vol. 13, pp. 89–132. Kluwer Academic Publishers, Boston (2003)
Cassell, J., Sullivan, J., Prevost, S., et al. (eds.): Embodied conversational agents. MIT Press, Cambridge (2000)
Cassell, J., Bickmore, T., Billinghurst, M., et al.: Embodiment in Conversational Interfaces: Rea. In: CHI, pp. 520–527. ACM Press, New York (1999)
Cassell, J., Vilhjalmsson, H., Bickmore, T.: BEAT: The Behavior Expression Animation Toolkit. In: SIGGRAPH, pp. 477–486. ACM Press, New York (2001)
Gillies, M., Ballin, D.: A Model of Interpersonal Attitude and Posture Generation. In: Rist, T., Aylett, R., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 88–92. Springer, Heidelberg (2003)
Gratch, J., Stacy, M.: Evaluating the Modeling and use of Emotion in Virtual Humans. In: Autonomous Agents and Multi-Agent Systems, ACM Press, New York (2004)
Johnson, W.L., Marsella, S., Vilhjalmsson, H.: The DARWARS Tactical Language Training System. The Interservice/Industry Training, Simulation and Education Conference, SSA (2004)
Kopp, S., Krenn, B., Marsella, S., et al.: Towards a Common Framework for Multimodal Generation in ECAs: The Behavior Markup Language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, Springer, Heidelberg (2006)
Lee, J., Marsella, S.: Nonverbal Behavior Generator for Embodied Conversational Agents. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 243–255. Springer, Heidelberg (2006)
Patel, J., Parker, R., Traum, D.: Simulation of Small Group Discussions for Middle Level of Detail Crowds. In: Army Science Conference (2004)
Pelachaud, C., Bilvi, M.: Computational model of believable conversational agents. In: Huget, M. (ed.) Communication in MAS: Background, Current Trends and Future, Springer, Heidelberg (2003)
Prada, R., Paiva, A.: Synthetic Group Dynamics in Entertainment Scenarios. In: International Conference on Advances in Computer Entertainment Technology, ACM Press, New York (2005)
Prendinger, H., Ishizuka, M.: Social Role Awareness in Animated Agents. In: AGENTS 2001, ACM Press, New York (2001)
Rehm, M., Andre, E., Nisch, M.: Let’s Come Together - Social Navigation Behaviors of Virtual and Real Humans. In: Maybury, M., Stock, O., Wahlster, W. (eds.) INTETAIN 2005. LNCS (LNAI), vol. 3814, pp. 124–133. Springer, Heidelberg (2005)
Rehm, M., Endrass, B., Andre, E.: A Plug-and-Play Framework for Theories of Social Group Dynamics. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 465–466. Springer, Heidelberg (2006)
Shao, W., Terzopoulos, D.: Autonomous Pedestrians. In: ACM SIGGRAPH Symposium on Computer Animation, ACM Publishing, New York (2005)
Si, M., Marsella, S., Pynadath, D.: Thespian: Modeling Socially Normative Behavior in a Decision-Theoretic Framework. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 369–382. Springer, Heidelberg (2006)
Si, M., Stacy, M., Pynadath, D.: Thespian: Using Multi-Agent Fitting to Craft Interactive Drama. In: International Conference on Autonomous Agents and Multi-Agent Systems, pp. 21–28. ACM Press, New York (2005)
Thorisson, K.R.: Real-Time Decision Making in Multimodal Face-to-Face Communication. In: Autonomous Agents, pp. 16–23. ACM Press, New York (1998)
Vilhjalmsson, H., Samtani, P.: MissionEngine: Multi-System Integration using Python in the Tactical Language Project. PyCon, Python Software Foundation (2005)
Vilhjalmsson, H.: Animating Conversation in Online Games. In: Rauterberg, M. (ed.) ICEC 2004. LNCS, vol. 3166, pp. 139–150. Springer, Heidelberg (2004)
Vinayagamoorthy, V., Gillies, M., Steed, A., et al.: Building Expression into Virtual Characters. EUROGRAPHICS State of The Art Report, vol. 2006. The Eurographics Association (2006)
Wang, N., Johnson, W.L., Mayer, R.E., et al.: The Politeness Effect: Pedagogical Agents and Learning Outcomes. International Journal of Human-Computer Interaction 22 (2007)
Warwick, W., Vilhjalmsson, H.: Engendering Believable Communicative Behaviors in Synthetic Entities for Tactical Language Training: An Interim Report. Behavior Representation in Modeling and Simulation. In: SISO (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vilhjalmsson, H., Merchant, C., Samtani, P. (2007). Social Puppets: Towards Modular Social Animation for Agents and Avatars. In: Schuler, D. (eds) Online Communities and Social Computing. OCSC 2007. Lecture Notes in Computer Science, vol 4564. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73257-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-73257-0_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73256-3
Online ISBN: 978-3-540-73257-0
eBook Packages: Computer ScienceComputer Science (R0)