Abstract
Facial expressions and speech are means to convey information. They can be used to reinforce speech or even complementary to speech. The main goal of our research is to investigate how facial expressions can be associated to text-based speech in an automated way. As a first step we studied how people attach smileys to text in chat sessions and facial expressions to text balloons in cartoons. We developed an expert system with a set of rules that describe dependencies between text and facial expressions. The specific facial expressions are stored in a nonverbal dictionary and we developed a search engine for that dictionary. Finally we present a tool to generate 3D facial animations.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
P. Ekman, Movements with precise meanings. Journal of Communication, 26, pp. 14–26, 1976.
D. Efron, Gesture, Race and Culture, The Hague, Mouton & Company, 1972.
C. Pelachaud, N.I. Badler, and M. Steedman, Generating facial expressions for speech, Cognitive Science, vol 20, no. 1, pp. 1–46, 1996.
P. Ekman and W.F. Friesen, Unmasking the Face. Englewood Cliffs, New Jersey, USA: Prentice-Hall, Inc., 1975.
A. Wojdel and L.J.M. Rothkrantz, A Performance Based Parametric Model for Facial Animation, to be published in Proceedings of IEEE International Conference on Multimedia and Expo, New York City, NY, USA, August 2000.
M. Pantic and L.J.M. Rothkrantz, Expert system for automatic analysis of facial expressions, to appear in Image and Vision, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rothkrantz, L.J.M., Wojdel, A. (2000). A Text Based Talking Face. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2000. Lecture Notes in Computer Science(), vol 1902. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45323-7_55
Download citation
DOI: https://doi.org/10.1007/3-540-45323-7_55
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41042-3
Online ISBN: 978-3-540-45323-9
eBook Packages: Springer Book Archive