Abstract
We present a method that estimates high level animation parameters (muscle contractions, eye movements, eye lids opening, jaw motion and lips contractions) from a marker-less face image sequence. We use an efficient appearance-based tracker to stabilise images of upper (eyes and eyebrows) and lower (mouth) face. By using a set of stabilised images with known animation parameters, we can learn a re-animation matrix that allows us to estimate the parameters of a new image. The system is able to re-animate a 32 DOF 3D face model in real-time.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jun-yong, N.U.: Expression cloning. In: Proc. of SIGGRAPH, pp. 277–288. ACM, New York (2001)
Cohn, J., Kanade, T., Moriyama, T., Ambadar, Z., Xiao, J., Ga, J., Imamura, H.: A comparative study of alternative facs coding algorithms. Technical report, Robotics Institute, Carnegie Mellon University (2001)
Tian, Y., Kanade, T., Cohn, J.: Recognizing action units for facial expression analysis. PAMI 23, 97–115 (2001)
Valente, S., Andrés, A.C., Del Valle, J.L.D.: Analysis and reproduction of facial expressions for realistic communicating clones. Journal of VLSI Signal Processing 29, 41–49 (2001)
Ahlberg, J.: Using the active appearence algorithm for face and facial feature tracking. In: Proc. of 2nd Int. Workshop on Recognition, analisys and tracking of faces and gestures in real time systems, RATFG-RTS 2001, pp. 68–72 (2001)
Terzopoulos, D., Waters, K.: Analysis and synthesis of facial image sequences using physical and anatomical models. PAMI 15 (1997)
Buck, I., Finkelstein, A., Jacobs, C., Klein, A., Salesin, D.H., Seims, J., Szeliski, R., Toyama, K.: Performance-driven hand-drawn animation. In: Proc. of Int. Symposium on Non Photorealistic Animation and Rendering, NPAR’2000, pp. 101–108 (2000)
Buenaposada, J., Muõz, E., Baumela, L.: Efficient appearance-based tracking. In: Proc. of Workshop on Nonrigid and Articulated Motion, IEEE, Los Alamitos (2004)
Hager, G., Belhumeur, P.: Efficient region tracking with parametric models of geometry and illumination. PAMI 20, 1025–1039 (1998)
Black, M.J., Jepson, A.D.: Eigentracking: Robust matching and tracking of articulated objects using a view-based representation. IJCV 26, 63–84 (1998)
Hou, X., Li, S.Z., Zhang, H., Cheng, Q.: Direct appearance models. In: Proc. of CVPR, IEEE, Los Alamitos (2001)
Parke, F.I., Waters, K.: Computer Facial Animation. AK Peters Ltd (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Buenaposada, J.M., Muñoz, E., Baumela, L. (2005). Performance Driven Facial Animation by Appearance Based Tracking. In: Marques, J.S., Pérez de la Blanca, N., Pina, P. (eds) Pattern Recognition and Image Analysis. IbPRIA 2005. Lecture Notes in Computer Science, vol 3522. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11492429_58
Download citation
DOI: https://doi.org/10.1007/11492429_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26153-7
Online ISBN: 978-3-540-32237-5
eBook Packages: Computer ScienceComputer Science (R0)