Abstract
In this paper, we present an efficient algorithm for reconstructing 3D head model from a single 2D image based on using a 3D eigenhead model. This system is composed of two components, offline training of the eigenhead model and online reconstruction of a 3D head model. For the first part, we propose a new 3D head alignment algorithm based on an iterative coarse-to-fine scheme to establish dense point correspondences between 3D head model in the cylindrical coordinate to align the 3D head models in the training data set. In addition, we apply the radial basis function technique to establish dense correspondences between each 3D face model and a reference face model, followed by the principal component analysis technique to compute the statistical eigenhead model. For the 3D face reconstruction from a single image, the proposed algorithm finds the best linear combination of the eigenhead bases that minimizes an energy function composed of distances between the corresponding facial feature points and a one-way partial Haussdorf distance between the facial contours in the image domain. This energy minimization is accomplished by the iterative Levenberg-Marquardt algorithm with the initial guess determined by solving a linear system derived from the image projection constraints for the corresponding facial feature points. Experimental results show that the proposed 3D face reconstruction algorithm provides satisfactory results and takes less than 10 seconds on a regular PC.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Turk, M., Pentland, A.: Eigenfaces for recognition. Int. J. Cognitive Neuroscience 3, 72–86 (1991)
Cootes, B.T., Taylor, C., Cooper, D., Graham, J.: Active Shape Model – their training and application. Computer Vision and Image Understading 61(1), 38–59 (1995)
Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D faces. In: Computer Graphics Proc. SIGGRAPH, pp. 187–194 (1999)
Cootes, T.F., Cooper, D.H., Taylor, C.J., Graham, J.: A trainable method of parametric shape description. Image and Vision Computing, 289–294 (1992)
Moghaddam, B., Lee, J.H., Pfister, H., Machiraju, R.: Model-based 3D face Capture with Shape-from-Silhouettes. Int. W., 20–27 (2003)
Lai, S.H., Chen, Y.L.: Learning a statistical 3D geometric head model. In: Int. C. SPIE (2003)
Carr, J.C., Beatson, R.K., Cherrie, J.B., Mitchell, T.J., Fright, W.R., McCallum, B.C.: Reconstruction and Representation of 3D Objects with Radial Basis Functions. In: SIGGRAPH, pp. 67–76 (2001)
Horn, B.K.P.: Close-form solution of absolute orientation using unit quaternions. JOSAA 4(4) (1987)
Levenberg, K.: A Method for the Solution of Certain Non-linear Problems in Least Squares. Quarterly of Applied Mathematics 2(2), 164–168 (1944)
Sim, T., Baker, S., Bsat, M.: The CMU Pose, Illumination, and Expression (PIE) Data-base. In: Proc. Int. C. Automatic Face and Gesture Recognition, pp. 53–58 (2002)
Atick, J.J., Griffin, P.A., Redlich, A.N.: Statistical Approach to Shape from Shading: Reconstruction of 3D Face Surfaces from Single 2D Images. Computation in Neurological Systems 7(1) (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, SF., Lai, SH. (2006). Efficient 3D Face Reconstruction from a Single 2D Image by Combining Statistical and Geometrical Information. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3852. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612704_43
Download citation
DOI: https://doi.org/10.1007/11612704_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31244-4
Online ISBN: 978-3-540-32432-4
eBook Packages: Computer ScienceComputer Science (R0)