Abstract
Fitting parameterized 3D shape and general reflectance models to 2D image data is challenging due to the high dimensionality of the problem. The proposed method combines the capabilities of classical and photometric stereo, allowing for accurate reconstruction of both textured and non-textured surfaces. In particular, we present a variational method implemented as a PDE-driven surface evolution interleaved with reflectance estimation. The surface is represented on an adaptive mesh allowing topological change. To provide the input data, we have designed a capture setup that simultaneously acquires both viewpoint and light variation while minimizing self-shadowing. Our capture method is feasible for real-world application as it requires a moderate amount of input data and processing time. In experiments, models of people and everyday objects were captured from a few dozen images taken with a consumer digital camera. The capture process recovers a photo-consistent model of spatially varying Lambertian and specular reflectance and a highly accurate geometry.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vision 47, 7–42 (2002)
Faugeras, O., Keriven, R.: Variational principles, surface evolution, pde’s, level set methods and the stereo problem. IEEE Trans. Image Processing 7, 336–344 (1998)
Robert, L., Deriche, R.: Dense depth map reconstruction: A minimization and regularization approach which preserves discontinuities. In: ECCV 1996, pp. 439–451 (1996)
Yang, R., Pollefeys, M., Welch, G.: Dealing with textureless regions and specular highlights - a pregressive space carving scheme using a novel photo-consistency measure. In: ICCV (2003)
Esteban, C.H., Schmitt, F.: Silhouette and stereo fusion for 3d object modeling. Computer Vision and Image Understanding 96, 367–392 (2004)
Fua, P., Leclerc, Y.: Object-centered surface reconstruction: combining multi-image stereo shading. In: Image Understanding Workshop, pp. 1097–1120 (1993)
Jin, H., Yezzi, A., Soatto, S.: Stereoscopic shading: Integrating shape cues in a variational framework. In: CVPR, pp. 169–176 (2000)
Zhang, L., Curless, B., Hertzmann, A., Seitz, S.M.: Shape and motion under varying illumination: Unifying structure from motion, photometric stereo, and multi-view stereo. In: ICCV (2003)
Weber, M., Blake, A., Cipolla, R.: Towards a complete dense geometric and photometric reconstruction under varying pose and illumination. In: BMVC (2002)
Yu, T.-L., Xu, N., Ahuja, N.: Shape and view independent reflectance map from multiple views. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 602–615. Springer, Heidelberg (2004)
Jin, H., Soatto, S., Yezzi, A.: Multi-view stereo reconstruction of dense shape and complex appearance. IJCV 63, 175–189 (2005)
Yu, T., Xu, N., Ahuja, N.: Recovering shape and reflectance model of non-lambertian objects from multiple views. In: CVPR (2004)
Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Siggraph (1997)
Sethian, J.: Level Set Methods. Cambridge University Press, Cambridge (1996)
Duan, Y., Yang, L., Qin, H., Samaras, D.: Shape reconstruction from 3D and 2D data using PDE-based deformable surfaces. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 238–251. Springer, Heidelberg (2004)
Caselles, V., Kimmel, R., Sapiro, G., Sbert, C.: Minimal surfaces based object segmentation. PAMI 19, 394–398 (1997)
Zhang, L., Seitz, S.: Image-based multiresolution modeling by surface deformation. Technical Report CMU-RI-TR-00-07, Carnegie Mellon University (2000)
Zach, C., Klaus, A., Hadwiger, M., Karner, K.: Accurate dense stereo reconstruction using graphics hardware. In: Eurographics 2003, pp. 227–234 (2003)
Ikeuchi, K., Sato, K.: Determining reflectance properties of an object using range and brightness images. PAMI 13, 1139–1153 (1991)
Lafortune, E.P., Foo, S.C., Torrance, K.E., Greenberg, D.P.: Non-linear approximation of reflectance functions. In: SIGGRAPH (1997)
Marschner, S.R.: Inverse rendering for computer graphics. PhD thesis, Cornell University (1998)
Baumberg, A., Lyons, A., Taylor, R.: 3D S.O.M. - a commercial software solution to 3d scanning. In: Vision, Video, and Graphics (VVG 2003), pp. 41–48 (2003)
Lensch, H.P.A., Goesele, M., Kautz, J., Heidrich, W., Seidel, H.P.: Image-based reconstruction of spatially varying materials. In: Eurographics Workshop on Rendering Techniques, pp. 103–114 (2001)
Lévy, B., Petitjean, S., Ray, N., Maillot, J.: Least squares conformal maps for automatic texture atlas generation. In: SIGGRAPH 2002, pp. 62–371 (2002)
Surazhsky, T., Magid, E., Soldea, O., Elber, G., Rivlin, E.: A comparison of gaussian and mean curvatures triangular meshes. In: ICRA 2003, pp. 1021–1026 (2003)
Lachaud, J.O., Montanvert, A.: Deformable meshes with automated topology changes for coarse-to-fine 3D surface extraction. Medical Image Analysis 3, 187–207 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Birkbeck, N., Cobzas, D., Sturm, P., Jagersand, M. (2006). Variational Shape and Reflectance Estimation Under Changing Light and Viewpoints. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_42
Download citation
DOI: https://doi.org/10.1007/11744023_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)