Abstract
We present a method to solve shape-from-shadow using shadow graphs which give a new graph-based representation for shadow constraints. It can be shown that the shadow graph alone is enough to solve the shape-from-shadow problem from a dense set of images. Shadow graphs provide a simpler and more systematic approach to represent and integrate shadow constraints from multiple images. To recover shape from a sparse set of images, we propose a method for integrated shadow and shading constraints. Previous shape-from-shadow algorithms do not consider shading constraints while shape-from-shading usually assumes there is no shadow. Our method is based on collecting a set of images from a fixed viewpoint as a known light source changes its position. It first builds a shadow graph from shadow constraints from which an upper bound for each pixel can be derived if the height values of a small number of pixels are initialized properly. Finally, a constrained optimization procedure is designed to make the results from shape-from-shading consistent with the upper bounds derived from the shadow constraints. Our technique is demonstrated on both synthetic and real imagery.
Chapter PDF
Similar content being viewed by others
References
P. Belhumeur and D. Kriegman. What is the set of images of an object under all possible illumination conditions? Int. Journal Comp. Vision, 28(3):1–16, 1998.
P. Belhumeur, D. Kriegman, and A. Yuille. The bas-relief ambiguity. In IEEE Conf. on Comp. Vision andPatt. Recog., pages 1040–1046, 1997.
K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink. Reflectance and texture of real-world surfaces. In Proceedings of CVPR, pages 151–157, 1997.
M. Daum and G. Dudek. On 3-d surface reconstruction using shape from shadows. In IEEE Conf. on Comp. Vision and Patt. Recog., pages 461–468, 1998.
P. Dupuis and J. Oliensis. Shape from shading: Provably convergent algorithms and uniqueness results. In Computer Vision-ECCV 94, pages 259–268, 1994.
Fsqp software. http://gachinese.com/aemdesign/FSQPframe.htm. Originally developed at the Institute for Systems Research, University of Maryland.
A. Georghiades, P. Belhumeur, and D. Kriegman. Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting. In IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes, pages 47–54, 1999.
R. Hassin and S. Rubinstein. Approximations for the maximum acyclic subgraph problem. Information Processing Letters, 51:133–140, 1994.
M. Hatzitheodorou. The derivation of 3-d surface shape from shadows. In Proc. Image Understanding Workshop, pages 1012–1020, 1989.
B.K.P. Horn and M.J. Brooks. The variational approach to shape from shading. Computer Vision, Graphics & Image Processing, 33:174–208, 1986.
K. Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Trans. Patt. Anal. Mach. Intel., 3(6):661–669, 1981.
D. Jacobs. Linear fitting with missing data: Applications to structure from motion and characterizing intensity images. In IEEE Conf. on Comp. Vision and Patt. Recog., pages 206–212, 1997.
J. Kender and E. Smith. Shape from darkness. In Int. Conf. on Computer Vision, pages 539–546, 1987.
D.J. Kriegman and P.N. Belhumeur. What shadows reveal about object structure. In Computer Vision-ECCV 98, 1998.
Y.G. Leclerc and A.F. Bobick. The direct computation of height from shading. In Proc. of IEEE Conf. on Comp. Vision and Patt. Recog., pages 552–558, 1991.
X. Liu, Y. Yu, and H.-Y Shum. Synthesizing bidirectional texture functions for real-world surfaces. In Proceedings of SIGGRAPH, pages 97–106, 2001.
S.K. Nayar, K. Ikeuchi, and T. Kanade. Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Trans. Robotics and Automation, 6(4):418–431, 1990.
S.K. Nayar, K. Ikeuchi, and T. Kanade. Shape from interreflections. International Journal of Computer Vision, 6(3):2–11, 1991.
W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling. Numerical Recipes in C. Cambridge Univ. Press, New York, 1988.
S.A. Shafer. Shadows and silhouettes in computer vision. Kluwer Academic Publishers, 1985.
A. J. Stewart and M.S. Langer. Towards accurate recovery of shape from shading under diffuse lighting. IEEE Patt. Anal. Mach. Intel., 19(9): 1020–1025, 1997.
R.J. Woodham. Photometric method for determining surface orientation from multiple images. In B.K.P. Horn and M.J. Brooks, editors, Shape from Shading, pages 513–532. MIT Press, 1989.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yu, Y., Chang, J.T. (2002). Shadow Graphs and Surface Reconstruction. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47967-8_3
Download citation
DOI: https://doi.org/10.1007/3-540-47967-8_3
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43744-4
Online ISBN: 978-3-540-47967-3
eBook Packages: Springer Book Archive