More Web Proxy on the site http://driver.im/

research-article

Multiple Illuminant Direction Detection with Application to Image Synthesis

Authors:

Yee-Hong YangAuthors Info & Claims

IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 23, Issue 8

Pages 915 - 920

https://doi.org/10.1109/34.946995

Published: 01 August 2001 Publication History

Abstract

In the early 1980s, Pentland observed that the human's eye is sensitive to the change of intensities. On an image of a smooth surface, the change of intensities is maximal whenever the illuminant direction is perpendicular to the normal of the surface. This motivates us to introduce the concept of critical points, where the surface normal is perpendicular to some light source direction. Apparently, the illuminant direction has a simple geometric relationship with the corresponding critical points. In this paper, for simplicity reasons, we restrict our discussions to the shading of a Lambertian sphere of known size in a multiple distant light source environment. A novel global representation of the intensity function is derived. Based on this intensity characterization, the least-squares and iteration techniques are used to determine critical points and, thus, the light source directions and their intensities if certain conditions are satisfied. The performance of this new approach is evaluated using both synthetic images and real images. As an application, we use it as a tool to determine light sources in real image synthesis. The experimental results show that this technique can be used to superimpose synthetic objects with a real scene.

References

[1]

M. Brooks and B. Horn, "Shape and Source from Shading,"Proc. Ninth Int'l Joint Conf. Artificial Intelligence, pp. 932-936, 1985.

[2]

W. Chojnacki, M. Brooks, and D. Gibbins, "Revisiting Pentland's Estimator of Light Source Direction," J. Optimal Soc. Am. A, vol. 11, no. 1, pp. 118-124, 1994.

[3]

W. Chojnacki, M. Brooks, and D. Gibbins, "Can the Sun's Direction Be Estimated Prior to the Determination of Shapes?" Proc. Seventh Australian Joint Conf. Artificial Intelligence, pp. 530-535, 1994.

[4]

P. Debevec, "Rendering Synthetic Objects into Real Scenes," ACM Proc. SIGGRAPH '98, pp. 189-198, July 1998.

Digital Library

[5]

D. Gibbins, "Estimating Illumination Conditions for Shape from Shading," PhD. Thesis, School of Information Science and Eng., The Flinders Univ. of South Australia, May 1994.

[6]

D. Hougen and N. Ahuja, "Estimation of the Light Source Distribution and its Use in Integrated Shape Recovery from Stereo and Shading," Proc. IEEE Fourth Int'l Conf. Computer Vision, pp. 148-155, 1993.

[7]

C. Lee and A Rosenfeld, "Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate Systems," Artificial Intelligence, no. 26, pp. 125-143, 1985.

Digital Library

[8]

C.-Y. Kim, A. Petrov, H.-K. Choh, Y.-S. Seo, and I.-S. Kweon, "Illuminant Direction and Shape of a Bump," J. Optical Soc. Am., vol. 15, pp. 2341-2350, 1998.

[9]

A. Pentland, "Finding the Illuminant Direction," J. Optical Soc. Am., vol. 72, pp. 448-455, 2982.

[10]

A. Pentland, "Local Shading Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 170-187, 1984.

Digital Library

[11]

I. Sato, Y. Sato, and K. Ikeuchi, "Illumination Distribution from Shadows," IEEE Proc. Computer Vision and Pattern Recognition, pp. 306-312, 1999.

[12]

I. Sato, Y. Sato, and K. Ikeuchi, "Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene," IEEE Trans. Visualization and Computer Graphics, vol. 5, no. 1, pp. 1-12, 1999.

Digital Library

[13]

D. Weinshall, "The Shape and the Direction of Illumination from Shading on Occluding Contours," MIT Artificial Intelligence Memo, 1264, 1990.

[14]

Y. Yang and A. Yuille, "Source from Shading," IEEE Proc. Computer Vision and Pattern Recognition, pp. 534-539, 1991.

[15]

Y.-H. Yang, "An Experimental Study of Light Source Determination for Computer Graphics," Proc. Vision Interface '98, pp. 271-278, 1998.

[16]

Q. Zheng and R. Chellappa, "Estimation of Illumination, Albedo, and Shape from Shading," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 680-702, 1991.

Digital Library

[17]

Y. Zhang and Y.H. Yang, "Illuminant Direction Determination for Multiple Light Sources," IEEE Proc. Computer Vision and Pattern Recognition, pp. 269-276, 2000.

Cited By

Kaichi TKikuchi TOzasa Y(2021)Single-Shot Multi-light-Direction Searching on Discretized Lighting SpaceSN Computer Science10.1007/s42979-021-00546-32:2Online publication date: 9-Mar-2021
https://dl.acm.org/doi/10.1007/s42979-021-00546-3
Kaisheva MRodehorst V(2021)A Comparative Survey of Geometric Light Source Calibration MethodsPattern Recognition10.1007/978-3-030-92659-5_43(663-680)Online publication date: 28-Sep-2021
https://dl.acm.org/doi/10.1007/978-3-030-92659-5_43
Santo HWaechter MSamejima MSugano YMatsushita Y(2018)Light Structure from Pin Motion: Simple and Accurate Point Light Calibration for Physics-Based ModelingComputer Vision – ECCV 201810.1007/978-3-030-01219-9_1(3-19)Online publication date: 8-Sep-2018
https://dl.acm.org/doi/10.1007/978-3-030-01219-9_1
Show More Cited By

Index Terms

Multiple Illuminant Direction Detection with Application to Image Synthesis
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding

Recommendations

Multiple Light Source Detection

Abstract--This paper presents the V2R algorithm, a novel method for multiple light source detection using a Lambertian sphere as a calibration object. The algorithm segments the image of the sphere into regions that are each illuminated by a single ...
Estimation of Illuminant Direction and Intensity of Multiple Light Sources
ECCV '02: Proceedings of the 7th European Conference on Computer Vision-Part IV

This paper presents a novel scheme for locating multiple light sources and estimating their intensities from a pair of stereo images of a sphere. No prior knowledge of the location and radius of the sphere is necessary. The sphere surface is not assumed ...
Estimation of Illuminant Direction, Albedo, and Shape from Shading

A robust approach to the recovery of shape from shading information is presented. Assuming uniform albedo and Lambertian surface for the imaging model, two methods for estimating the azimuth of the illuminant are presented. One is based on local ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence Volume 23, Issue 8

August 2001

142 pages

ISSN:0162-8828

Issue’s Table of Contents

Copyright © Copyright © 1996 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 August 2001

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kaichi TKikuchi TOzasa Y(2021)Single-Shot Multi-light-Direction Searching on Discretized Lighting SpaceSN Computer Science10.1007/s42979-021-00546-32:2Online publication date: 9-Mar-2021
https://dl.acm.org/doi/10.1007/s42979-021-00546-3
Kaisheva MRodehorst V(2021)A Comparative Survey of Geometric Light Source Calibration MethodsPattern Recognition10.1007/978-3-030-92659-5_43(663-680)Online publication date: 28-Sep-2021
https://dl.acm.org/doi/10.1007/978-3-030-92659-5_43
Santo HWaechter MSamejima MSugano YMatsushita Y(2018)Light Structure from Pin Motion: Simple and Accurate Point Light Calibration for Physics-Based ModelingComputer Vision – ECCV 201810.1007/978-3-030-01219-9_1(3-19)Online publication date: 8-Sep-2018
https://dl.acm.org/doi/10.1007/978-3-030-01219-9_1
Kee EO'brien JFarid H(2014)Exposing Photo Manipulation from Shading and ShadowsACM Transactions on Graphics10.1145/262964633:5(1-21)Online publication date: 23-Sep-2014
https://dl.acm.org/doi/10.1145/2629646
Hwang GPark SKim S(2013)Components for bidirectional augmented broadcasting services on smart TVsMultimedia Tools and Applications10.1007/s11042-012-1307-667:3(687-708)Online publication date: 1-Dec-2013
https://dl.acm.org/doi/10.1007/s11042-012-1307-6
Lopez-Moreno JSundstedt VSangorrin FGutierrez DGutierrez DKearney JBanks MMania K(2010)Measuring the perception of light inconsistenciesProceedings of the 7th Symposium on Applied Perception in Graphics and Visualization10.1145/1836248.1836252(25-32)Online publication date: 23-Jul-2010
https://dl.acm.org/doi/10.1145/1836248.1836252
Takai TMaki ANiinuma KMatsuyama T(2009)Difference sphereComputer Vision and Image Understanding10.1016/j.cviu.2009.03.017113:9(966-978)Online publication date: 1-Sep-2009
https://dl.acm.org/doi/10.1016/j.cviu.2009.03.017
Hara KNishino KIkeuchi K(2008)Mixture of Spherical Distributions for Single-View RelightingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2007.116430:1(25-35)Online publication date: 1-Jan-2008
https://dl.acm.org/doi/10.1109/TPAMI.2007.1164
Wang HLin SYe XGu W(2008)Separating corneal reflections for illumination estimationNeurocomputing10.1016/j.neucom.2007.07.03971:10-12(1788-1797)Online publication date: 1-Jun-2008
https://dl.acm.org/doi/10.1016/j.neucom.2007.07.039
Xie FTao LXu GDi H(2006)Estimating illumination parameters in real space with application to image relightingProceedings of the 7th Asian conference on Computer Vision - Volume Part I10.1007/11612032_50(490-499)Online publication date: 13-Jan-2006
https://dl.acm.org/doi/10.1007/11612032_50
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents