More Web Proxy on the site http://driver.im/

Article

A lighting reproduction approach to live-action compositing

Authors:

Andreas Wenger,

Andrew Gardner,

Tim HawkinsAuthors Info & Claims

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

Pages 547 - 556

https://doi.org/10.1145/566570.566614

Published: 01 July 2002 Publication History

Abstract

We describe a process for compositing a live performance of an actor into a virtual set wherein the actor is consistently illuminated by the virtual environment. The Light Stage used in this work is a two-meter sphere of inward-pointing RGB light emitting diodes focused on the actor, where each light can be set to an arbitrary color and intensity to replicate a real-world or virtual lighting environment. We implement a digital two-camera infrared matting system to composite the actor into the background plate of the environment without affecting the visible-spectrum illumination on the actor. The color reponse of the system is calibrated to produce correct color renditions of the actor as illuminated by the environment. We demonstrate moving-camera composites of actors into real-world environments and virtual sets such that the actor is properly illuminated by the environment into which they are composited.

References

[1]

ALEXANDER, D. K., JONES, P. J., AND JENKINS, H. The artificial sky and heliodon facility at Cardiff University. In Proc. International Building Performance Simulation Association (IBPSA) (September 1999). (Abstract).

[2]

BEN-EZRA, M. Segmentation with invisible keying signal. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog. (June 2000), pp. 568-575.

[3]

BORGES, C. F. Trichromatic approximation for computer graphics illumination models. In Computer Graphics (Proceedings of SIGGRAPH 91) (July 1991), vol. 25, pp. 101-104.

Digital Library

[4]

BRINKMANN, R. The Art and Science of Digital Compositing. Morgan Kaufmann, 1999.

Digital Library

[5]

CHUANG, Y.-Y., ZONGKER, D. E., HINDORFF, J., CURLESS, B., SALESIN, D. H., AND SZELISKI, R. Environment matting extensions: Towards higher accuracy and real-time capture. In Proceedings of SIGGRAPH 2000 (July 2000), pp. 121-130.

Digital Library

[6]

DEBEVEC, P. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In SIGGRAPH 98 (July 1998).

Digital Library

[7]

DEBEVEC, P., HAWKINS, T., TCHOU, C., DUIKER, H.-P., SAROKIN, W., AND SAGAR, M. Acquiring the reflectance field of a human face. Proceedings of SIGGRAPH 2000 (July 2000), 145-156.

Digital Library

[8]

DEBEVEC, P. E., AND MALIK, J. Recovering high dynamic range radiance maps from photographs. In SIGGRAPH 97 (August 1997), pp. 369-378.

Digital Library

[9]

FAUGERAS, O. Three-Dimensional Computer Vision. MIT Press, 1993.

Digital Library

[10]

FIELDING, R. The Technique of Special Effects Cinematography, 4th ed. Hastings House, New York, 1985, ch. 11, pp. 290-321.

[11]

GAT, N. Real-time multi- and hyper-spectral imaging for remote sensing and machine vision: an overview. In Proc. 1998 ASAE Annual International Mtg. (Orlando, Florida, July 1998).

[12]

KAJIYA, J. T. The rendering equation. In Computer Graphics (Proceedings of SIGGRAPH 86) (Dallas, Texas, August 1986), vol. 20, pp. 143-150.

Digital Library

[13]

KOUDELKA, M., MAGDA, S., BELHUMEUR, P., AND KRIEGMAN, D. Image-based modeling and rendering of surfaces with arbitrary brdfs. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog. (2001), pp. 568-575.

[14]

LEVOY, M., AND HANRAHAN, P. Light field rendering. In SIGGRAPH 96 (1996), pp. 31-42.

Digital Library

[15]

MALZBENDER, T., GELB, D., AND WOLTERS, H. Polynomial texture maps. Proceedings of SIGGRAPH 2001 (August 2001), 519-528. ISBN 1-58113-292-1.

Digital Library

[16]

MATUSIK, W., BUEHLER, C., RASKAR, R., GORTLER, S. J., AND MCMILLAN, L. Image-based visual hulls. In Proc. SIGGRAPH 2000 (July 2000), pp. 369-374.

Digital Library

[17]

MILLER, G. S., AND HOFFMAN, C. R. Illumination and reflection maps: Simulated objects in simulated and real environments. In SIGGRAPH 84 Course Notes for Advanced Computer Graphics Animation (July 1984).

[18]

NIMEROFF, J. S., SIMONCELLI, E., AND DORSEY, J. Efficient re-rendering of naturally illuminated environments. Fifth Eurographics Workshop on Rendering (June 1994), 359-373.

[19]

PORTER, T., AND DUFF, T. Compositing digital images. In Computer Graphics (Proceedings of SIGGRAPH 84) (Minneapolis, Minnesota, July 1984), vol. 18, pp. 253-259.

Digital Library

[20]

RAMAMOORTHI, R., AND HANRAHAN, P. A signal-processing framework for inverse rendering. In Proc. SIGGRAPH 2001 (August 2001), pp. 117-128.

Digital Library

[21]

SMITH, A. R., AND BLINN, J. F. Blue screen matting. In Proceedings of SIGGRAPH 96 (August 1996), pp. 259-268.

Digital Library

[22]

TCHOU, C., AND DEBEVEC, P. HDR Shop. Available at http://www.debevec.org/HDRShop, 2001.

[23]

TSAI, R. A versatile camera calibration technique for high accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal of Robotics and Automation 3, 4 (August 1987), 323-344.

[24]

VIDOR, Z. An infrared self-matting process. Society of Motion Picture and Television Engineers 69 (June 1960), 425-427.

[25]

WINDOWS AND DAYLIGHTING GROUP. The sky simulator for daylighting studies. Tech. Rep. DA 188 LBL, Lawrence Berkeley Laboratories, January 1985.

[26]

WYSZECKI, G., AND STILES, W. S. Color Science: Concepts and Methods, Quantitative and Formulae, 2nd ed. Wiley, New York, 1982.

[27]

ZONGKER, D. E., WERNER, D. M., CURLESS, B., AND SALESIN, D. H. Environment matting and compositing. Proceedings of SIGGRAPH 99 (August 1999), 205-214.

Digital Library

Cited By

Cremona CKavakli M(2023)The Evolution of the Virtual Production Studio as a Game Changer in FilmmakingCreating Digitally10.1007/978-3-031-31360-8_14(403-429)Online publication date: 3-Dec-2023
https://doi.org/10.1007/978-3-031-31360-8_14
Kavakli MCremona C(2022)The Virtual Production Studio Concept – An Emerging Game Changer in Filmmaking2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00020(29-37)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00020
Chandran SKubo HUeda TFunatomi TMukaigawa YJayasuriya S(2022)Slope Disparity Gating: System and ApplicationsIEEE Transactions on Computational Imaging10.1109/TCI.2022.31622598(317-332)Online publication date: 2022
https://doi.org/10.1109/TCI.2022.3162259
Show More Cited By

Index Terms

A lighting reproduction approach to live-action compositing
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing
    2. Rendering
      1. Reflectance modeling

Recommendations

Practical multispectral lighting reproduction

We present a practical framework for reproducing omnidirectional incident illumination conditions with complex spectra using a light stage with multispectral LED lights. For lighting acquisition, we augment standard RGB panoramic photography with one or ...
A lighting reproduction approach to live-action compositing

We describe a process for compositing a live performance of an actor into a virtual set wherein the actor is consistently illuminated by the virtual environment. The Light Stage used in this work is a two-meter sphere of inward-pointing RGB light ...
Image-based rendering of diffuse, specular and glossy surfaces from a single image
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques

In this paper, we present a new method to recover an approximation of the bidirectional reflectance distribution function (BRDF) of the surfaces present in a real scene. This is done from a single photograph and a 3D geometric model of the scene. The ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

July 2002

574 pages

ISBN:1581135211

DOI:10.1145/566570

Conference Chair:
Tom Appolloni
Harris Corporation

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH02

Sponsor:

SIGGRAPH

SIGGRAPH02: The 29th International Conference on Computer Graphics and Interactive Techniques

July 23 - 26, 2002

Texas, San Antonio

Acceptance Rates

SIGGRAPH '02 Paper Acceptance Rate 67 of 358 submissions, 19%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
1,761
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)4

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cremona CKavakli M(2023)The Evolution of the Virtual Production Studio as a Game Changer in FilmmakingCreating Digitally10.1007/978-3-031-31360-8_14(403-429)Online publication date: 3-Dec-2023
https://doi.org/10.1007/978-3-031-31360-8_14
Kavakli MCremona C(2022)The Virtual Production Studio Concept – An Emerging Game Changer in Filmmaking2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00020(29-37)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00020
Chandran SKubo HUeda TFunatomi TMukaigawa YJayasuriya S(2022)Slope Disparity Gating: System and ApplicationsIEEE Transactions on Computational Imaging10.1109/TCI.2022.31622598(317-332)Online publication date: 2022
https://doi.org/10.1109/TCI.2022.3162259
Kubo HJayasuriya SIwaguchi TFunatomi TMukaigawa YNarasimhan S(2021)Programmable Non-Epipolar Indirect Light Transport: Capture and AnalysisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2019.294681227:4(2421-2436)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TVCG.2019.2946812
Meka APandey RHäne COrts-Escolano SBarnum PDavid-Son PErickson DZhang YTaylor JBouaziz SLegendre CMa WOverbeck RBeeler TDebevec PIzadi STheobalt CRhemann CFanello S(2020)Deep relightable texturesACM Transactions on Graphics10.1145/3414685.341781439:6(1-21)Online publication date: 27-Nov-2020
https://dl.acm.org/doi/10.1145/3414685.3417814
Henderson KLiu XFolden JTilmon BJayasuriya SKoppal S(2020)Design and Calibration of a Fast Flying-Dot Projector for Dynamic Light Transport AcquisitionIEEE Transactions on Computational Imaging10.1109/TCI.2020.29642466(529-543)Online publication date: 2020
https://doi.org/10.1109/TCI.2020.2964246
LeGendre CYu XDebevec P(2016)Optimal LED selection for multispectral lighting reproductionACM SIGGRAPH 2016 Posters10.1145/2945078.2945150(1-2)Online publication date: 24-Jul-2016
https://dl.acm.org/doi/10.1145/2945078.2945150
LeGendre CYu XLiu DBusch JJones APattanaik SDebevec P(2016)Practical multispectral lighting reproductionACM Transactions on Graphics10.1145/2897824.292593435:4(1-11)Online publication date: 11-Jul-2016
https://dl.acm.org/doi/10.1145/2897824.2925934
Kobayashi NOkabe T(2016)Separating reflection components in images under multispectral and multidirectional light sources2016 23rd International Conference on Pattern Recognition (ICPR)10.1109/ICPR.2016.7900129(3210-3215)Online publication date: Dec-2016
https://doi.org/10.1109/ICPR.2016.7900129
Weinmann MKlein R(2015)Advances in geometry and reflectance acquisition (course notes)SIGGRAPH Asia 2015 Courses10.1145/2818143.2818165(1-71)Online publication date: 2-Nov-2015
https://dl.acm.org/doi/10.1145/2818143.2818165
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents