Abstract
We combine uncalibrated Structure-from-Motion, lightfield rendering and view-dependent texture mapping to model and render scenes from a set of images that are acquired from an uncalibrated handheld video camera. The camera is simply moved by hand around the 3D scene of interest. The intrinsic camera parameters like focal length and the camera positions are automatically calibrated with a Structure-From-Motion approach. Dense and accurate depth maps for each camera viewpoint are computed with multi-viewpoint stereoscopic matching. The set of images, their calibration parameters and the depth maps are then utilized for depth-compensated image-based rendering. The rendering utilizes a scalable geometric approximation that is tailored to the needs of the rendering hardware.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
P. Beardsley, P. Torr and A. Zisserman: 3D Model Acquisition from Extended Image Sequences. ECCV 96, LNCS 1064, vol.2, pp.683–695. Springer 1996. 66 R. Koch, B. Heigl, and M. Pollefeys
P. Debevec, Y. Yu, G. Borshukov: E-cient View-Dependent Image-Based Rendering with Projective Texture Mapping. Proceedings SIGGRAPH’ 98, ACM Press, New York, 1998.
L. Falkenhagen: Hierarchical Block-Based Disparity Estimation Considering Neighborhood Constraints. Intern. Workshop on SNHC and 3D Imaging, Rhodes, Greece, Sept. 1997.
O. Faugeras: What can be seen in three dimensions with an uncalibrated stereo rig. Proc. ECCV’92, pp.563–578.
S. Gortler, R. Grzeszczuk, R. Szeliski, M. F. Cohen: The Lumigraph. Proceedings SIGGRAPH’ 96, pp 43–54, ACM Press, New York, 1996.
R. Hartley: Estimation of relative camera positions for uncalibrated cameras. ECCV’92, pp.579–587.
R. Koch, M. Pollefeys, and L. Van Gool: Multi Viewpoint Stereo from Uncalibrated Video Sequences. Proc. ECCV’98, Freiburg, June 1998.
R. Koch, M. Pollefeys, B. Heigl, L. Van Gool, H. Niemann: Calibration of Handheld Camera Sequences for Plenoptic Modeling. Proc. of ICCV’99, Korfu, Greece, Sept. 1999.
R. Koch, M. Pollefeys and L. Van Gool: Robust Calibration and 3D Geometric Modeling from Large Collections of Uncalibrated Images. Proceedings DAGM’99, Bonn, Sept. 1999.
M. Levoy, P. Hanrahan: Light-field Rendering. Proceedings SIGGRAPH’ 96, pp 31–42, ACM Press, New York, 1996.
L. McMillan and G. Bishop, “Plenoptic modeling: An image-based rendering system”, Proc. SIGGRAPH’95, pp. 39–46, 1995.
M. Pollefeys, R. Koch, M. Vergauwen and L. Van Gool: Metric 3D Surface Reconstruction from Uncalibrated Image Sequences. In: 3D Structure from Multiple Images of Large Scale Environments. LNCS Series Vol. 1506, pp. 139–154. Springer-Verlag, 1998.
M. Pollefeys, R. Koch and L. Van Gool: Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters. Int. Journal of Computer Vision 32(1), 7–27 (1999), Kluver 1999.
P.H.S. Torr: Motion Segmentation and Outlier Detection. PhD thesis, University of Oxford, UK, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Koch, R., Heigl, B., Pollefeys, M. (2001). Image-Based Rendering from Uncalibrated Lightfields with Scalable Geometry. In: Klette, R., Gimel’farb, G., Huang, T. (eds) Multi-Image Analysis. Lecture Notes in Computer Science, vol 2032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45134-X_4
Download citation
DOI: https://doi.org/10.1007/3-540-45134-X_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42122-1
Online ISBN: 978-3-540-45134-1
eBook Packages: Springer Book Archive