More Web Proxy on the site http://driver.im/

Article

Efficiently combining positions and normals for precise 3D geometry

Authors:

Szymon Rusinkiewicz,

Ravi RamamoorthiAuthors Info & Claims

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Pages 536 - 543

https://doi.org/10.1145/1186822.1073226

Published: 01 July 2005 Publication History

Abstract

Range scanning, manual 3D editing, and other modeling approaches can provide information about the geometry of surfaces in the form of either 3D positions (e.g., triangle meshes or range images) or orientations (normal maps or bump maps). We present an algorithm that combines these two kinds of estimates to produce a new surface that approximates both. Our formulation is linear, allowing it to operate efficiently on complex meshes commonly used in graphics. It also treats high-and low-frequency components separately, allowing it to optimally combine outputs from data sources such as stereo triangulation and photometric stereo, which have different error-vs.-frequency characteristics. We demonstrate the ability of our technique to both recover high-frequency details and avoid low-frequency bias, producing surfaces that are more widely applicable than position or orientation data alone.

Supplementary Material

MP4 File (pps017.mp4)

Download
31.58 MB

References

[1]

Banerjee, S., Sastry, P., and Venkatesh, Y. 1992. Surface reconstruction from disparate shading: An integration of shape-from-shading and stereopsis. In IAPR, volume 1, pages 141--144.

[2]

Bernardini, F., Martin, I., Mittleman, J., Rushmeier, H., and Taubin, G. 2002. Building a digital model of michelangelo's florentine pietà. IEEE Computer Graphics and Applications, 22(1):59--67.

Digital Library

[3]

Besl, P. J. 1989. Active Optical Range Imaging Sensors, pages 1--63.

Digital Library

[4]

Besl, P. J. and Mckay, N. D. 1992. A method for registration of 3-d shapes. PAMI, 14(2):239--256.

Digital Library

[5]

Bouguet, J.-Y. 2004. Camera Calibration Toolbox for Matlab. URL http://www.vision.caltech.edu/bouguetj/calib_doc.

[6]

Chen, C.-Y., Klette, R., and Chen, C.-F. 2003. Shape from photometric-stereo and contours. In N. Petkov and M. Westenberg, editors, CAIP, Springer-Verlag, pages 377--384.

[7]

Cryer, J. E., Tsai, P.-S., and Shah, M. 1995. Integration of shape from shading and stereo. Pattern Recognition, 28(7): 1033--1043.

[8]

Curless, B. 1997. New Methods For Surface Reconstruction From Range Images. PhD thesis, Stanford University.

Digital Library

[9]

Curless, B. and Levoy, M. 1996. A volumetric method for building complex models from range images. In SIGGRAPH, ACM Press, pages 303--312.

Digital Library

[10]

Davis, J., Nehab, D., Ramamoorthi, R., and Rusinkiewicz, S. 2005. Spacetime stereo: A unifying framework for depth from triangulation. PAMI, 27(2):296--302.

Digital Library

[11]

Epstein, R., Yuille, A. L., and Belhumeur, P. N. 1996. Learning object representations from lighting variations. In ECCV, pages 179--199.

Digital Library

[12]

Fua, P. and Leclerc, Y. G. 1994. Using 3-dimensional meshes to combine image-based and geometry-based constraints. In J.-O. Eklundh, editor, ECCV, volume 2, Springer-Verlag, pages 281--291.

Digital Library

[13]

Georghiades. A. 2003. Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. In ICCV, volume 2, pages 816--823.

Digital Library

[14]

Horn, B. K. P. 1970. Shape from Shading: A Method for Obtaining the Shape of a Smooth Opaque Object from One View. PhD thesis, Massachusetts Institute of Technology.

[15]

Ikeuchi, K. 1983. Constructing a depth map from images. A. I Memo AIM-744, Artificial Intelligence Laboratory, MIT.

[16]

Ikeuchi, K. 1987. Determining a depth map using a dual photometric stereo. IJRR, 6(1):15--31.

Digital Library

[17]

Lange, H. 1999. Advances in the cooperation of shape from shading and stereo vision. In 3DIM, pages 46--58.

Digital Library

[18]

Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Trans. Graph., 22(2): 234--257.

Digital Library

[19]

Miller, G. 1994. Efficient algorithms for local and global accessibility shading. In SIGGRAPH, pages 319--326.

Digital Library

[20]

Mostafa, M., Yamany, S., and Farag, A. 1999. Integrating shape from shading and range data using neural networks. In CVPR, volume 2, IEEE Computer Society, pages 15--20.

[21]

Paige, C. C. and Saunders, M. A. 1982. LSQR: An algorithm for sparse linear equations and sparse least squares. TOMS, 8(1): 43--71.

Digital Library

[22]

Poussart, D. and Laurendeau, D. 1989. 3-D Sensing for Industrial Computer Vision, pages 122--159.

Digital Library

[23]

Pulli, K. 1999. Multiview registration for large datasets. In 3DIM, pages 160--168.

Digital Library

[24]

Rushmeier, H. and Bernardini, F. 1999. Computing consistent normals and colors from photometric data. In 3DIM, pages 99--108.

Digital Library

[25]

Tagare, H. D. and Defigueiredo, R. J. P. 1991. A theory of photometric stereo for a class of diffuse non-lambertian surfaces. PAMI, 13(2):133--152.

Digital Library

[26]

Terzopoulos, D. 1988. The computation of visible-surface representations. PAMI, 10(4):417--438.

Digital Library

[27]

Woodham, R. J. 1980. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19 (1):139--144.

[28]

Zhang, L., Curless, B., and Seitz, S. M. 2003. Spacetime stereo: Shape recovery for dynamic scenes. In CVPR, pages 367--374.

Cited By

Liu CWang LLi ZQuan SXu Y(2023)Real-Time Lighting Estimation for Augmented Reality via Differentiable Screen-Space RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314194329:4(2132-2145)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TVCG.2022.3141943
Kim YKramberger ABuch ASloth C(2023)Contact-Based Pose Estimation of Workpieces for Robotic Setups2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10161465(12324-12330)Online publication date: 29-May-2023
https://doi.org/10.1109/ICRA48891.2023.10161465
Li ZZheng QShi BPan GJiang X(2023)DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00810(8381-8391)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00810
Show More Cited By

Index Terms

Efficiently combining positions and normals for precise 3D geometry

Recommendations

Efficiently combining positions and normals for precise 3D geometry

Range scanning, manual 3D editing, and other modeling approaches can provide information about the geometry of surfaces in the form of either 3D positions (e.g., triangle meshes or range images) or orientations (normal maps or bump maps). We present an ...
Estimating specular normals from spherical Stokes reflectance fields
SIGGRAPH '12: ACM SIGGRAPH 2012 Posters

Despite being at the focal point of intense research in both computer graphics as well as in computer vision, accurately reproducing the shape and appearance of real-world scenes remains a challenging problem, especially under uncontrolled conditions. ...
Simultaneous acquisition of polarimetric SVBRDF and normals

Capturing appearance often requires dense sampling in light-view space, which is often achieved in specialized, expensive hardware setups. With the aim of realizing a compact acquisition setup without multiple angular samples of light and view, we sought ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

July 2005

826 pages

ISBN:9781450378253

DOI:10.1145/1186822

Editor:
Markus Gross
Eidgenössische Technische Hochschule Zürich

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGGRAPH05

Sponsor:

SIGGRAPH

SIGGRAPH05: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 31 - August 4, 2005

California, Los Angeles

Acceptance Rates

SIGGRAPH '05 Paper Acceptance Rate 98 of 461 submissions, 21%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

85
Total Citations
View Citations
2,329
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu CWang LLi ZQuan SXu Y(2023)Real-Time Lighting Estimation for Augmented Reality via Differentiable Screen-Space RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314194329:4(2132-2145)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TVCG.2022.3141943
Kim YKramberger ABuch ASloth C(2023)Contact-Based Pose Estimation of Workpieces for Robotic Setups2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10161465(12324-12330)Online publication date: 29-May-2023
https://doi.org/10.1109/ICRA48891.2023.10161465
Li ZZheng QShi BPan GJiang X(2023)DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00810(8381-8391)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00810
Zhou THe KWu DXu TZhang QShao KChen WXu LYu J(2023)Relightable Neural Human Assets from Multi-view Gradient Illuminations2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00420(4315-4327)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00420
Jafarian YPark H(2022)Self-supervised 3D Representation Learning of Dressed Humans from Social Media VideosIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.3231558(1-14)Online publication date: 2022
https://doi.org/10.1109/TPAMI.2022.3231558
Fan HQi LChen CRao YKong LDong JYu H(2022)Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and AttenuationIEEE Journal of Oceanic Engineering10.1109/JOE.2021.308596847:1(46-58)Online publication date: Jan-2022
https://doi.org/10.1109/JOE.2021.3085968
Luo JRuezga EDavis J(2022)How Accurate Is Passive Stereo For 3d Face Reconstruction?2022 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP46576.2022.9898004(2516-2520)Online publication date: 16-Oct-2022
https://doi.org/10.1109/ICIP46576.2022.9898004
Kaya BKumar SOliveira CFerrari VVan Gool L(2022)Uncertainty-Aware Deep Multi-View Photometric Stereo2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01227(12591-12601)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01227
Miyashita LTabata SIshikawa M(2022)High-Speed and Low-Latency 3D Sensing with a Parallel-Bus Pattern2022 International Conference on 3D Vision (3DV)10.1109/3DV57658.2022.00041(291-300)Online publication date: Sep-2022
https://doi.org/10.1109/3DV57658.2022.00041
Ha HLee JMeuleman AKim M(2021)NormalFusion: Real-Time Acquisition of Surface Normals for High-Resolution RGB-D Scanning2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.01571(15965-15974)Online publication date: Jun-2021
https://doi.org/10.1109/CVPR46437.2021.01571
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents