More Web Proxy on the site http://driver.im/

article

Context-based surface completion

Authors:

Daniel Cohen-OrAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 23, Issue 3

Pages 878 - 887

https://doi.org/10.1145/1015706.1015814

Published: 01 August 2004 Publication History

Abstract

Sampling complex, real-world geometry with range scanning devices almost always yields imperfect surface samplings. These "holes" in the surface are commonly filled with a smooth patch that conforms with the boundary. We introduce a context-based method: the characteristics of the given surface are analyzed, and the hole is iteratively filled by copying patches from valid regions of the given surface. In particular, the method needs to determine best matching patches, and then, fit imported patches by aligning them with the surrounding surface. The completion process works top down, where details refine intermediate coarser approximations. To align an imported patch with the existing surface, we apply a rigid transformation followed by an iterative closest point procedure with non-rigid transformations. The surface is essentially treated as a point set, and local implicit approximations aid in measuring the similarity between two point set patches. We demonstrate the method at several point-sampled surfaces, where the holes either result from imperfect sampling during range scanning or manual removal.

Supplementary Material

MOV File (pps083.mov)

Download
11.86 KB

References

[1]

ADOBE, 2002. Adobe photoshop 7.0.

[2]

AMENTA, N., BERN, M., AND KAMVYSSELIS, M. 1998. A new voronoi-based surface reconstruction algorithm. In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series, 415--422.

Digital Library

[3]

BAJAJ, C. L., BERNARDINI, F., AND XU, G. 1995. Automatic reconstruction of surfaces and scalar fields from 3D scans. In Proceedings of SIGGRAPH 95, Computer Graphics Proceedings, Annual Conference Series, 109--118.

Digital Library

[4]

BAREQUET, G., AND SHARIR, M. 1995. Filling gaps in the boundary of a polyhedron. Computer Aided Geometric Design 12, 2, 207--229.

Digital Library

[5]

BESL, P., AND MCKAY, N. 1992. A method for registration of 3D shapes. IEEE Transaction on Pattern Analysis and Machine Intelligence 14, 2, 239--256.

Digital Library

[6]

CHEN, Y., AND MEDIONI, G. 1992. Object modeling by registration of multiple range images. Image and Vision Computing 10, 3, 145--155.

Digital Library

[7]

CLARENZ, U., DIEWALD, U., DZIUK, G., RUMPF, M., AND RUSU, R. 2004. A finite element method for surface restoration with smooth boundary conditions. In CAGD. submitted, available from http://numerik.math.uni-duisburg.de/.

Digital Library

[8]

CRIMINISI, A., PÉREZ, P., AND TOYAMA, K. 2003. Object removal by exemplar-based inpainting. In 2003 Conference on Computer Vision and Pattern Recognition (CVPR 2003), 721--728.

[9]

CURLESS, B., AND LEVOY, M. 1996. A volumetric method for building complex models from range images. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 303--312.

Digital Library

[10]

DAVIS, J., MARSCHNER, S. R., GARR, M., AND LEVOY, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proceedings of the 1st International Symposium on 3D Data Processing Visualization and Transmission (3DPVT-02), IEEE Computer Society, Los Alamitos, CA, G. M. Cortelazzo and C. Guerra, Eds., 428--438.

[11]

DRORI, I., COHEN-OR, D., AND YESHURUN, H. 2003. Fragment-based image completion. ACM Transactions on Graphics 22, 3 (July), 303--312.

Digital Library

[12]

EFROS, A. A., AND FREEMAN, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 341--346.

Digital Library

[13]

EFROS, A. A., AND LEUNG, T. K. 1999. Texture synthesis by non-parametric sampling. In IEEE International Conference on Computer Vision, 1033--1038.

Digital Library

[14]

HERTZMANN, A., JACOBS, C. E., OLIVER, N., CURLESS, B., AND SALESIN, D. H. 2001. Image analogies. In Proceedings of ACM SIGGRAPH 2001, Computer Graphics Proceedings, Annual Conference Series, 327--340.

Digital Library

[15]

HERTZMANN, A., OLIVER, N., CURLESS, B., AND SEITZ, S. M. 2002. Curve analogies. In Rendering Techniques 2002: 13th Eurographics Workshop on Rendering, 233--246.

Digital Library

[16]

ILIC, S., AND FUA, P. 2003. Implicit meshes for modeling and reconstruction. In 2003 Conference on Computer Vision and Pattern Recognition (CVPR 2003), 483--492.

[17]

JIA, J., AND TANG, C.-K. 2003. Image repairing: Robust image synthesis by adaptive nd tensor voting. In 2003 Conference on Computer Vision and Pattern Recognition (CVPR 2003), 643--650.

Digital Library

[18]

KWATRA, V., SCHÖDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3 (July), 277--286.

Digital Library

[19]

LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., SHADE, J., AND FULK, D. 2000. The digital michelangelo project: 3D scanning of large statues. In Proceedings of the 27th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., 131--144.

Digital Library

[20]

LIEPA, P. 2003. Filling holes in meshes. In Symposium on Geometry Processing, 200--205.

Digital Library

[21]

OHTAKE, Y., BELYAEV, A., ALEXA, M., TURK, G., AND SEIDEL, H.-P. 2003. Multi-level partition of unity implicits. ACM Transactions on Graphics 22, 3 (July), 463--470.

Digital Library

[22]

SAVCHENKO, V., AND KOJEKINE, N. 2002. An approach to blend surfaces. In CGI, 139--150.

[23]

SUN, J., ZHENG, N.-N., TAO, H., AND SHUM, H.-Y. 2003. Image hallucination with primal sketch priors. In 2003 Conference on Computer Vision and Pattern Recognition (CVPR 2003), 729--736.

[24]

TAUBIN, G. 1994. Distance approximation for rasterizing implicit curves. ACM Transactions on Graphics 13, 1 (Jan.), 3--42.

Digital Library

[25]

VERDERA, J., CASELLES, V., BERTALMIO, M., AND SAPIRO, G. 2003. Inpainting surface holes. In 2003 International Conference on Image Processing 2003 ICIP.

[26]

WEI, L.-Y., AND LEVOY, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 479--488.

Digital Library

[27]

YING, L., HERTZMANN, A., BIERMANN, H., AND ZORIN, D. 2001. Texture and shape synthesis on surfaces. In Rendering Techniques 2001: 12th Eurographics Workshop on Rendering, 301--312.

Digital Library

[28]

ZHANG, Z. 1992. Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision 13, 2, 119--152.

Digital Library

Cited By

Li WChen XWang JChen B(2023)Patch-Based 3D Natural Scene Generation from a Single Example2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01608(16762-16772)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01608
Vasic IQuattrini RPierdicca RFrontoni EVasic B(2022)A Method for Determining the Shape Similarity of Complex Three-Dimensional Structures to Aid Decay Restoration and Digitization Error CorrectionInformation10.3390/info1303014513:3(145)Online publication date: 9-Mar-2022
https://doi.org/10.3390/info13030145
Wu XLin XLi NLi H(2022)Patch-based mesh inpainting via low rank recoveryGraphical Models10.1016/j.gmod.2022.101139122:COnline publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1016/j.gmod.2022.101139
Show More Cited By

Index Terms

Context-based surface completion
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
      1. Parametric curve and surface models
      2. Volumetric models

Recommendations

Context-based surface completion
SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

Sampling complex, real-world geometry with range scanning devices almost always yields imperfect surface samplings. These "holes" in the surface are commonly filled with a smooth patch that conforms with the boundary. We introduce a context-based method:...
Surface completion for shape and appearance
Abstract
In this paper, we present a new surface content completion system that can effectively repair both shape and appearance from scanned, incomplete point set inputs. First, geometric holes can be robustly identified from noisy and defective data sets ...
Surface Parameterization Using Riemann Surface Structure
ICCV '05: Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2

We propose a general method that parameterizes general surfaces with complex (possible branching) topology using Riemann surface structure. Rather than evolve the surface geometry to a plane or sphere, we instead use the fact that all orientable ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 23, Issue 3

August 2004

684 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1015706

Editor:
John C. Hart

Issue’s Table of Contents

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

139
Total Citations
View Citations
2,000
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li WChen XWang JChen B(2023)Patch-Based 3D Natural Scene Generation from a Single Example2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01608(16762-16772)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01608
Vasic IQuattrini RPierdicca RFrontoni EVasic B(2022)A Method for Determining the Shape Similarity of Complex Three-Dimensional Structures to Aid Decay Restoration and Digitization Error CorrectionInformation10.3390/info1303014513:3(145)Online publication date: 9-Mar-2022
https://doi.org/10.3390/info13030145
Wu XLin XLi NLi H(2022)Patch-based mesh inpainting via low rank recoveryGraphical Models10.1016/j.gmod.2022.101139122:COnline publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1016/j.gmod.2022.101139
Calatroni LHuska MMorigi SRecupero G(2022)A Unified Surface Geometric Framework for Feature-Aware Denoising, Hole Filling and Context-Aware CompletionJournal of Mathematical Imaging and Vision10.1007/s10851-022-01107-w65:1(82-98)Online publication date: 22-Jun-2022
https://dl.acm.org/doi/10.1007/s10851-022-01107-w
Narasimha VDhanalakshmi M(2022)Risk Factor of Diabetes with Comorbidity Using Machine Learning TechniquesICCCE 202110.1007/978-981-16-7985-8_37(355-363)Online publication date: 16-May-2022
https://doi.org/10.1007/978-981-16-7985-8_37
Xian CZhang DDai CWang C(2021)Fast Generation of High-Fidelity RGB-D Images by Deep Learning With Adaptive ConvolutionIEEE Transactions on Automation Science and Engineering10.1109/TASE.2020.300206918:3(1328-1340)Online publication date: Jul-2021
https://doi.org/10.1109/TASE.2020.3002069
Perez ESalamanca SMerchan PAdan A(2021)Repairing 3D Models Obtained From Range SensorsIEEE Access10.1109/ACCESS.2021.30615259(43474-43493)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3061525
Feng CLiang JRen MQiao GLu WLiu S(2020)A Fast Hole-Filling Method for Triangular Mesh in Additive RepairApplied Sciences10.3390/app1003096910:3(969)Online publication date: 2-Feb-2020
https://doi.org/10.3390/app10030969
Wang PLiu YTong X(2020)Deep Octree-based CNNs with Output-Guided Skip Connections for 3D Shape and Scene Completion2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW50498.2020.00141(1074-1081)Online publication date: Jun-2020
https://doi.org/10.1109/CVPRW50498.2020.00141
rong YWen Hui L(2020)Adaptive restoration strategy based on non-rigid matching for repairing damaged complex partsJournal of Industrial and Production Engineering10.1080/21681015.2020.1816583(1-9)Online publication date: 5-Sep-2020
https://doi.org/10.1080/21681015.2020.1816583
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents