More Web Proxy on the site http://driver.im/

research-article

Image based PTM synthesis for realistic rendering of low resolution 3D models

Authors:

Anoop M. NamboodiriAuthors Info & Claims

ICVGIP '10: Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing

Pages 345 - 352

https://doi.org/10.1145/1924559.1924605

Published: 12 December 2010 Publication History

Abstract

Capturing the shape and texture of large structures such as monuments and statues at very high resolution is extremely expensive, both in terms of time as well as storage space. In many cases the finer details are generated by surface properties of the material, and the appearance is statistically uniform. In this paper, we present an approach to add surface details to a coarse 3D model of an object based on two additional information: a set of images of the object and a high resolution model of the material that the object is made of. The material model that we employ is the Polynomial Texture Map (PTM), which captures the appearance of a surface under various illumination conditions. We use the observed images of the object as constraints to synthesize texture samples for each triangle of the object under any given illumination.

The primary challenge is to synthesize a polynomial model of the texture, where the constraints arise in the image domain. We use the knowledge of object illumination to map the texture models into image space and compute the optimal patch. The texture transfer then happens as a complete 3D texturemodel. We also consider the problems of pose, scale, reflectance and smoothness of surface while carrying out the texture transfer. We synthesize the texture of an object at a per-triangle basis while carrying out operations such as normalization and blending to take care of discontinuities at the edges.

References

[1]

M. Ashikhmin and P. Shirley. Steerable illumination textures. ACM Trans. Graph., 21(1):1--19, 2002.

Digital Library

[2]

A. Baumberg. Blending images for texturing 3d models. In Proc. Conf. on British Machine Vision Association, pages 404--413, 2002.

[3]

K. J. Dana, B. van Ginneken, S. K. Nayar, and J. J. Koenderink. Reflectance and texture of real-world surfaces. ACM Trans. Graph., 18(1):1--34, 1999.

Digital Library

[4]

A. Efros and W. T. Freeman. Image quilting for texture synthesis and transfer. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 341--346, New York, NY, USA, Aug. 2001. ACM.

Digital Library

[5]

A. Efros and T. Leung. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, pages 1033--1038, 1999.

Digital Library

[6]

M. L. et al. The digital michelangelo project: 3d scanning of large statues. In Proceedings of SIGGRAPH, pages 131--144, New Orleans, LA, USA, 2000.

Digital Library

[7]

D. J. Heeger and J. R. Bergen. Pyramid-based texture analysis/synthesis. In SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pages 229--238, New York, NY, USA, 1995. ACM.

Digital Library

[8]

Y. Hel-Or, T. Malzbender, and D. Gelb. Synthesis and rendering of 3d textures. 3rd International Workshop on Texture Analysis and Synthesis, 2003.

[9]

T. Leung and J. Malik. Representing and recognizing the visual appearance of materials using three-dimensional textons. International Journal On Computer Vision, 43(1):29--44, 2001.

Digital Library

[10]

L. Liang, C. Liu, Y. Xu, B. Guo, and H. yeung Shum. Real-time texture synthesis by patch-based sampling. ACM Transactions on Graphics, 20:127--150, 2001.

Digital Library

[11]

S. Magda and D. Kriegman. Fast texture synthesis on arbitrary meshes. In SIGGRAPH '03: ACM SIGGRAPH 2003 Sketches & Applications, New York, NY, USA, 2003. ACM.

Digital Library

[12]

T. Malzbender, D. Gelb, and H. Wolters. Polynomial texture maps. In Computer Graphics, SIGGRAPH 2001 Proceedings, pages 519--528, 2001.

Digital Library

[13]

K. Popat and R. W. Picard. Novel cluster-based probability model for texture synthesis, classification, and compression. In Visual Communications and Image Processing, pages 756--768, 1993.

[14]

C. Rocchini, P. Cignoni, C. Montani, and R. Scopigno. Multiple textures stitching and blending on 3d objects. In Eurographics Rendering Workshop, pages 119--130. Springer-Verlag, 1999.

Digital Library

[15]

M. Soucy, G. Godin, R. Baribeau, F. Blais, and M. Rioux. Sensors and algorithms for the construction of digital 3-d colour models of real objects. pages II: 409--412, 1996.

[16]

G. Turk. Texture synthesis on surfaces. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 347--354, Aug. 2001.

Digital Library

[17]

L.-Y. Wei and M. Levoy. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pages 479--488, New York, NY, USA, 2000. ACM Press/Addison-Wesley Publishing Co.

Digital Library

[18]

L.-Y. Wei and M. Levoy. Texture synthesis over arbitrary manifold surfaces. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 355--360, New York, NY, USA, 2001. ACM.

Digital Library

Cited By

Castro YNurit MPitard GZendagui ALe Goïc GBrost VBoucher AMansouri APamart ADe Luca L(2020)Calibration of spatial distribution of light sources in reflectance transformation imaging based on adaptive local density estimationJournal of Electronic Imaging10.1117/1.JEI.29.4.04100429:04(1)Online publication date: 11-Jan-2020
https://doi.org/10.1117/1.JEI.29.4.041004
Tomasello SPazzi MStanco FGiachetti APingi P(2017)3D reconstruction of facade and the statues of the Church "Maria Santissima dell'Elemosina" in BiancavillaProceedings of the Conference on Smart Tools and Applications in Computer Graphics10.2312/stag.20171230(81-89)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.2312/stag.20171230

Index Terms

Image based PTM synthesis for realistic rendering of low resolution 3D models
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation
    2. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Interactive rendering of realistic illumination models using wavelet-based precomputation
Photometric Image-Based Rendering for Virtual Lighting Image Synthesis
IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality

A concept named Photometric Image-Based Rendering (PIBR) is introduced for a seamless augmented reality. The PIBR is defined as Image-Based Rendering which covers appearance changes caused by the lighting condition changes, while Geometric Image-Based ...
Filtering and Rendering of Resolution-Dependent Reflectance Models

The apparent reflectance of a surface depends upon the resolution at which it is imaged. Conventional reflectance models represent reflection at a single predetermined resolution; however, a low-resolution pixel that views a greater surface area often ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICVGIP '10: Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing

December 2010

533 pages

ISBN:9781450300605

DOI:10.1145/1924559

General Chairs:
Rama Chellappa
University of Maryland
,
Padmanabhan Anandan
Microsoft Research, India
,
Program Chairs:
A. N. Rajagopalan
Indian Institute of Technology Madras, India
,
P. J. Narayanan
International Institute of Information Technology Hyderabad, India
,
Philip Torr
Oxford Brookes University, UK

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICVGIP '10

ICVGIP '10: Seventh Indian Conference on Computer Vision, Graphics and Image Processing

December 12 - 15, 2010

Chennai, India

Acceptance Rates

Overall Acceptance Rate 95 of 286 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
181
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Castro YNurit MPitard GZendagui ALe Goïc GBrost VBoucher AMansouri APamart ADe Luca L(2020)Calibration of spatial distribution of light sources in reflectance transformation imaging based on adaptive local density estimationJournal of Electronic Imaging10.1117/1.JEI.29.4.04100429:04(1)Online publication date: 11-Jan-2020
https://doi.org/10.1117/1.JEI.29.4.041004
Tomasello SPazzi MStanco FGiachetti APingi P(2017)3D reconstruction of facade and the statues of the Church "Maria Santissima dell'Elemosina" in BiancavillaProceedings of the Conference on Smart Tools and Applications in Computer Graphics10.2312/stag.20171230(81-89)Online publication date: 11-Sep-2017
https://dl.acm.org/doi/10.2312/stag.20171230

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents