More Web Proxy on the site http://driver.im/

article

ShapePalettes: interactive normal transfer via sketching

Authors:

Chi-Keung Tang,

Michael S. Brown,

Heung-Yeung ShumAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 26, Issue 3

Pages 44 - es

https://doi.org/10.1145/1276377.1276432

Published: 29 July 2007 Publication History

Abstract

We present a simple interactive approach to specify 3D shape in a single view using "shape palettes". The interaction is as follows: draw a simple 2D primitive in the 2D view and then specify its 3D orientation by drawing a corresponding primitive on a shape palette. The shape palette is presented as an image of some familiar shape whose local 3D orientation is readily understood and can be easily marked over. The 3D orientation from the shape palette is transferred to the 2D primitive based on the markup. As we will demonstrate, only sparse markup is needed to generate expressive and detailed 3D surfaces. This markup approach can be used to model freehand 3D surfaces drawn in a single view, or combined with image-snapping tools to quickly extract surfaces from images and photographs.

Supplementary Material

JPG File (pps044.jpg)

Download
12.49 KB

MP4 File (pps044.mp4)

Download
47.31 MB

References

[1]

Bookstein, F. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. PAMI 11, 6 (June), 567--585.

Digital Library

[2]

Criminisi, A., Reid, I., and Zisserman, A. 2000. Single view metrology. IJCV 40, 2 (November), 123--148.

Digital Library

[3]

DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., and Santella, A. 2003. Suggestive contours for conveying shape. ACM Trans. Graph. 22, 3, 848--855.

Digital Library

[4]

Frankot, R., and Chellappa, R. 1988. A method for enforcing integrability in shape from shading algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 10, 4, 439--451.

Digital Library

[5]

Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Trans. Graph. 23, 3, 652--663.

Digital Library

[6]

Goldman, D., Curless, B., Hertzmann, A., and Seitz, S. 2005. Shape and spatially-varying brdfs from photometric stereo. In ICCV05, 1: 341--348.

Digital Library

[7]

Hertzmann, A., and Seitz, S. 2005. Example-based photometric stereo: Shape reconstruction with general, varying brdfs. PAMI 27, 8 (August), 1254--1264.

Digital Library

[8]

Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577--584.

Digital Library

[9]

Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: a sketching interface for 3d freeform design. In SIGGRAPH '99, 409--416.

Digital Library

[10]

Johnston, S. F. 2002. Lumo: illumination for cel animation. In NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering, ACM Press, New York, NY, USA.

Digital Library

[11]

Karpenko, O. A., and Hughes, J. F. 2006. Smoothsketch: 3d free-form shapes from complex sketches. ACM Trans. Graph. 25, 3.

Digital Library

[12]

Koenderink, J. 1998. Pictorial relief. Royal 356, 1740, 1071--1086.

[13]

Kovesi, P. 2005. Shapelets correlated with surface normals produce surfaces. In ICCV05, 994--1001.

Digital Library

[14]

Mortensen, E., and Barrett, W. 1995. Intelligent scissors for image composition. Proceedings of ACM SIGGRAPH95, 191--198.

Digital Library

[15]

Nalwa, V. 1993. A Guided Tour of Computer Vision. Addison-Wesley.

Digital Library

[16]

Nealen, A., Sorkine, O., Alexa, M., and Cohen-Or, D. 2005. A sketch-based interface for detail-preserving mesh editing. ACM Trans. Graph. 24, 3, 1142--1147.

Digital Library

[17]

Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2004. Ridge-valley lines on meshes via implicit surface fitting. ACM Trans. Graph. 23, 3, 609--612.

Digital Library

[18]

Okabe, M., Zeng, G., Matsushita, Y., Igarashi, T., Quan, L., and Shum, H.-Y. 2006. Single-view relighting with normal map painting. In Proceedings of Pacific Graphics, 27--34.

[19]

Sloan, P. J., Martin, W., Gooch, A., and Gooch, B. 2001. The lit sphere: A model for capturing NPR shading from art. In Proceedings of Graphics Interface 2001, B. Watson and J. W. Buchanan, Eds., 143--150.

Digital Library

[20]

Van Overveld, C. W. A. M. 1996. Painting gradients: Free-form surface design using shading patterns. In Graphics Interface '96, Canadian Human-Computer Communications Society, W. A. Davis and R. Bartels, Eds., 151--158.

Digital Library

[21]

Wu, T.-P., Tang, K.-L., Tang, C.-K., and Wong, T.-T. 2006. Dense photometric stereo: A markov random field approach. PAMI 28, 11 (November), 1830--1846.

Digital Library

[22]

Zeleznik, R. C., Herndon, K. P., and Hughes, J. F. 1996. Sketch: an interface for sketching 3d scenes. In SIGGRAPH '96, 163--170.

Digital Library

[23]

Zhang, L., Dugas-Phocion, G., Samson, J., and Seitz, S. 2001. Single view modeling of free-form scenes. In CVPR01, 1:990--997.

Cited By

Zheng YMa LChen YWu E(2022)Physcially Based Multi-Solvent Stains Simulation on TextileJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1881234:02(315-324)Online publication date: 2-Dec-2022
https://doi.org/10.3724/SP.J.1089.2022.18812
Chang HLin T(2022)Portrait imaging relighting system based on a simplified photometric stereo methodApplied Optics10.1364/AO.45166261:15(4379)Online publication date: 16-May-2022
https://doi.org/10.1364/AO.451662
Zhang LSimo-Serra EJi YLiu C(2020)Generating Digital Painting Lighting Effects via RGB-space GeometryACM Transactions on Graphics10.1145/337217639:2(1-13)Online publication date: 24-Feb-2020
https://dl.acm.org/doi/10.1145/3372176
Show More Cited By

Index Terms

ShapePalettes: interactive normal transfer via sketching
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

ShapePalettes: interactive normal transfer via sketching
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

We present a simple interactive approach to specify 3D shape in a single view using "shape palettes". The interaction is as follows: draw a simple 2D primitive in the 2D view and then specify its 3D orientation by drawing a corresponding primitive on a ...
Shading-based surface editing

We present a system for free-form surface modeling that allows a user to modify a shape by changing its rendered, shaded image using stroke-based drawing tools. User input is translated into a set of tangent and positional constraints on the surface. A ...
Structured annotations for 2D-to-3D modeling
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

We present a system for 3D modeling of free-form surfaces from 2D sketches. Our system frees users to create 2D sketches from arbitrary angles using their preferred tool, which may include pencil and paper. A 3D model is created by placing primitives ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 26, Issue 3

July 2007

976 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1276377

Issue’s Table of Contents

Copyright © 2007 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Published in TOG Volume 26, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
1,385
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zheng YMa LChen YWu E(2022)Physcially Based Multi-Solvent Stains Simulation on TextileJournal of Computer-Aided Design & Computer Graphics10.3724/SP.J.1089.2022.1881234:02(315-324)Online publication date: 2-Dec-2022
https://doi.org/10.3724/SP.J.1089.2022.18812
Chang HLin T(2022)Portrait imaging relighting system based on a simplified photometric stereo methodApplied Optics10.1364/AO.45166261:15(4379)Online publication date: 16-May-2022
https://doi.org/10.1364/AO.451662
Zhang LSimo-Serra EJi YLiu C(2020)Generating Digital Painting Lighting Effects via RGB-space GeometryACM Transactions on Graphics10.1145/337217639:2(1-13)Online publication date: 24-Feb-2020
https://dl.acm.org/doi/10.1145/3372176
Su WDu DYang XZhou SFu H(2018)Interactive Sketch-Based Normal Map Generation with Deep Neural NetworksProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/32031861:1(1-17)Online publication date: 25-Jul-2018
https://dl.acm.org/doi/10.1145/3203186
Wu BRahman TTai X(2018)Sparse-Data Based 3D Surface Reconstruction for Cartoon and MapImaging, Vision and Learning Based on Optimization and PDEs10.1007/978-3-319-91274-5_3(47-64)Online publication date: 20-Nov-2018
https://doi.org/10.1007/978-3-319-91274-5_3
Zhang XGao Y(2017)3D Modeling for Environmental InformaticsDecision Management10.4018/978-1-5225-1837-2.ch047(1038-1057)Online publication date: 2017
https://doi.org/10.4018/978-1-5225-1837-2.ch047
Yeh CHuang SJayaraman PFu CLee T(2017)Interactive High-Relief Reconstruction for Organic and Double-Sided Objects from a PhotoIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.257470523:7(1796-1808)Online publication date: 1-Jul-2017
https://doi.org/10.1109/TVCG.2016.2574705
Henz BOliveira M(2017)Artistic relighting of paintings and drawingsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1150-733:1(33-46)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1007/s00371-015-1150-7
Todo HYamaguchi YBajaj CErtl TNishita TGrinspun EBickel BDobashi Y(2016)Reflectance and shape estimation for cartoon shaded objectsProceedings of the 24th Pacific Conference on Computer Graphics and Applications: Short Papers10.5555/3061425.3061431(27-32)Online publication date: 11-Oct-2016
https://dl.acm.org/doi/10.5555/3061425.3061431
Zhang XGao Y(2016)3D Modeling for Environmental InformaticsComputer Vision and Pattern Recognition in Environmental Informatics10.4018/978-1-4666-9435-4.ch010(199-218)Online publication date: 2016
https://doi.org/10.4018/978-1-4666-9435-4.ch010
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents