[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article
Open access

Tessellation-free displacement mapping for ray tracing

Published: 10 December 2021 Publication History

Abstract

Displacement mapping is a powerful mechanism for adding fine to medium geometric details over a 3D surface using a 2D map encoding them. While GPU rasterization supports it through the hardware tessellation unit, ray tracing surface meshes textured with high quality displacement requires a significant amount of memory. More precisely, the input surface needs to be pre-tessellated at the displacement map resolution before being enriched with its mandatory acceleration data structure. Consequently, designing displacement maps interactively while enjoying a full physically-based rendering is often impossible, as simply tiling multiple times the map quickly saturates the graphics memory. In this work we introduce a new tessellation-free displacement mapping approach for ray tracing. Our key insight is to decouple the displacement from its base domain by mapping a displacement-specific acceleration structures directly on the mesh. As a result, our method shows low memory footprint and fast high resolution displacement rendering, making interactive displacement editing possible.

Supplementary Material

MP4 File (a282-thonat.mp4)

References

[1]
Lionel Baboud, Elmar Eisemann, and Hans-Peter Seidel. 2011. Precomputed safety shapes for efficient and accurate height-field rendering. IEEE transactions on visualization and computer graphics 18, 11 (2011), 1811--1823.
[2]
Carsten Benthin, Sven Woop, Matthias Nießner, Kai Selgrad, and Ingo Wald. 2015. Efficient Ray Tracing of Subdivision Surfaces Using Tessellation Caching. In Proceedings of the 7th Conference on High-Performance Graphics. 5--12.
[3]
James F Blinn. 1978. Simulation of wrinkled surfaces. ACM SIGGRAPH computer graphics 12, 3 (1978), 286--292.
[4]
J. Burgess. 2020. RTX on---The NVIDIA Turing GPU. IEEE Micro 40, 2 (2020), 36--44.
[5]
Nathan A Carr, Jared Hoberock, Keenan Crane, and John C Hart. 2006. Fast GPU ray tracing of dynamic meshes using geometry images. In Graphics Interface, Vol. 2006. Citeseer, 203--209.
[6]
Ying-Chieh Chen and Chun-Fa Chang. 2008. A Prism-Free Method for Silhouette Rendering in Inverse Displacement Mapping. Comput. Graph. Forum 27 (10 2008), 1929--1936.
[7]
Per H. Christensen, David M. Laur, Julia Fong, Wayne L. Wooten, and Dana Batali. 2003. Ray Differentials and Multiresolution Geometry Caching for Distribution Ray Tracing in Complex Scenes. Computer Graphics Forum 22, 3 (2003), 543--552. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/1467-8659.t01-1-00702
[8]
Robert L Cook. 1984. Shade trees. In Proceedings of the 11th annual conference on Computer graphics and interactive techniques. 223--231.
[9]
C. Dachsbacher and Natalya Tatarchuk. 2007. Prism Parallax Occlusion Mapping with Accurate Silhouette Generation.
[10]
Luiz Henrique De Figueiredo and Jorge Stolfi. 2004. Affine arithmetic: concepts and applications. Numerical Algorithms 37, 1-4 (2004), 147--158.
[11]
Peter Djeu, Warren Hunt, Rui Wang, Ikrima Elhassan, Gordon Stoll, and William R. Mark. 2011. Razor: An Architecture for Dynamic Multiresolution Ray Tracing. ACM Trans. Graph. 30, 5, Article 115 (Oct. 2011), 26 pages.
[12]
William Donnelly. 2005. Per-pixel displacement mapping with distance functions. GPU gems 2, 22 (2005), 3.
[13]
Tom Duff, James Burgess, Per Christensen, Christophe Hery, Andrew Kensler, Max Liani, and Ryusuke Villemin. 2017. Building an orthonormal basis, revisited. Journal of Computer Graphics Techniques (JCGT) 6, 1 (2017).
[14]
Jonathan Dummer. 2006. Cone step mapping: An iterative ray-heightfield intersection algorithm. URL: http://www.lonesock.net/files/ConeStepMapping.pdf 2, 3 (2006), 4.
[15]
Elmer G Gilbert, Daniel W Johnson, and S Sathiya Keerthi. 1988. A fast procedure for computing the distance between complex objects in three-dimensional space. IEEE Journal on Robotics and Automation 4, 2 (1988), 193--203.
[16]
Johannes Hanika, Alexander Keller, and Hendrik P. A. Lensch. 2010. Two-Level Ray Tracing with Reordering for Highly Complex Scenes. In Proceedings of Graphics Interface 2010 (Ottawa, Ontario, Canada) (GI '10). Canadian Information Processing Society, CAN, 145--152.
[17]
John C Hart. 1996. Sphere tracing: A geometric method for the antialiased ray tracing of implicit surfaces. The Visual Computer 12, 10 (1996), 527--545.
[18]
W. Heidrich and H. Seidel. 1998. Ray-tracing Procedural Displacement Shaders. In Graphics Interface.
[19]
Johannes Hirche, Alexander Ehlert, Stefan Guthe, and Michael Doggett. 2004. Hardware Accelerated Per-Pixel Displacement Mapping. In Proceedings of Graphics Interface 2004 (London, Ontario, Canada) (GI '04). Canadian Human-Computer Communications Society, Waterloo, CAN, 153--158.
[20]
Qiming Hou, Hao Qin, Wenyao Li, Baining Guo, and Kun Zhou. 2010. Micropolygon Ray Tracing with Defocus and Motion Blur. In ACM SIGGRAPH 2010 Papers (Los Angeles, California) (SIGGRAPH '10). Association for Computing Machinery, New York, NY, USA, Article 64, 10 pages.
[21]
Warren Hunt, William R. Mark, and Don Fussell. 2007. Fast and Lazy Build of Acceleration Structures from Scene Hierarchies. In 2007 IEEE Symposium on Interactive Ray Tracing. 47--54.
[22]
Stefan Jeschke, Stephan Mantler, and Michael Wimmer. 2007. Interactive Smooth and Curved Shell Mapping. In Proceedings of the 18th Eurographics Conference on Rendering Techniques (Grenoble, France) (EGSR'07). Eurographics Association, Goslar, DEU, 351--360.
[23]
Tomomichi Kaneko, Toshiyuki Takahei, Masahiko Inami, Naoki Kawakami, Yasuyuki Yanagida, Taro Maeda, and Susumu Tachi. 2001. Detailed shape representation with parallax mapping. In Proceedings of ICAT, Vol. 2001. 205--208.
[24]
Khronos. 2020. Vulkan Ray Tracing specification. https://www.khronos.org/blog/vulkan-ray-tracing-final-specification-release
[25]
L. Lee, Shih-Wei Tseng, and W. Tai. 2009. Improved Relief Texture Mapping Using Minmax Texture. 2009 Fifth International Conference on Image and Graphics (2009), 547--552.
[26]
Alexander Lier, Magdalena Martinek, Marc Stamminger, and Kai Selgrad. 2018. A High-Resolution Compression Scheme for Ray Tracing Subdivision Surfaces with Displacement. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 2 (2018), 1--17.
[27]
Songrun Liu, Zachary Ferguson, Alec Jacobson, and Yotam Gingold. 2017. Seamless: Seam erasure and seam-aware decoupling of shape from mesh resolution. ACM Transactions on Graphics (TOG) 36, 6, Article 216 (Nov. 2017), 15 pages.
[28]
The-Kiet Lu, K. Low, and J. Zheng. 2009. Fast visualization of complex 3D models using displacement mapping. In Graphics Interface.
[29]
Jeffrey A. Mahovsky. 2005. Ray Tracing with Reduced-Precision Bounding Volume Hierarchies. Ph.D. Dissertation. CAN.
[30]
William Martin, Elaine Cohen, Russell Fish, and Peter Shirley. 2000. Practical ray tracing of trimmed NURBS surfaces. Journal of Graphics Tools 5, 1 (2000), 27--52.
[31]
Tomas Möller and Ben Trumbore. 1997. Fast, minimum storage ray-triangle intersection. Journal of graphics tools 2, 1 (1997), 21--28.
[32]
Henry Moreton. 2001. Watertight Tessellation Using Forward Differencing. In Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Workshop on Graphics Hardware (Los Angeles, California, USA) (HWWS '01). Association for Computing Machinery, New York, NY, USA, 25--32.
[33]
K. Moule and M. McCool. 2002. Efficient Bounded Adaptive Tessellation of Displacement Maps. In Graphics Interface.
[34]
J. Munkberg, J. Hasselgren, Robert Toth, and T. Akenine-Möller. 2010. Efficient bounding of displaced Bézier patches. In HPG '10.
[35]
M. Nießner and C. Loop. 2013. Analytic Displacement Mapping using Hardware Tessellation. ACM Transactions on Graphics (TOG) 32, 3 (2013), 26.
[36]
Matthias Nießner, Charles Loop, Mark Meyer, and Tony Derose. 2012. Feature-Adaptive GPU Rendering of Catmull-Clark Subdivision Surfaces. ACM Trans. Graph. 31, 1, Article 6 (Feb. 2012), 11 pages.
[37]
NVIDIA. 2020. RTX Technology - RT Cores. https://developer.nvidia.com/rtx/raytracing#rtcores
[38]
Kyoungsu Oh, Hyunwoo Ki, and Cheol-Hi Lee. 2006. Pyramidal displacement mapping: a gpu based artifacts-free ray tracing through an image pyramid. In Proceedings of the ACM symposium on Virtual reality software and technology. 75--82.
[39]
Manuel Oliveira and Fabio Policarpo. 2005. An Efficient Representation for Surface Details. UFRGS Technical Report RP-351 (01 2005).
[40]
Afonso Paiva, Filipe de Carvalho Nascimento, Luiz Henrique de Figueiredo, and Jorge Stolfi. 2012. Approximating implicit curves on triangulations with affine arithmetic. In 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images. IEEE, 94--101.
[41]
Matt Pharr and Pat Hanrahan. 1996. Geometry Caching for Ray-Tracing Displacement Maps. In Proceedings of the Eurographics Workshop on Rendering Techniques '96 (Porto, Portugal). Springer-Verlag, Berlin, Heidelberg, 31--ff.
[42]
M. Pharr, Craig E. Kolb, Reid Gershbein, and P. Hanrahan. 1997. Rendering complex scenes with memory-coherent ray tracing. Proceedings of the 24th annual conference on Computer graphics and interactive techniques (1997).
[43]
Fabio Policarpo and Manuel M Oliveira. 2007. Relaxed cone stepping for relief mapping. GPU gems 3 (2007), 409--428.
[44]
Fábio Policarpo, Manuel M Oliveira, and Joäo LD Comba. 2005. Real-time relief mapping on arbitrary polygonal surfaces. In Proceedings of the 2005 symposium on Interactive 3D graphics and games. 155--162.
[45]
Serban D. Porumbescu, Brian Budge, Louis Feng, and Kenneth I. Joy. 2005. Shell Maps. ACM Trans. Graph. 24, 3 (July 2005), 626--633.
[46]
Andreas Reich, Tobias Günther, and Thorsten Grosch. 2015. Illumination-driven Mesh Reduction for Accelerating Light Transport Simulations. Computer Graphics Forum 34, 4 (2015), 165--174.
[47]
Siegfried M Rump and Masahide Kashiwagi. 2015. Implementation and improvements of affine arithmetic. Nonlinear Theory and Its Applications, IEICE 6, 3 (2015), 341--359.
[48]
Kai Selgrad, Alexander Lier, Magdalena Martinek, Christoph Buchenau, Michael Guthe, Franziska Kranz, Henry Schäfer, and Marc Stamminger. 2016. A Compressed Representation for Ray Tracing Parametric Surfaces. ACM Trans. Graph. 36, 1, Article 5 (2016), 13 pages.
[49]
Christian Sigg and Markus Hadwiger. 2005. Fast third-order texture filtering. GPU gems 2 (2005), 313--329.
[50]
Brian Smits, Peter Shirley, and Michael M Stark. 2000. Direct ray tracing of displacement mapped triangles. In Eurographics Workshop on Rendering Techniques. Springer, 307--318.
[51]
L. Szirmay-Kalos and Tamás Umenhoffer. 2008. Displacement Mapping on the GPU --- State of the Art. Computer Graphics Forum 27 (2008).
[52]
László Szirmay-Kalos, Tamás Umenhoffer, Gustavo Patow, László Szécsi, and Mateu Sbert. 2009. Specular effects on the gpu: State of the art. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 1586--1617.
[53]
Natalya Tatarchuk. 2006. Dynamic parallax occlusion mapping with approximate soft shadows. In Proceedings of the 2006 symposium on Interactive 3D graphics and games. 63--69.
[54]
Art Tevs, Ivo Ihrke, and Hans-Peter Seidel. 2008. Maximum mipmaps for fast, accurate, and scalable dynamic height field rendering. In Proceedings of the 2008 symposium on Interactive 3D graphics and games. 183--190.
[55]
Ingo Wald, Sven Woop, Carsten Benthin, Gregory S Johnson, and Manfred Ernst. 2014. Embree: a kernel framework for efficient CPU ray tracing. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--8.
[56]
Lifeng Wang, Xi Wang, Xin Tong, Stephen Lin, Shimin Hu, Baining Guo, and Heung-Yeung Shum. 2003. View-dependent displacement mapping. ACM Transactions on graphics (TOG) 22, 3 (2003), 334--339.
[57]
X. Wang, J. Maillot, E. Fiume, V. Ng-Thow-Hing, Andrew Woo, and S. Bakshi. 2000. Feature-based Displacement Mapping. In Rendering Techniques.
[58]
Xi Wang, Xin Tong, Stephen Lin, Shimin Hu, Baining Guo, and Heung-Yeung Shum. 2004. Generalized displacement maps. In Proceedings of the Fifteenth Eurographics conference on Rendering Techniques. 227--233.
[59]
Amy Williams, Steve Barrus, R Keith Morley, and Peter Shirley. 2005. An efficient and robust ray-box intersection algorithm. In ACM SIGGRAPH 2005 Courses. 9--es.
[60]
Keith Yerex and Martin Jägersand. 2004. Displacement mapping with ray-casting in hardware. In SIGGRAPH sketches. 149.

Cited By

View all
  • (2024)Ray Tracing Animated Displaced Micro‐MeshesComputer Graphics Forum10.1111/cgf.1522543:7Online publication date: 30-Oct-2024
  • (2024)A Hierarchical Architecture for Neural MaterialsComputer Graphics Forum10.1111/cgf.1511643:6Online publication date: 15-May-2024
  • (2024)QUADify: Extracting Meshes with Pixel-Level Details and Materials from Images2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00446(4661-4670)Online publication date: 16-Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 40, Issue 6
December 2021
1351 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3478513
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 December 2021
Published in TOG Volume 40, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. affine arithmetic
  2. displacement mapping
  3. ray tracing

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)515
  • Downloads (Last 6 weeks)35
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Ray Tracing Animated Displaced Micro‐MeshesComputer Graphics Forum10.1111/cgf.1522543:7Online publication date: 30-Oct-2024
  • (2024)A Hierarchical Architecture for Neural MaterialsComputer Graphics Forum10.1111/cgf.1511643:6Online publication date: 15-May-2024
  • (2024)QUADify: Extracting Meshes with Pixel-Level Details and Materials from Images2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00446(4661-4670)Online publication date: 16-Jun-2024
  • (2024)WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D GaussiansComputer Vision – ECCV 202410.1007/978-3-031-72664-4_17(298-314)Online publication date: 26-Oct-2024
  • (2023)AN EFFICIENT TECHNOLOGY OF REAL-TIME MODELING OF HEIGHT FIELD SURFACE ON THE RAY TRACING PIPELINEПрограммирование10.31857/S0132347423030068(56-64)Online publication date: 1-May-2023
  • (2023)Locally-Adaptive Level-of-Detail for Hardware-Accelerated Ray TracingACM Transactions on Graphics10.1145/361835942:6(1-15)Online publication date: 5-Dec-2023
  • (2023)Joint UV Optimization and Texture BakingACM Transactions on Graphics10.1145/361768343:1(1-20)Online publication date: 28-Sep-2023
  • (2023)Nonlinear Ray Tracing for Displacement and Shell MappingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618199(1-10)Online publication date: 10-Dec-2023
  • (2023)RMIP: Displacement ray tracing via inversion and oblong boundingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618182(1-11)Online publication date: 10-Dec-2023
  • (2023)An Efficient Technology of Real-Time Modeling of Height Field Surface on the Ray Tracing PipelineProgramming and Computing Software10.1134/S036176882303006449:3(178-186)Online publication date: 1-Jun-2023
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media