More Web Proxy on the site http://driver.im/

research-article

From microfacets to participating media: A unified theory of light transport with stochastic geometry

Authors:

Benedikt Bitterli,

Wojciech JaroszAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 43, Issue 4

Article No.: 112, Pages 1 - 17

https://doi.org/10.1145/3658121

Published: 19 July 2024 Publication History

Abstract

Stochastic geometry models have enjoyed immense success in graphics for modeling interactions of light with complex phenomena such as participating media, rough surfaces, fibers, and more. Although each of these models operates on the same principle of replacing intricate geometry by a random process and deriving the average light transport across all instances thereof, they are each tailored to one specific application and are fundamentally distinct. Each type of stochastic geometry present in the scene is firmly encapsulated in its own appearance model, with its own statistics and light transport average, and no cross-talk between different models or deterministic and stochastic geometry is possible.

In this paper, we derive a theory of light transport on stochastic implicit surfaces, a geometry model capable of expressing deterministic geometry, microfacet surfaces, participating media, and an exciting new continuum in between containing aggregate appearance, non-classical media, and more. Our model naturally supports spatial correlations, missing from most existing stochastic models.

Our theory paves the way for tractable rendering of scenes in which all geometry is described by the same stochastic model, while leaving ample future work for developing efficient sampling and rendering algorithms.

Supplementary Material

ZIP File (papers_124.zip)

supplemental

Download
3.34 MB

References

[1]

Robert J Adler and Jonathan E Taylor. 2009. Random fields and geometry. Springer Science & Business Media.

[2]

Jonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P. Srinivasan. 2021. Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields. Proceedings of the International Conference on Computer Vision (ICCV) (2021).

[3]

Petr Beckmann. 1965. Shadowing of random rough surfaces. IEEE Transactions on Antennas and Propagation 13, 3 (1965).

[4]

Benedikt Bitterli, Srinath Ravichandran, Thomas Müller, Magnus Wrenninge, Jan Novák, Steve Marschner, and Wojciech Jarosz. 2018. A Radiative Transfer Framework for Non-Exponential Media. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 37, 6 (Nov. 2018), 225:1--225:17.

[5]

Patrick Boissé. 1990. Radiative transfer inside clumpy media-The penetration of UV photons inside molecular clouds. Astronomy and Astrophysics 228 (1990). http://adsabs.harvard.edu/abs/1990A%26A...228.483B

[6]

Christophe Bourlier, Joseph Saillard, and Gerard Berginc. 2000. Effect of correlation between shadowing and shadowed points on the Wagner and Smith monostatic one-dimensional shadowing functions. IEEE Transactions on Antennas and Propagation 48, 3 (March 2000).

[7]

Alan J Bray, Satya N Majumdar, and Grégory Schehr. 2013. Persistence and first-passage properties in nonequilibrium systems. Advances in Physics 62, 3 (June 2013).

[8]

Ken Brodlie, Rodolfo Allendes Osorio, and Adriano Lopes. 2012. A review of uncertainty in data visualization. In Expanding the Frontiers of Visual Analytics and Visualization. Springer London, London.

[9]

Antonio Buonocore, Amelia G. Nobile, and Luigi M. Ricciardi. 1987. A New Integral Equation for the Evaluation of First-Passage-Time Probability Densities. Adv. Appl. Probab. 19, 4 (1987).

[10]

Anthony B. Davis and Mark B. Mineev-Weinstein. 2011. Radiation Propagation in Random Media: From Positive to Negative Correlations in High-Frequency Fluctuations. Journal of Quantitative Spectroscopy and Radiative Transfer 112, 4 (March 2011), 632--645.

[11]

Amir Dembo and Sumit Mukherjee. 2017. Persistence of Gaussian processes: non-summable correlations. Probab. Theory Relat. Fields 169, 3--4 (Dec. 2017).

[12]

Eugene d'Eon. 2021. An Analytic BRDF for Materials with Spherical Lambertian Scatterers. Computer Graphics Forum (Proceedings of the Eurographics Symposium on Rendering) 40, 4 (2021), 153--161.

[13]

Eugene d'Eon. 2023. Student-T and beyond: Practical tools for multiple-scattering BSDFs with general NDFs. In ACM SIGGRAPH 2023 Talks. ACM, New York, NY, USA.

Digital Library

[14]

Eric Dexheimer and Andrew J. Davison. 2023. Learning a Depth Covariance Function. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE.

[15]

Stanimir Dragiev, Marc Toussaint, and Michael Gienger. 2011. Gaussian process implicit surfaces for shape estimation and grasping. In 2011 IEEE International Conference on Robotics and Automation. ieeexplore.ieee.org.

[16]

Jonathan Dupuy, Eric Heitz, and Eugene d'Eon. 2016. Additional Progress towards the Unification of Microfacet and Microflake Theories. In Proceedings of EGSR (Experimental Ideas & Implementations). Eurographics Association, 55--63.

[17]

Jonathan Dupuy, Eric Heitz, Jean-Claude Iehl, Pierre Poulin, Fabrice Neyret, and Victor Ostromoukhov. 2013. Linear Efficient Antialiased Displacement and Reflectance Mapping. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 32, 6, Article 211 (2013), 11 pages.

[18]

Eugene d'Eon. 2018. A reciprocal formulation of nonexponential radiative transfer. 1: Sketch and motivation. Journal of Computational and Theoretical Transport 47, 1--3 (2018).

[19]

Eugene d'Eon. 2023. Beyond Renewal Approximations: A 1D Point Process Approach to Linear Transport in Stochastic Media. ANS M&C 2023 - The international conference on Mathematics and Computational Methods Applied to Nuclear Science and Engineering - Niagara Falls, Ontario, Canada, Aug. (2023).

[20]

David S. Ebert, F. Kenton Musgrave, Darwyn Peachey, Kenneth Perlin, and Steven Worley. 2003. Texturing and modeling: a procedural approach (3rd ed.). Morgan Kaufmann, San Francisco, CA, USA.

Digital Library

[21]

Anne Estrade, Ileana Iribarren, and Marie Kratz. 2012. Chord-length distribution functions and Rice formulae. Application to random media. Extremes 15, 3 (Sept. 2012).

[22]

Nathaniel Fout and Kwan-Liu Ma. 2012. Fuzzy volume rendering. IEEE Transactions on Visualization and Computer Graphics 18, 12 (Dec. 2012).

Digital Library

[23]

Sara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. 2022. Plenoxels: Radiance Fields without Neural Networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]

Leonid Fukshansky, A. Martinez von Remisoksky, and John McClendon. 1993. Absorption spectra of leaves corrected for scattering and distributional error: a radiative transfer and absorption statistics treatment. Photochemistry and Photobiology 57, 3 (1993), 538--555.

[25]

Bruno Galerne, Ares Lagae, Sylvain Lefebvre, and George Drettakis. 2012. Gabor noise by example. ACM Transactions on Graphics 31, 4 (Aug. 2012).

Digital Library

[26]

Manuel Gamito. 2009. Techniques for Stochastic Implicit Surface Modelling and Rendering. Ph. D. Dissertation. University of Sheffield. https://etheses.whiterose.ac.uk/116/

[27]

Pascal Guehl, Rémi Allègre, J-M Dischler, Bedrich Benes, and Eric Galin. 2020. Semi-procedural textures using point process texture basis functions. Computer Graphics Forum 39, 4 (July 2020).

[28]

Kurtis Robert Gurley. 1997. Modelling and simulation of non-Gaussian processes. Ph. D. Dissertation. University of Notre Dame.

[29]

John C. Hart. 1996. Sphere Tracing: A Geometric Method for the Antialiased Ray Tracing of Implicit Surfaces. The Visual Computer 12, 10 (Dec. 1996), 527--545.

[30]

John C. Hart, Ed Bachta, Wojciech Jarosz, and Terry Fleury. 2002. Using Particles to Sample and Control More Complex Implicit Surfaces. In Proceedings of Shape Modeling International. 129--136.

[31]

Eric Heitz, Jonathan Dupuy, Cyril Crassin, and Carsten Dachsbacher. 2015. The SGGX Microflake Distribution. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 34, 4 (July 2015), 48:1--48:11.

Digital Library

[32]

Han-Ping Hong, M Y Xiao, Xizhong Cui, and Yongxu Liu. 2023. A framework for conditional simulation of nonstationary non-Gaussian random field and multivariate processes. Mechanical Systems and Signal Processing 183, 109646 (Jan. 2023).

[33]

Shuping Huang, ST Quek, and K. Phoon. 2001. Convergence study of the truncated Karhunen-Loeve expansion for simulation of stochastic processes. International journal for numerical methods in engineering 52, 9 (2001).

[34]

Wenzel Jakob, Adam Arbree, Jonathan T. Moon, Kavita Bala, and Steve Marschner. 2010. A Radiative Transfer Framework for Rendering Materials with Anisotropic Structure. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 29, 4 (July 2010), 53:1--53:13.

Digital Library

[35]

Adrian Jarabo, Carlos Aliaga, and Diego Gutierrez. 2018. A Radiative Transfer Framework for Spatially-Correlated Materials. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 37, 4 (July 2018), 83:1--83:13.

[36]

Yang Jiao, F H Stillinger, and Salvatore Torquato. 2007. Modeling heterogeneous materials via two-point correlation functions: basic principles. Physical Review E 76 (Sept. 2007).

[37]

Yang Jiao, F H Stillinger, and Salvatore Torquato. 2008. Modeling heterogeneous materials via two-point correlation functions. II. Algorithmic details and applications. Physical Review E 77 (March 2008).

[38]

James T. Kajiya. 1986. The Rendering Equation. Computer Graphics (Proceedings of SIGGRAPH) 20, 4 (Aug. 1986), 143--150.

Digital Library

[39]

John T. O. Kirk. 1975. A theoretical analysis of the contribution of algal cells to the attenuation of light within natural waters I. General treatment of suspensions of pigmented cells. New phytologist 75, 1 (1975).

[40]

Georg Lindgren, Krzysztof Podgorski, and Igor Rychlik. 2020. Effective computations of joint excursion times for stationary Gaussian processes. (July 2020). arXiv:2007.14220 [math.PR] http://arxiv.org/abs/2007.14220

[41]

Yu-Tao Liu, Li Wang, Jie Yang, Weikai Chen, Xiaoxu Meng, Bo Yang, and Lin Gao. 2023. NeUDF: Leaning Neural Unsigned Distance Fields with Volume Rendering. In Computer Vision and Pattern Recognition (CVPR).

[42]

Binglin Lu and Salvatore Torquato. 1992. Lineal-path function for random heterogeneous materials. Physical Review A 45, 2 (Jan. 1992).

[43]

Wolfram Martens, Yannick Poffet, Pablo Ramón Soria, Robert Fitch, and Salah Sukkarieh. 2017. Geometric Priors for Gaussian Process Implicit Surfaces. IEEE Robotics and Automation Letters 2, 2 (April 2017).

[44]

Media Molecule. 2020. Dreams. https://www.mediamolecule.com/games/dreams

[45]

Johannes Meng, Marios Papas, Ralf Habel, Carsten Dachsbacher, Steve Marschner, Markus Gross, and Wojciech Jarosz. 2015. Multi-Scale Modeling and Rendering of Granular Materials. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 34, 4 (July 2015), 49:1--49:13.

[46]

Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng. 2020. NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. In Proceedings of the European Conference on Computer Vision (ECCV).

Digital Library

[47]

Jonathan T. Moon, Bruce Walter, and Stephen R. Marschner. 2007. Rendering Discrete Random Media Using Precomputed Scattering Solutions. In Rendering Techniques (Proceedings of the Eurographics Symposium on Rendering). Eurographics Association, 231--242.

[48]

Joy N Mueller, Khachik Sargsyan, and Habib N Najm. 2023. Polynomial Chaos Surrogate Construction for Stochastic Models with Parametric Uncertainty. In 14th International Conference on Applications of Statistics and Probability in Civil Engineering (ICASP14), Dublin, Ireland.

[49]

Thomas Müller, Alex Evans, Christoph Schied, and Alexander Keller. 2022. Instant Neural Graphics Primitives with a Multiresolution Hash Encoding. ACM Transactions on Graphics 41, 4, Article 102 (July 2022), 15 pages.

Digital Library

[50]

Thomas Müller, Marios Papas, Markus Gross, Wojciech Jarosz, and Jan Novák. 2016. Efficient Rendering of Heterogeneous Polydisperse Granular Media. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 35, 6 (Nov. 2016), 168:1--168:14.

[51]

Marcus M Noack and James A Sethian. 2022. Advanced stationary and nonstationary kernel designs for domain-aware gaussian processes. Communications in Applied Mathematics and Computational Science 17, 1 (2022).

[52]

Marc Olano and Dan Baker. 2010. LEAN Mapping. In Proceedings of the Symposium on Interactive 3D Graphics and Games. 181--188.

[53]

Christopher J Paciorek and Mark J Schervish. 2006. Spatial modelling using a new class of nonstationary covariance functions. Environmetrics 17, 5 (2006).

[54]

Tobias Pfaffelmoser, Matthias Reitinger, and Rüdiger Westermann. 2011. Visualizing the positional and geometrical variability of isosurfaces in uncertain scalar fields. Computer Graphics Forum 30, 3 (June 2011).

Digital Library

[55]

Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically Based Rendering: From Theory to Implementation (3 ed.). Morgan Kaufmann, Cambridge, MA.

[56]

Gerald C Pomraning. 1991. Linear kinetic theory and particle transport in stochastic mixtures. Vol. 7. World Scientific.

[57]

Ali Rahimi and Benjamin Recht. 2007. Random Features for Large-Scale Kernel Machines. In Advances in Neural Information Processing Systems (NIPS). Curran Associates Inc., Red Hook, NY, USA, 1177--1184.

[58]

Anthony P. Roberts and Salvatore Torquato. 1999. Chord-distribution functions of three-dimensional random media: approximate first-passage times of Gaussian processes. Physical Review E 59, 5 Pt A (May 1999).

[59]

Rohan Sawhney and Keenan Crane. 2020. Monte Carlo Geometry Processing: A Grid-Free Approach to PDE-based Methods on Volumetric Domains. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 39, 4 (2020).

[60]

Silvia Sellán and Alec Jacobson. 2022. Stochastic Poisson Surface Reconstruction. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 41, 6 (Dec. 2022).

[61]

Silvia Sellán and Alec Jacobson. 2023. Neural Stochastic Screened Poisson Reconstruction. ACM SIGGRAPH Asia Conference Papers (2023).

[62]

Michael D. Shields, George Deodatis, and Paolo Bocchini. 2011. A simple and efficient methodology to approximate a general non-Gaussian stationary stochastic process by a translation process. Probabilistic Engineering Mechanics 26, 4 (Oct. 2011).

[63]

B. Smith. 1967. Geometrical Shadowing of a Random Rough Surface. IEEE Transactions on Antennas and Propagation 15, 5 (Sept. 1967), 668--671.

[64]

Ralph C Smith. 2013. Uncertainty quantification: theory, implementation, and applications. Vol. 12. Siam.

[65]

Jorge Stol and Luiz Henrique De Figueiredo. 1997. Self-validated numerical methods and applications. In Monograph for 21st Brazilian Mathematics Colloquium, IMPA, Rio de Janeiro. Citeseer, Vol. 5. Citeseer.

[66]

Ryusuke Sugimoto, Terry Chen, Yiti Jiang, Christopher Batty, and Toshiya Hachisuka. 2023. A Practical Walk-on-Boundary Method for Boundary Value Problems. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 42, 4 (July 2023), 81:1--81:16.

[67]

Towaki Takikawa, Andrew Glassner, and Morgan McGuire. 2022. A Dataset and Explorer for 3D Signed Distance Functions. Journal of Computer Graphics Techniques (JCGT) 11, 2 (27 April 2022), 1--29. http://jcgt.org/published/0011/02/01/

[68]

Michael Eugene Taylor. 2006. Measure theory and integration. American Mathematical Society.

[69]

Salvatore Torquato. 1986. Microstructure Characterization and Bulk Properties of Disordered Two-Phase Media. Journal of Statistical Physics 45, 5 (Dec. 1986), 843--873.

[70]

Salvatore Torquato. 2005. Random Heterogeneous Materials: Microstructure and Macroscopic Properties. Springer New York.

[71]

S. Torquato and B. Lu. 1993. Chord-Length Distribution Function for Two-Phase Random Media. Physical Review E 47, 4 (April 1993), 2950--2953.

[72]

V. Tuchin. 2000. Tissue Optics: Light Scattering Methods and Instruments for Medical Diagnosis.

[73]

Delio Vicini, Wenzel Jakob, and Anton Kaplanyan. 2021. A Non-Exponential Transmittance Model for Volumetric Scene Representations. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 40, 4 (July 2021), 136:1--136:16.

Digital Library

[74]

Emily H Vu and Aaron J Olson. 2021. Conditional Point Sampling: A Stochastic Media Transport Algorithm with Full Geometric Sampling Memory. Journal of Quantitative Spectroscopy and Radiative Transfer (2021).

[75]

Bruce Walter, Stephen R. Marschner, Hongsong Li, and Kenneth E. Torrance. 2007. Microfacet Models for Refraction through Rough Surfaces. In Rendering Techniques (Proceedings of the Eurographics Symposium on Rendering). Eurographics Association, 195--206.

[76]

Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang. 2021. NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction. Advances in Neural Information Processing Systems (NIPS) 34 (2021).

[77]

Philippe Weier, Tobias Zirr, Anton Kaplanyan, Ling-Qi Yan, and Philipp Slusallek. 2023. Neural Prefiltering for Correlation-Aware Levels of Detail. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 42, 4 (July 2023), 78:1--78:16.

[78]

Christopher KI Williams and Carl Edward Rasmussen. 2006. Gaussian processes for machine learning. Vol. 2. MIT press Cambridge, MA.

[79]

Michael M. R. Williams. 1974. Random processes in nuclear reactors. Pergamon Press.

[80]

Oliver Williams and Andrew Fitzgibbon. 2006. Gaussian process implicit surfaces. In Gaussian Processes in Practice.

[81]

Andrew P. Witkin and Paul S. Heckbert. 1994. Using Particles to Sample and Control Implicit Surfaces. In Annual Conference Series (Proceedings of SIGGRAPH). ACM, New York, NY, USA, 269--277.

[82]

George Zimmerman and Marvin L Adams. 1991. Algorithms for Monte Carlo particle transport in binary statistical mixtures. Transactions of the American Nuclear Society 64 (1991).

Cited By

Chen XFeng ZSun KQian KZhang XShu YLiu JTan RHe YChen J(2024)RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF MeasurementsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699351(464-477)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699351

Index Terms

From microfacets to participating media: A unified theory of light transport with stochastic geometry
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
      1. Volumetric models

Recommendations

Efficient Simulation of Light Transport in Scenes with Participating Media Using Photon Maps
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

This paper presents a new method for computing global illumination in scenes with participating media. The method is based on bidirectional Monte Carlo ray tracing and uses photon maps to increase efficiency and reduce noise. We remove previous ...
Point-based light transport for participating media with refractive boundaries
EGSR '16: Proceedings of the Eurographics Symposium on Rendering: Experimental Ideas & Implementations

Illumination effects in translucent materials are a combination of several physical phenomena: absorption and scattering inside the material, refraction at its surface. Because refraction can focus light deep inside the material, where it will be ...
Parallel MDOM for light transport in participating media
SCCG '13: Proceedings of the 29th Spring Conference on Computer Graphics

We present a novel technique for physically based rendering of participating media like cloud, smoke, wax, marble, etc. We solve the radiative transfer equation (RTE) for participating media using the Modified Discrete Ordinate Method (MDOM), which ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 43, Issue 4

July 2024

1774 pages

EISSN:1557-7368

DOI:10.1145/3675116

Issue’s Table of Contents

Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2024

Published in TOG Volume 43, Issue 4

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
530
Total Downloads

Downloads (Last 12 months)530
Downloads (Last 6 weeks)110

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen XFeng ZSun KQian KZhang XShu YLiu JTan RHe YChen J(2024)RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF MeasurementsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699351(464-477)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699351

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents