[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article
Open access

Differentiable Owen Scrambling

Published: 19 November 2024 Publication History

Abstract

Quasi-Monte Carlo integration is at the core of rendering. This technique estimates the value of an integral by evaluating the integrand at well-chosen sample locations. These sample points are designed to cover the domain as uniformly as possible to achieve better convergence rates than purely random points. Deterministic low-discrepancy sequences have been shown to outperform many competitors by guaranteeing good uniformity as measured by the so-called discrepancy metric, and, indirectly, by an integer t value relating the number of points falling into each domain stratum with the stratum area (lower t is better). To achieve randomness, scrambling techniques produce multiple realizations preserving the t value, making the construction stochastic. Among them, Owen scrambling is a popular approach that recursively permutes intervals for each dimension. However, relying on permutation trees makes it incompatible with smooth optimization frameworks. We present a differentiable Owen scrambling that regularizes permutations. We show that it can effectively be used with automatic differentiation tools for optimizing low-discrepancy sequences to improve metrics such as optimal transport uniformity, integration error, designed power spectra or projective properties, while maintaining their initial t-value as guaranteed by Owen scrambling. In some rendering settings, we show that our optimized sequences improve the rendering error.

References

[1]
Abdalla G.M. Ahmed, Hélène Perrier, David Coeurjolly, Victor Ostromoukhov, Jianwei Guo, Dongming Yan, Hui Huang, and Oliver Deussen. 2016. Low-Discrepancy Blue Noise Sampling. ACM Transactions on Graphics 35, 6 (2016).
[2]
Abdalla G.M. Ahmed, Matt Pharr, and Peter Wonka. 2023a. ART-Owen Scrambling. ACM Transactions on Graphics 42, 6 (2023), 1--11.
[3]
Abdalla G.M. Ahmed, Jing Ren, and Peter Wonka. 2022. Gaussian Blue Noise. ACM Transactions on Graphics 41, 6, Article 260 (Nov. 2022), 15 pages.
[4]
Abdalla G.M. Ahmed, Mikhail Skopenkov, Markus Hadwiger, and Peter Wonka. 2023b. Analysis and Synthesis of Digital Dyadic Sequences. ACM Transactions on Graphics 42, 6, Article 218 (Dec. 2023), 17 pages.
[5]
Abdalla G.M. Ahmed and Peter Wonka. 2021. Optimizing Dyadic Nets. ACM Transactions on Graphics 40, 4, Article 141 (jul 2021), 17 pages.
[6]
Michael Balzer, Thomas Schlömer, and Oliver Deussen. 2009. Capacity-constrained Point Distributions: a Variant of Lloyd's Method. ACM Transactions on Graphics 28, 3, Article 86 (jul 2009), 8 pages.
[7]
Paul Bratley and Bennett L. Fox. 1988. Algorithm 659: Implementing Sobol's Quasi-random Sequence Generator. ACM Trans. Math. Softw. 14, 1 (mar 1988), 88--100.
[8]
Samuel Burer and Adam N Letchford. 2012. Non-convex Mixed-integer Nonlinear Programming: A Survey. Surveys in Operations Research and Management Science 17, 2 (2012), 97--106.
[9]
Brent Burley. 2020. Practical Hash-based Owen Scrambling. Journal of Computer Graphics Techniques (JCGT) 10, 4 (December 2020), 1--20. http://jcgt.org/published/0009/04/01/
[10]
Stanley H Chan, Todd Zickler, and Yue M Lu. 2014. Monte Carlo Non-local Means: Random Sampling for Large-scale Image Filtering. IEEE Transactions on Image Processing 23, 8 (2014), 3711--3725.
[11]
Zhonggui Chen, Zhan Yuan, Yi-King Choi, Ligang Liu, and Wenping Wang. 2012. Variational Blue Noise Sampling. IEEE Transactions on Visualization and Computer Graphics 18 (03 2012).
[12]
Per Christensen, Andrew Kensler, and Charlie Kilpatrick. 2018. Progressive Multi-Jittered Sample Sequences. Computer Graphics Forum 37, 4 (2018), 21--33.
[13]
Robert L. Cook. 1986. Stochastic Sampling in Computer Graphics. ACM Transactions on Graphics 5, 1 (1986), 51--72.
[14]
Roy Cranley and Thomas NL Patterson. 1976. Randomization of Number Theoretic Methods for Multiple Integration. SIAM J. Numer. Anal. 13, 6 (1976), 904--914.
[15]
Fernando de Goes, Katherine Breeden, Victor Ostromoukhov, and Mathieu Desbrun. 2012. Blue Noise Through Optimal Transport. ACM Transactions on Graphics 31, 6, Article 171 (nov 2012), 11 pages.
[16]
Qiang Du, Vance Faber, and Max Gunzburger. 1999. Centroidal Voronoi Tessellations: Applications and Algorithms. SIAM Rev. 41, 4 (1999), 637--676.
[17]
Frédo Durand. 2011. A Frequency Analysis of Monte-Carlo and other Numerical Integration Schemes. MIT CSAIL Technical report TR-2011-052 (2011). http://hdl.handle.net/1721.1/67677
[18]
Raanan Fattal. 2011. Blue-Noise Point Sampling using Kernel Density Model. ACM SIGGRAPH 2011 papers 28, 3 (2011), 1--10.
[19]
Henri Faure and Christiane Lemieux. 2016. Irreducible Sobol' Sequences in Prime Power Bases. Acta Arithmetica 173, 1 (2016), 59--80.
[20]
Leonhard Grünschloß, Johannes Hanika, Ronnie Schwede, and Alexander Keller. 2008. (t, m, s)-Nets and Maximized Minimum Distance. Springer Berlin Heidelberg, 397--412.
[21]
Daniel Heck, Thomas Schlömer, and Oliver Deussen. 2013. Blue noise sampling with controlled aliasing. ACM Transactions on Graphics 32, 3 (2013), 25:1--25:12.
[22]
Andrew Helmer, Per Christensen, and Andrew Kensler. 2021. Stochastic Generation of (t, s) Sample Sequences. In Eurographics Symposium on Rendering - DL-only Track, Adrien Bousseau and Morgan McGuire (Eds.). The Eurographics Association.
[23]
Pedro Hermosilla, Tobias Ritschel, Pere-Pau Vázquez, Àlvar Vinacua, and Timo Ropinski. 2018. Monte carlo Convolution for Learning on Non-uniformly Sampled Point Clouds. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1--12.
[24]
Fred J. Hickernell. 1996. The Mean Square Discrepancy of Randomized Nets. ACM Trans. Model. Comput. Simul. 6, 4 (oct 1996), 274--296.
[25]
James T. Kajiya. 1986. The Rendering Equation. Computer Graphics 20, 4 (1986), 143--150.
[26]
Alexander Keller. 2013. Quasi-Monte Carlo Image Synthesis in a Nutshell. In Monte Carlo and Quasi-Monte Carlo Methods 2012. Springer, 213--249.
[27]
Pierre L'Ecuyer and David Munger. 2016. Algorithm 958: Lattice Builder: A General Software Tool for Constructing Rank-1 Lattice Rules. ACM Trans. Math. Softw. 42, 2, Article 15 (may 2016), 30 pages.
[28]
Thomas Leimkühler, Gurprit Singh, Karol Myszkowski, Hans-Peter Seidel, and Tobias Ritschel. 2019. Deep Point Correlation Design. ACM Transactions on Graphics 38, 6 (2019).
[29]
Bruno Lévy and Erica L Schwindt. 2018. Notions of optimal transport theory and how to implement them on a computer. Computers & Graphics 72 (2018), 135--148.
[30]
Hongwei Li, Diego Nehab, Li-Yi Wei, Pedro V. Sander, and Chi-Wing Fu. 2010. Fast Capacity Constrained Voronoi Tessellation. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (Washington, D.C.) (I3D '10). ACM, Article 13, 1 pages.
[31]
S. Lloyd. 1982. Least Squares Quantization in PCM. IEEE Transactions on Information Theory 28, 2 (1982), 129--137.
[32]
Jiří Matoušek. 1998. On the L2-discrepancy for Anchored Boxes. J. Complex. 14, 4 (dec 1998), 527--556.
[33]
Gonzalo Mena, David Belanger, Gonzalo Munoz, and Jasper Snoek. 2017. Sinkhorn Networks: Using Optimal Transport Techniques to Learn Permutations. In NIPS Workshop in Optimal Transport and Machine Learning, Vol. 3.
[34]
Harald Niederreiter. 1992. Random Number Generation and Quasi-Monte Carlo Methods. Society for Industrial and Applied Mathematics.
[35]
Victor Ostromoukhov, Nicolas Bonneel, David Coeurjolly, and Jean-Claude Iehl. 2024. Quad-Optimized Low-Discrepancy Sequences. In ACM SIGGRAPH 2024 Conference Papers (Denver, CO, USA) (SIGGRAPH '24). ACM, New York, NY, USA, Article 72, 9 pages.
[36]
Art B. Owen. 1997a. Monte Carlo Variance of Scrambled Net Quadrature. SIAM J. Numer. Anal. 34, 5 (1997), 1884--1910.
[37]
Art B. Owen. 1997b. Scrambled Net Variance for Integrals of Smooth Functions. Ann. Statist. 25, 6 (1997), 1541--1562. http://dml.mathdoc.fr/item/1031594731
[38]
Art B. Owen. 2003. Variance with Alternative Scramblings of Digital Nets. ACM Trans. Model. Comput. Simul. 13, 4 (oct 2003), 363--378.
[39]
A. Cengiz Öztireli, Marc Alexa, and Markus Gross. 2010. Spectral Sampling of Manifolds. ACM Transactions on Graphics 29, 6, Article 168 (dec 2010), 8 pages.
[40]
A. Cengiz Öztireli and Markus Gross. 2012. Analysis and Synthesis of Point Distributions based on Pair Correlation. ACM Transactions on Graphics 31, 6 (2012), 174:1--174:6.
[41]
Loïs Paulin, Nicolas Bonneel, David Coeurjolly, Jean-Claude Iehl, Alexander Keller, and Victor Ostromoukhov. 2022. MatBuilder: Mastering Sampling Uniformity over Projections. ACM Transactions on Graphics 41, 4 (Aug. 2022).
[42]
Lois Paulin, Nicolas Bonneel, David Coeurjolly, Jean-Claude Iehl, Antoine Webanck, Mathieu Desbrun, and Victor Ostromoukhov. 2020. Sliced optimal transport sampling. ACM Transactions on Graphics 39, 4, Article 99 (aug 2020), 17 pages.
[43]
Loïs Paulin, David Coeurjolly, Jean-Claude Iehl, Nicolas Bonneel, Alexander Keller, and Victor Ostromoukhov. 2021. Cascaded Sobol Sampling. ACM Transactions on Graphics 40, 6 (Dec. 2021), 274:1--274:13.
[44]
Hélène Perrier. 2018. Anti-Aliased Low Discrepancy Samplers for Monte Carlo Estimators in Physically Based Rendering. Ph.D. Dissertation. Université Claude Bernard Lyon 1. http://www.theses.fr/2018LYSE1040/document
[45]
Hélène Perrier, David Coeurjolly, Feng Xie, Matt Pharr, Pat Hanrahan, and Victor Ostromoukhov. 2018. Sequences with Low-Discrepancy Blue-Noise 2-D Projections. Computer Graphics Forum 37, 2 (2018), 339--353. https://hal.science/hal-01717945
[46]
Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically Based Rendering: From Theory to Implementation (3rd ed.). Morgan Kaufmann Publishers Inc.
[47]
Adrien Pilleboue, Gurprit Singh, David Coeurjolly, Michael Kazhdan, and Victor Ostromoukhov. 2015. Variance Analysis for Monte Carlo Integration. ACM Transactions on Graphics 34, 4 (2015), 124:1--124:14.
[48]
Corentin Salaün, Iliyan Georgiev, Hans-Peter Seidel, and Gurprit Singh. 2022. Scalable Multi-class Sampling via Filtered Sliced Optimal Transport. ACM Transactions on Graphics 41, 6 (2022).
[49]
John K. Salmon, Mark A. Moraes, Ron O. Dror, and David E. Shaw. 2011. Parallel Random Numbers: As Easy as 1, 2, 3. In SC '11: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. 1--12.
[50]
Rohan Sawhney and Keenan Crane. 2020. Monte Carlo Geometry Processing: A Grid-free Approach to PDE-based Methods on Volumetric Domains. ACM Transactions on Graphics 39, 4 (2020).
[51]
Ilya M. Sobol. 1967. On the Distribution of Points in a Cube and the Approximate Evaluation of Integrals. USSR Computational mathematics and mathematical physics 7 (1967), 86--112.
[52]
Kartic Subr and Jan Kautz. 2013. Fourier analysis of stochastic sampling strategies for assessing bias and variance in integration. ACM Trans. Graph. 32, 4 (2013), 128:1--128:12.
[53]
UTK. 2018. Uniform Tool Kit. https://utk-team.github.io/utk/.
[54]
Eric Veach. 1997. Robust Monte Carlo Methods for Light Transport Simulation. Ph. D. Dissertation. Stanford University. https://graphics.stanford.edu/papers/veach_thesis/thesis-bw.pdf
[55]
Yin Xu, Ligang Liu, Craig Gotsman, and Steven Gortler. 2011. Capacity-Constrained Delaunay Triangulation for point distributions. Computers & Graphics 35 (06 2011), 510--516.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 43, Issue 6
December 2024
1828 pages
EISSN:1557-7368
DOI:10.1145/3702969
Issue’s Table of Contents
Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2024
Published in TOG Volume 43, Issue 6

Check for updates

Author Tags

  1. sampling
  2. owen scrambling
  3. quasi-monte carlo
  4. automatic differentiation

Qualifiers

  • Research-article

Funding Sources

  • Agence Nationale de la Recherche

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 196
    Total Downloads
  • Downloads (Last 12 months)196
  • Downloads (Last 6 weeks)114
Reflects downloads up to 22 Jan 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media