[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

Removing Monte Carlo noise using a Sobel operator and a guided image filter

Published: 01 April 2018 Publication History

Abstract

In this study, a novel adaptive rendering approach is proposed to remove Monte Carlo noise while preserving image details through a feature-based reconstruction. First, noise in the additional features is removed using a guided image filter that reduces the impact of noisy features involving strong motion blur or depth of field. The Sobel operator is then employed to recognize the geometric structures by robustly computing a gradient buffer for each feature. Given the gradient information for high-dimensional features, we compute the optimal filter parameters using a data-driven method. Finally, an error analysis is derived through a two-step smoothing strategy to produce a smooth image and guide the adaptive sampling process. Experimental results indicate that our approach outperforms state-of-the-art methods in terms of visual image quality and numerical error.

References

[1]
Li, T.M., Wu, Y.T., Chuang, Y.Y.: SURE-based optimization for adaptive sampling and reconstruction. ACM Trans. Graph. 31(6), 194:1---194:9 (2012)
[2]
Rousselle, F., Manzi, M., Zwicker, M.: Robust denoising using feature and color information. Comput. Graph. Forum 32(7), 121---130 (2013)
[3]
Rousselle, F., Knaus, C., Zwicker, M.: Adaptive sampling and reconstruction using greedy error minimization. ACM Trans. Graph. 30(6), 6:1---6:11 (2011)
[4]
Moon, B., Carr, N., Yoon, S.: Adaptive rendering based on weighted local regression. ACM Trans. Graph. 33(5), 170:1---170:14 (2014)
[5]
Kalantari, N.K., Bako, S., Sen, P.: A machine learning approach for filtering Monte Carlo noise. ACM Trans. Graph. 34(4), 122:1---122:12 (2015)
[6]
Bauszat, P., Eisemann, M., Eisemann, E.: General and robust error estimation and reconstruction for Monte Carlo rendering. Comput. Graph. Forum 34(2), 597---608 (2015)
[7]
He, K., Sun, J., Tang, X.: Guided Image Filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(6), 1397---1409 (2010)
[8]
Kajiya, J.T.: The rendering equation. In: ACM SIGGRAPH, pp. 143---150 (1986)
[9]
Hachisuka, T., Jarosz, W., Weistroffer, R.P., Dale, K.: Multidimensional adaptive sampling and reconstruction for ray tracing. ACM Trans. Graph. 27(3), 33:1---33:10 (2008)
[10]
Durand, F., Holzschuch, N., Soler, C., Chan, E., Sillion, F.X.: A frequency analysis of light transport. ACM Trans. Graph. 24(3), 1115---1126 (2005)
[11]
Soler, C., Subr, K., Durand, F., Holzschuch, N., Sillion, F.: Fourier depth of field. ACM Trans. Graph. 28(2), 18:1---18:12 (2009)
[12]
Egan, K., Tseng, Y.T., Durand, F., Holzschuch, N.: Frequency analysis and sheared reconstruction for rendering motion blur. ACM Trans Graph 28(3), 93:1---93:13 (2009)
[13]
Egan, K., Hecht, F., Durand, F., Ramamoorthi, R.: Frequency analysis and sheared filtering for shadow light fields of complex occluders. ACM Trans. Graph. 30(2), 9:1---9:13 (2011)
[14]
Egan, K., Durand, F., Ramamoorthi, R.: Practical filtering for efficient ray-traced directional occlusion. ACM Trans. Graph. 30(6), 180:1---180:10 (2011)
[15]
Belcour, l, Soler, C., Subr, K., Holzschuch, N., Durand, F.: 5D covariance tracing for efficient defocus and motion blur. ACM Trans. Graph. 32(3), 31:1---31:18 (2011)
[16]
Lehtinen, J., Aila, T., Chen, J., Laine, S., Durand, F.: Temporal light field reconstruction for rendering distribution effects. ACM Trans. Graph. 31(4), 55:1---55:10 (2012)
[17]
Lehtinen, J., Aila, T., Laine, S., Durand, F.: Reconstructing the indirect light field for global illumination. ACM Trans Graph 30(4), 51:1---51:12 (2011)
[18]
Kettunen, M., Manzi, M., Aittala, M., Lehtinen, J.: Gradient-domain path tracing. ACM Trans. Graph. 34(4), 123:1---123:13 (2015)
[19]
Manzi, M., Vicini, D., Zwicker, M.: Regularizing image reconstruction for gradient-domain rendering with feature patches. Comput. Graph. Forum 35(2), 263---273 (2016)
[20]
Sen, P., Darabi, S.: Compressed rendering: a rendering application of compressed sensing. IEEE Trans. Vis. Comput. Graph. 17(4), 487---499 (2011)
[21]
Liu, X.D., WU, J.Z., Zheng, C.W.: KD-tree based parallel adaptive rendering. The Visual Computer 28(6---8), 613---623 (2012)
[22]
Mitchell, D.P.: Generating antialiased images at low sampling densities. In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, vol. 21, pp. 65-72. ACM, Anaheim (1987)
[23]
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In Proceedings of the International Conference on Computer Vision, pp. 839---846 (1998)
[24]
Buades, A., Coll, B., Morel, J.M: A non-local algorithm for image denoising. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 60-65 (2005)
[25]
Rousselle, F., Knaus, C., Zwicker, M.: Adaptive rendering with non-local means filtering. ACM Trans. Graph. 31(6), 195:1---195:9 (2012)
[26]
Overbeck, R.S., Donner, C., Ramamoorthi, R.: Adaptive wavelet rendering. ACM Trans. Graph. 28(5), 140:1---140:12 (2009)
[27]
Kalantari, N.K., Sen, P.: Removing the noise in Monte Carlo rendering with general image denoising algorithm. Comput. Graph. Forum 32(2), 93---102 (2013)
[28]
Sen, P., Darabi, S.: On Filtering the Noise from the Random parameters in Monte Carlo Rendering. ACM Trans Graph 31(3), 18:1---18:14 (2012)
[29]
Bauszat, P., Eisemann, M., John, S.: Sample-based manifold filtering for interactive global illumination and depth of field. Comput. Graph. Forum 34(1), 265---276 (2015)
[30]
Liu, X.D., Zheng, C.W.: Adaptive cluster rendering via regression analysis. Vis. Comput. 31(1), 105---114 (2015)
[31]
Liu, X.D., Zheng, C.W.: Parallel adaptive sampling and reconstruction using multi-scale and directional analysis. The Visual Computer 29(6---8), 501---511 (2013)
[32]
Moon, B., Jun, J.Y., Lee, J.: Robust image denoising using a virtual flash image for Monte Carlo ray tracing. Comput. Graph. Forum 32(1), 139---151 (2013)
[33]
Bitterli, B., Rousselle, F., Moon, B.: Nonlinearly weighted first-order regression for denoising Monte Carlo renderings. Comput. Graph. Forum 35(4), 107---117 (2016)
[34]
Bauszat, P., Eisemann, M., Magnor, M.: Guided image filtering for interactive high-quality global illumination. Comput. Graph. Forum 30(4), 1361---1368 (2011)
[35]
Delbracio, M., Muse, P., Buades, A., Chauvier, J.: Boosting Monte Carlo Rendering by ray histogram fusion. ACM Trans Graph 33(1), 8:1---8:15 (2014)
[36]
Moon, B., Guitian, J.A., Yoon, S., Mitchell, K.: Adaptive rendering with linear predictions. ACM Trans. Graph. 34(4), 121:1---121:11 (2015)
[37]
Moon, B., McDonagh, S., Mitchell, K., Gross, M.: Adaptive polynomial rendering. ACM Trans Graph 35(4), 40:1---40:11 (2016)
[38]
Zwicker, M., Jarosz, W., Lehtinen, J., Moon, B.: Recent advances in adaptive sampling and reconstruction for Monte Carlo rendering. Comput. Graph. Forum 34(2), 667---681 (2015)
[39]
Ruppert, D., Wand, M.: Multivariate locally weighted least squares regression. The annals of statistics 22(3), 1346---1370 (1994)
[40]
Pharr, M., Humphreys, G.: Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann Publishers Inc., San Fransisco (2010)
[41]
Wu, F.K., Zheng, C.W.: Microfacet-based interference simulation for multilayer films. Graphical Models 78(6), 26---35 (2015)

Cited By

View all
  • (2024)A Statistical Approach to Monte Carlo DenoisingSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687591(1-11)Online publication date: 3-Dec-2024
  • (2023)A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusionMultimedia Tools and Applications10.1007/s11042-022-13323-y82:2(1821-1871)Online publication date: 1-Jan-2023
  • (2022)Skew Angle Detection and Correction in Text Images Using RGB GradientImage Analysis and Processing – ICIAP 202210.1007/978-3-031-06430-2_21(249-262)Online publication date: 23-May-2022
  • Show More Cited By
  1. Removing Monte Carlo noise using a Sobel operator and a guided image filter

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image The Visual Computer: International Journal of Computer Graphics
      The Visual Computer: International Journal of Computer Graphics  Volume 34, Issue 4
      April 2018
      136 pages

      Publisher

      Springer-Verlag

      Berlin, Heidelberg

      Publication History

      Published: 01 April 2018

      Author Tags

      1. Adaptive sampling and reconstruction
      2. Guided image filter
      3. Ray tracing
      4. Sobel operator

      Qualifiers

      • Article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 15 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)A Statistical Approach to Monte Carlo DenoisingSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687591(1-11)Online publication date: 3-Dec-2024
      • (2023)A novel approach with the dynamic decision mechanism (DDM) in multi-focus image fusionMultimedia Tools and Applications10.1007/s11042-022-13323-y82:2(1821-1871)Online publication date: 1-Jan-2023
      • (2022)Skew Angle Detection and Correction in Text Images Using RGB GradientImage Analysis and Processing – ICIAP 202210.1007/978-3-031-06430-2_21(249-262)Online publication date: 23-May-2022
      • (2021)Progressive path tracing with bilateral-filtering-based denoisingMultimedia Tools and Applications10.1007/s11042-020-09650-780:1(1529-1544)Online publication date: 1-Jan-2021
      • (2020)Multi-focus image fusion for different datasets with super-resolution using gradient-based new fusion ruleMultimedia Tools and Applications10.1007/s11042-020-08670-779:19-20(13311-13350)Online publication date: 28-Jan-2020
      • (2019)Blockwise Multi-Order Feature Regression for Real-Time Path-Tracing ReconstructionACM Transactions on Graphics10.1145/326997838:5(1-14)Online publication date: 17-Jun-2019

      View Options

      View options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media