Abstract
The denoising function in digital imaging devices must consider resource consumption and real-time capability in addition to effective noise-removal performance. One commonly used denoising method is pixel similarity weighted frame averaging (PSWFA). In this study, we improve the denoising capability of PSWFA using a pre-filter that consists of a downsampling operator and a small Gaussian filter. Moreover, given that noise in digital imaging devices is signal dependent and is typically modeled as a Poisson–Gaussian distribution, we introduce generalized Anscombe transformation to remove the signal dependency by rendering the noise variance constant. The transformed image can be considered corrupted by an approximately Gaussian noise. To embed our algorithm in hardware, we implement our algorithm on a Spartan-6 FPGA for evaluation. We also compare our algorithm with some existing denoising methods on FPGA. For further evaluation of the denoising ability, the algorithm is compared with some state-of-the-art algorithms that are not implemented on FPGA but have high performance on a personal computer. Experimental results on both simulated noise videos and actually captured low-light noise videos show the effectiveness of our algorithm, particularly in the processing of large-scale noise.
Similar content being viewed by others
References
Mäkitalo, M., Foi, A.: Optimal inversion of the generalized Anscombe transformation for Poisson–Gaussian noise. IEEE Trans. Image Process. 22(1), 91–103 (2013)
Luisier, F., Blu, T., Unser, M.: Image denoising in mixed Poisson-Gaussian noise. IEEE Trans. Image Process. 20(3), 696–708 (2011)
Salmon, J., Harmony, Z., Deledalle, C.A., Willett, R.: Poisson noise reduction with non-local PCA, In: Proceedings of IEEE International Conferernce on Acoustics, Speech, and Signal Processing, ICASSP 2012 (2012)
Deledalle, C., Tupin, F., Denis, L.: Poisson NL means: unsupervised non local means for Poisson noise. In: Proceedings of IEEE International Conference on Image Processing, ICIP 2010 (2010)
Mäkitalo, M., Foi, A.: Optimal inversion of the Anscombe transformation in low-count Poisson image denoising. IEEE Trans. Image Process. 20(1), 99–109 (2011)
Zhang, B., Fadili, J.M., Starck, J.-L.: Wavelets, ridgelets, and curvelets for Poisson noise removal. IEEE Trans. Image Process. 17(7), 1093–1108 (2008)
Starck, J.L., Murtagh, F., Bijaoui, A.: Image Processing and Data Analysis. Cambridge University Press, Cambridge (1998)
Anscombe, F.J.: The transformation of Poisson, binomial and negative-binomial data. Biometrika 35(3/4), 246–254 (1948)
Dabov, K., Foi, A., Egiazarian, K.: Video denoising by sparse 3-D transform-domain collaborative filtering. In: Proceedings of IEEE transactions on Europen Signal Processing Conference, (EUSIPCO), Poznan, Poland, pp. 1257–1260 (2007)
Luiser, F., Blu, T., Unser, M.: SURE-LET for orthonormal wavelet-domain video denoising. IEEE Trans. Circuits Syst. Video Technol. 20(6), 913–919 (2010)
Varghese, G., Wang, Z.: Video denoising based on a spatiotemporal Gaussian scale mixture model. IEEE Trans. Circuits Syst. Video Technol. 20(7), 1032–1040 (2010)
Han, Y., Chen, R.: Efficient video denoising based on dynamic nonlocal means. Image Vis. Comput. 30(2), 78–85 (2012)
Katona, M., Pižurica, A., Teslić, N., Kovačević, V., Philips, W.: A real-time wavelet-domain video denoising implementation in FPGA. EURASIP J. Embed. Syst. 2006, 1–12 (2006)
Reeja, S.R., Kavya, N.P.: Real time video denoising. In: Proceedings of 2012 IEEE International Conference on Engineering Education: Innovative Practices and Future Trends (AICERA) (2012)
Bennett, E.P., McMillan, L.: Video enhancement using per-pixel virtual exposures. In: Proceedings of ACM SIGGraph 05 Conference, pp. 845–852 (2005)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.O.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)
Hasinoff, S.W., Durand, F., Freeman, W.T.: Noise-optimal capture for high dynamic range photography. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010, pp. 553–560 (2010)
Tomasi C., Manduchi, R.: Bilateral filtering for gray and color images. In: Proceedings of IEEE International Conference on Computer vision (ICCV’98), pp. 839–846, Bombay, India (1998)
Xilinx Image Noise Reduction (2D) IP core [Online]. Available: http://www.xilinx.com/products/intellectual-property/EF-DI-IMG-NOISE.htm. Accessed 28 Oct 2013
Xilinx Motion Adaptive Noise Reduction (3D) IP core [Online]. Available: http://www.xilinx.com/products/intellectual-property/EF-DI-IMG-MA-NOISE.htm. Accessed 28 Oct 2013
Gargouri, A., Masmoudi, D.S.: New pulse mode neuro-fuzzy hardware architecture and application to image denoising. Int. J. Electron. Commun. (AEU) 67(6), 513–520 (2013)
Vinh, T.Q., Tri, L.Q.B., Tai, N.N.: A real-time video denoising implementation on FPGA using Contourlet transform. In: Proceedings of International Conference on Computing, Management and Telecommunications (ComManTel), pp. 203–207 (2013)
VBM3D author website [Online]. Available: http://www.cs.tut.fi/~foi/GCF-BM3D/. Accessed 9 May 2013
SURE-LET author website [Online]. Available: http://bigwww.epfl.ch/luisier/videodenoising/. Accessed 11 May 2013
Mäkitalo’s denoising experiment for Poisson–Gaussian noise [Online]. Available: http://www.cs.tut.fi/~foi/invansc. Accessed 28 April 2013
Video Sequence Database [Online]. Available: http://media.xiph.org/video/derf/. Accessed 10 March 2013
Wang, Z., Bovik, A.C.: Mean squared error: love it or leave it? A new look at signal fidelity measures. IEEE Signal Process. Mag. 26(1), 98–117 (2009)
Acknowledgments
This research was partially supported by the National Natural Science Foundation (NSFC) of China (Grant Nos. 61175006 and 61175015).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tan, X., Liu, Y., Zuo, C. et al. A real-time video denoising algorithm with FPGA implementation for Poisson–Gaussian noise. J Real-Time Image Proc 13, 327–343 (2017). https://doi.org/10.1007/s11554-014-0405-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-014-0405-2