Abstract
The widely used JPEG lossy baseline coding system is known to produce, at low bit rates, blocking effects and Gibbs phenomenon. This paper develops a method to get rid of these artifacts without smoothing images and without removing perceptual features. This results in better looking pictures and improved PSNR. Our algorithm is based on an adapted total variation minimization approach constrained by the knowledge of the input intervals the unquantized cosine coefficients belong to. In this way, we reconstruct an image having the same quantized coefficients than the original one, but which is minimal in term of the total variation. This discourages blocking effects and Gibbs phenomenon to appear while edges are kept as sharp as possible. Although the proposed subgradient method is converging in infinite time, experiments show that best results are obtained with a very few number of iterations. This leads to a simple and fast algorithm that may be applied to the great set of JPEG images to decompress them more efficiently.
Similar content being viewed by others
References
R. Acar and C.R. Vogel, “Analysis of total variation penalty methods for ill-posed problems,” Inverse Problems, Vol. 10, pp. 1217–1229, 1994.
Y. Alber, A. Iusem, and M. Solodov, “On the projected subgradient method for nonsmooth convex optimization in a hilbert space,” Mathematical Programming, Vol. 81, pp. 23–35, 1998.
A. Almansa, S. Durand, and B. Rougé, “Measuring and improving image resolution by adaptation of the reciprocal cell,” Preprint CMLA n2002-12, to appear in J. Math. Imaging Vis., 2002.
P. Blomgren and T.F. Chan, “Color TV: Total variation methods for restoration of vector valued images,” IEEE Trans. on Image Proc., 1998. Special issue on Geometry Driven Diffusion and PDEs in Image Processing.
P. Blomgren, T.F. Chan, P. Mulet, and C.K. Wong, “Total variation image restoration: Numerical methods and extensions,” in Proc. of ICIP’97, 1997, Vol. 3, pp. 384–387.
E. Candès and F. Guo, “New multiscale transforms, minimum total variation synthesis: Applications to edge-preserving image reconstruction,” Signal Processing, Vol. 82, pp. 1519–1543, 2002.
A. Chambolle, “An algorithm for total variation minimization and applications,” J. Math. Imaging Vis., Vol. 20, No. 1, pp. 89–97, 2004.
T.F. Chan, H.M. Zhou, and R.H. Chan, “A continuation method for total variation denoising problems,” UCLA CAM Report 95-18, University of California, Los Angeles, CA, 1995.
T. Chan, A. Marquina, and P. Mulet, “High-order total variation-based image restoration,” SIAM J. Sci. Comput., Vol. 22, No. 2, pp. 503–516, 2000.
T.F. Chan and H.M. Zhou, “Total variation improved wavelet thresholding in image compression,” in Proc. of ICIP’2000, 2000.
Y. Chen and T. Wunderli, “Adaptive total variation for image restoration in bv space,” J. Math. Anal. Appl., pp. 117–137, 2002.
R.R. Coifman and A. Sowa, “Combining the calculus of variations and wavelets for image enhancement,” Applied and Comput. Harmonic Ana., Vol. 9, pp. 1–18, 2000.
P.L. Combettes and J. Luo, “An adaptive level set method for nondifferentiable constrained image recovery,” IEEE Trans. on Image Proc., Vol. 11, No. 11, pp. 1295–1304, 2002.
F. Dibos and G. Koepfler, “Global total variation minimization,” SIAM J. Numer. Anal., Vol. 37, No. 2, pp. 646–664, 2000.
D.C. Dobson and C.R. Vogel, “Convergence of an iterative method for total variation denoising,” SIAM J. Numer. Anal., Vol. 34, No. 5, pp. 1779–1791, 1997.
S. Durand and J. Froment, “Artifact free signal denoising with wavelets,” in Proc. of ICASSP’01, Salt Lake City, Vol. 6, 2001.
S. Durand and J. Froment, “Reconstruction of wavelet coefficients using total variation minimization,” SIAM J. Sci. Comput., Vol. 24, No. 5, pp. 1754–1767, 2003.
J. Froment, “A functional analysis model for natural images permitting structured compression,” ESAIM:COCV Control, Opt. and Cal. of Var., Vol. 4, pp. 473–495, 1999.
J. Froment and L. Moisan (Eds.),“Megawave2 v.2.30. A free and open-source Unix image processing software for reproducible research,” available at http://www.cmla.ens-cachan.fr, 2004.
Y. Gousseau and J-M. Morel, “Are natural images of bounded variation?” SIAM J. Math. Anal., Vol. 33, No. 3, pp. 634–648, 2001.
F. Guichard and F. Malgouyres, “Total variation based interpolation,” in Proc. of EUSIPCO’98, 1998, Vol. 3, pp. 1741–1744.
Y. Li and F. Santosa, “A computational algorithm for minimizing total variation in image restoration,” IEEE Trans. on Image Proc., Vol. 5, No. 6, pp. 987–995, 1996.
F. Malgouyres, “Minimizing the total variation under a general convex constraint for image restoration,” IEEE Trans. on Image Proc., Vol. 11, No. 12, pp. 1450–1456, 2002.
L. Moisan, “Extrapolation de spectre et variation totale pondérée,” in Proc. of Gretsi’01, Toulouse, France, 2001.
M. Nikolova, “Local strong homogeneity of a regularized estimator,” SIAM J. Appl. Math., Vol. 61, No. 2, pp. 633–658, 2000.
A. Nosratinia, “Denoising of jpeg images by re-application of jpeg,” J. of VLSI Signal Processing, Vol. 27, pp. 69–79, 2001.
S. Osher and L. Rudin, “Feature-oriented image enhancement using shock filters,” SIAM J. Numer. Anal., Vol. 27, pp. 919–940, 1990.
S.J. Reeves and S.I. Eddins, “Comments on iterative procedures for reduction of blocking effects in transform coding,” IEEE Trans. on Circuits and Systems for Video Tech., Vol. 3, No. 6, pp. 439–440, 1993.
L.I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D, Vol. 60, pp. 259–268, 1992.
M.-Y. Shen and C.-C. J. Kuo, “Review of postprocessing techniques for compression artifact removal,” J. Visual Comm. and Image Representation, Vol. 9, No. 1, pp. 2–14, 1998.
N.Z. Shor, “Minimization methods for non-differentiable functions,” Springer Series in Computational Mathematics, Springer, 1985.
D. Strong and T. Chan, “Relation of regularization parameter and scale in total variation based image denoising,” UCLA CAM Report 96-7, University of California, Los Angeles, CA, 1996.
L. Vese and S. Osher, “Image denoising and decomposition with total variation minimization and oscillatory functions,” J. Math. Imaging Vis., Vol. 20, No. 1, pp. 7–18, 2004.
C.R. Vogel and M.E. Oman, “Iterative method for total variation denoising,” SIAM J. Sci. Comput., Vol. 17, No. 1, pp. 227–238, 1996.
G.K. Wallace, “The jpeg still picture compression standard,” Communications of the ACM, Vol. 34, No. 4, pp. 31–44, 1991.
Y. Yang, N.P. Galatsanos, and A.K. Katsaggelos, “Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images,” IEEE Trans. on Circuits and Systems for Video Tech., Vol. 3, No. 6, pp. 421–432, 1993.
D.C. Youla, “Generalized image restoration by the method of alternating orthogonal projections,” IEEE Trans. on Circuits and Systems, Vol. 25, No. 9, pp. 694–702, 1978.
S. Zhong, “Image compression by optimal reconstruction,” United States Patent 5,534,925, Cognitech Inc., July 1996.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was also supported in part by CNES, 18 avenue E. Belin, 31055 Toulouse Cedex, France and Science Pratique SA, 47 avenue Carnot, 94230 Cachan, France under Grant 762/00/CNES/8319; by CMLA, ENS Cachan, 61 avenue du Président Wilson, 94235 Cachan Cedex, France; by DOLabs, 3 rue Nationale, 92100 Boulogne-Billancourt, France and by MAP5, UFR mathématiques et informatique, Université Paris 5, 45 rue des Saints Pères, 75270 Paris Cedex 06, France.
François Alter was at École Normale Supérieure Ulm in Paris from 1998 to 2003, and entered the Corps des Mines attached to the French minister in charge of industry in 2003. He received M.Sc. degree in Pure Mathematics from Paris 6 University in 2001. Since 2002, he has been preparing his Ph.D. in Image Processing and Analysis at CMLA in Cachan, France. His research interests are Geometric Partial Differential Equations and Stochastic Perception Theory.
Sylvain Durand received his PhD in applied mathematics, in 1993, from Paris-Dauphine University, France. In 1994 and 1995, he held a postdoctoral position at Washington University of St. Louis, Missouri. He is currently assistant professor at Jules Verne University of Picardie, France. His research interests include mathematical aspects of image processing.
Jacques Froment received the Ph.D. degree in applied mathematics from Paris-Dauphine University, France, in 1990. During the academic year 1990/1991, he was an associate research scientist at the Courant Institute of Mathematical Sciences in NYU’s computer science department. From 1991 to 2002, he was an assistant professor in the department of mathematics at Paris 5 University, France. He is currently professor of applied mathematics at the University of Bretagne Sud, Vannes, France. His research interests include mathematical models in computer vision and representation of meaningful information with applications to image compression and restoration.
Rights and permissions
About this article
Cite this article
Alter, F., Durand, S. & Froment, J. Adapted Total Variation for Artifact Free Decompression of JPEG Images. J Math Imaging Vis 23, 199–211 (2005). https://doi.org/10.1007/s10851-005-6467-9
Issue Date:
DOI: https://doi.org/10.1007/s10851-005-6467-9