Abstract
We propose a Levenberg–Marquardt method with general uniformly convex regularization terms to solve nonlinear inverse problems in Banach spaces, which is an extension of the scheme proposed by Hanke in (Inverse Probl 13:79–95, 1997) in Hilbert space setting. The method is so designed that it can be used to detect the features of the sought solutions such as sparsity or piecewise constancy. It can also be used to deal with the situation that the data is contaminated by noise containing outliers. By using tools from convex analysis in Banach spaces, we establish the convergence of the method. Numerical simulations are reported to test the performance of the method.
Similar content being viewed by others
References
Bachmayr, M., Burger, M.: Iterative total variation schemes for nonlinear inverse problems. Inverse Probl. 25(10), 105004 (2009)
Bakushinsky, A.B., Kokurin, M.Y.: Iterative Methods for Approximate Solutions of Inverse Problems. Mathematics and Its Applications (New York), vol. 577. Springer, Dordrecht (2004)
Bazaraa, M.S., Sherali, H.D., Shetty, C.M.: Nonlinear Programming, Theory and Algorithms, 3rd edn. Wiley-Interscience, New York (2006)
Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2, 183–202 (2009)
Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40, 120–145 (2011)
Cioranescu, I.: Geometry of Banach Spaces, Duality Mappings and Nonlinear Problems. Kluwer, Dordrecht (1990)
Colonius, F., Kunisch, K.: Stability for parameter estimation in two point boundary value problems. J. Reine Angew. Math. 370, 1–29 (1986)
Engl, H.W., Hanke, M., Neunauer, A.: Regularization of Inverse Problems. Kluwer, Dordrecht (1996)
Engl, H.W., Kunisch, K., Neubauer, A.: Convergence rates of Tikhonov regularization of nonlinear ill-posed problems. Inverse Probl. 5, 523–540 (1989)
Hanke, M.: Regularizing properties of a truncated Newton-CG algorithm for nonlinear inverse problems. Numer. Funct. Anal. Optim. 18(9–10), 971–993 (1997)
Hanke, M.: A regularizing Levenberg–Marquardt scheme with applications to inverse groundwater filtration problems. Inverse Probl. 13, 79–95 (1997)
Hanke, M., Neubauer, A., Scherzer, O.: A convergence analysis of the Landweber iteration for nonlinear ill-posed problems. Numer. Math. 72, 21–37 (1995)
Hettlich, F., Rundell, W.: A second degree method for nonlinear inverse problems. SIAM J. Numer. Anal. 37(2), 587–620 (2000)
Hohage, T., Werner, F.: Iteratively regularized Newton-type methods for general data misfit functionals and applications to Poisson data. Numer. Math. 123(4), 745–779 (2013)
Hohage, T., Werner, F.: Convergence rates for inverse problems with impulsive noise. SIAM J. Numer. Anal. 52(3), 1203–1221 (2014)
Jin, Q.: Applications of the modified discrepancy principle to Tikhonov regularization of nonlinear ill-posed problems. SIAM J. Numer. Anal. 36(2), 475–490 (1999)
Jin, Q.: On the order optimality of the regularization via inexact Newton iterations. Numer. Math. 121, 237–260 (2012)
Jin, Q.: Inexact Newton–Landweber iteration for solving nonlinear inverse problems in Banach spaces. Inverse Probl. 28, 065002 (15pp) (2012)
Jin, Q., Tautenhahn, U.: On the discrepancy principle for some Newton type methods for solving nonlinear inverse problems. Numer. Math. 111, 509–558 (2009)
Jin, Q., Wang, W.: Landweber iteration of Kaczmarz type with general non-smooth convex penalty functionals. Inverse Probl. 29, 085011 (22pp) (2013)
Jin, Q., Zhong, M.: On the iteratively regularized Gauss–Newton method in Banach spaces with applications to parameter identification problems. Numer. Math. 124, 647–683 (2013)
Jin, Q., Zhong, M.: Nonstationary iterated Tikhonov regularization in Banach spaces with uniformly convex penalty terms. Numer. Math. 127, 485–513 (2014)
Kaltenbacher, B.: A convergence rates result for an iteratively regularized Gauss–Newton–Halley method in Banach space. Inverse Probl. 31, 015007 (20pp) (2015)
Kaltenbacher, B., Hofmann, B.: Convergence rates for the iteratively regularized Gauss–Newton method in Banach spaces. Inverse Probl. 26, 035007 (21pp) (2010)
Kaltenbacher, B., Neubauer, A., Scherzer, O.: Iterative Regularization Methods for Nonlinear Ill-Posed Problems. de Gruyter, Berlin (2008)
Kaltenbacher, B., Schöpfer, F., Schuster, T.: Iterative methods for nonlinear ill-posed problems in Banach spaces: convergence and applications to parameter identification problems. Inverse Probl. 25, 065003 (19pp) (2009)
Lechleiter, A., Rieder, A.: Towards a general convergence theory for inexact Newton regularizations. Numer. Math. 114, 521–548 (2010)
Margotti, F., Rieder, A., Leitäo, A.: A Kaczmarz version of the REGINN-Landweber iteration for ill-posed problems in Banach spaces. SIAM J. Numer. Anal. 52, 1439–1465 (2014)
Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)
Rieder, A.: On the regularization of nonlinear ill-posed problems via inexact Newton iterations. Inverse Probl. 15, 309–327 (1999)
Schuster, T., Kaltenbacher, B., Hofmann, B., Kazimierski, K.S.: Regularization Methods in Banach Spaces. Walter de Gruyter, Berlin (2012)
Z\(\breve{\text{ a }}\)linscu, C.: Convex Analysis in General Vector Spaces. World Scientific Publishing Co., Inc., River Edge (2002)
Zhu, M., Chan, T.F.: An efficient primaldual hybrid gradient algorithm for total variation image restoration. CAM Report 08-34, UCLA (2008)
Acknowledgments
Q Jin is partly supported by the ARC discovery project grant DP150102345 and H Yang is partly supported by the Natural Science Foundation of China under grant 11071264 and 11571386.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jin, Q., Yang, H. Levenberg–Marquardt method in Banach spaces with general convex regularization terms. Numer. Math. 133, 655–684 (2016). https://doi.org/10.1007/s00211-015-0764-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00211-015-0764-z