Abstract
We develop a general convergence analysis for a class of inexact Newton-type regularizations for stably solving nonlinear ill-posed problems. Each of the methods under consideration consists of two components: the outer Newton iteration and an inner regularization scheme which, applied to the linearized system, provides the update. In this paper we give a novel and unified convergence analysis which is not confined to a specific inner regularization scheme but applies to a multitude of schemes including Landweber and steepest decent iterations, iterated Tikhonov method, and method of conjugate gradients.
Similar content being viewed by others
References
Bakushinsky A.B.: The problem of the convergence of the iteratively regularized Gauss-Newton method. Comput. Math. Phys. 32, 1353–1359 (1992)
Bakushinsky, A.B., Kokurin, M.Y.: Iterative Methods for Approximate Solution of Inverse Problems. Vol. 577 of Mathematics and its Applications. Springer, Dordrecht, The Netherlands (2004)
Brakhage, H.: On ill-posed problems and the method of conjugate gradients. In: Engl, H.W., Groetsch, C.W. (eds.) Inverse and Ill-Posed Problems. Vol. 4 of Notes and Reports in Mathematics in Science and Engineering, pp. 165–175, Boston. Academic Press, New York (1987)
Deuflhard P.: Newton Methods for Nonlinear Problems. Vol. 35 of Springer Series in Computational Mathematics. Springer, Berlin (2004)
Deuflhard P., Engl H.W., Scherzer O.: A convergence analysis of iterative methods for the solution of nonlinear ill-posed problems under affinely invariant conditions. Inverse Problems 14, 1081–1106 (1998)
Engl H.W., Hanke M., Neubauer A.: Regularization of Inverse Problems. Vol. 375 of Mathematics and its Applications. Kluwer Academic Publishers, Dordrecht (1996)
Hämarik U., Tautenhahn U.: On the monotone error rule for parameter choice in iterative and continuous regularization methods. BIT 41, 1029–1038 (2001)
Hanke M.: Conjugate Gradient Type Methods for Ill-Posed Problems. Vol. 327 of Pitman Research Notes in Mathematics. Longman Scientific & Technical, Harlow, UK (1995)
Hanke M.: A regularizing Levenberg-Marquardt scheme, with applications to inverse groundwater filtration problems. Inverse Problems 13, 79–95 (1997)
Hanke M.: Regularizing properties of a truncated Newton-CG algorithm for nonlinear inverse problems. Numer. Funct. Anal. Optim. 18, 971–993 (1998)
Hanke M., Neubauer A., Scherzer O.: A convergence analysis of the Landweber iteration for nonlinear ill-posed problems. Numer. Math. 72, 21–37 (1995)
Jin Q., Tautenhahn U.: On the discrepancy principle for some Newton type methods for solving nonlinear ill-posed problems. Numer. Math 111, 509–558 (2009)
Kaltenbacher, B., Neubauer, A., Scherzer, O.: Iterative Regularization Methods for Nonlinear Ill-Posed Problems. Radon Series on Computational and Applied Mathematics. de Gruyter, Berlin (2008)
Kirsch A.: An Introduction to the Mathematical Theory of Inverse Problems. Vol. 120 of Applied Mathematical Sciences. Springer-Verlag, New York (1996)
Lechleiter A., Rieder A.: Newton regularizations for impedance tomography: a numerical study. Inverse Problems 22, 1887–1967 (2006)
Lechleiter A., Rieder A.: Newton regularizations for impedance tomography: convergence by local injectivity. Inverse Problems 24, 065009 (2008)
Louis, A.K.: Inverse und schlecht gestellte Probleme. Studienbücher Mathematik, B.G. Teubner, Stuttgart, Germany (1989)
Rieder A.: On the regularization of nonlinear ill-posed problems via inexact Newton iterations. Inverse Problems 15, 309–327 (1999)
Rieder A.: On convergence rates of inexact Newton regularizations. Numer. Math. 88, 347–365 (2001)
Rieder A.: Keine Probleme mit Inversen Problemen. Vieweg, Wiesbaden (2003)
Rieder A.: Inexact Newton regularization using conjugate gradients as inner iteration. SIAM J. Numer. Anal. 43, 604–622 (2005)
Scherzer O.: The use of Morozov’s discrepancy principle for Tikhonov regularization for solving nonlinear ill-posed problems. Computing 51, 45–60 (1993)
Scherzer O.: A convergence analysis of a method of steepest descent and a two-step algorithm for nonlinear ill-posed problems. Numer. Funct. Anal. Optim. 17, 197–214 (1996)
Zeidler E.: Nonlinear Functional Analysis and its Applications I: Fixed-Point Theorems. Springer-Verlag, New York (1993)
Author information
Authors and Affiliations
Corresponding author
Additional information
Dedicated to Alfred K. Louis on the occasion of his 60th birthday.
Rights and permissions
About this article
Cite this article
Lechleiter, A., Rieder, A. Towards a general convergence theory for inexact Newton regularizations. Numer. Math. 114, 521–548 (2010). https://doi.org/10.1007/s00211-009-0256-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00211-009-0256-0