Inexact free derivative quasi-Newton method for large-scale nonlinear system of equations
Authors: 
C. A. Arias, C. GómezAuthors Info & Claims
Abstract
In this work, we propose a free derivative quasi-Newton method for solving large-scale nonlinear systems of equation. We introduce a two-stage linear search direction and develop its global convergence theory. Besides, we prove that the method enjoys superlinear convergence rate. Finally, numerical experiments illustrate that the proposed method is competitive with respect to Newton-Krylov methods and other well-known methods for solving large-scale nonlinear systems of equations.
References
[1]
Nocedal J and Wright S Numerical Optimization 2000 New York Springer Series in Operations Research
[2]
Dennis, J.E., Schnabel. R.: Numerical Methods for Unconstrained Optimization and Nonlinear Equations. SIAM, Philadelphia (1996)
[3]
Pérez R and Rocha VL Recent Applications and Numerical Implementation of Quasi-Newton Methods for Solving Nonlinear Systems of Equations Numer Algorithms. 2004 35 261-285
[4]
Martínez JM Practical quasi-Newton methods for solving nonlinear systems J Comput Math. 2000 124 1–2 97-121
[5]
Gomes-Ruggiero, M.A., Martínez, J.M., Santos, S.A.: Solving nonsmooth equations by means of Quasi-Newton methods with globalization. Recent Advances in Noonsmooth Optimization, pp. 121 – 140. World Scientific Publisher, Singapore (1995).
[6]
Martínez JM A family of quasi-Newton methods for nonlinear equations with direct secant updates of matrix factorizations SIAM J Numer Anal. 1990 27 4 1034-1049
[7]
Dennis JE and More JJ A Characterization of Superlinear Convergence and its Application to Quasi-Newton Methods Math Comput. 1974 28 126 549-560
[8]
Schubert L Modification of quasi-Newton method for nonlinear equations with a sparse Jacobian Math Comp. 1970 24 109 27-30
[9]
Dembo R, Eisenstat S, and Trond S Inexact Newton Methods SIAM J Numer Anal. 1982 19 2 400-408
[10]
Deuflhard P Global Inexact Newton Mehods for Very Large Scale Nonlinear Problems Impact of Comptuning Science and engineering. 1991 3 4 366-393
[11]
Martinez JM and Qi L Inexact Newton Methods for solving nonsmooth equations J Comput Appl Math. 1995 60 1–2 127-145
[12]
Steighaug, T.: Quasi Newton Methods for Large Scale Nonlinear Problems. Yale University (1980)
[13]
Steihaug, T.: Damped Inexact Quasi Newton Methods. Technical Report TR81-03, Departament of Mathematical Science, Rice University (1984). https://hdl.handle.net/1911/101545
[14]
Eisenstat, S., Steihaug, T.: Local Analysis of Inexact Quasi Newton Methods. Technical Report TR82-07, Departament of Mathematical Science, Rice University (1982). https://hdl.handle.net/1911/101548
[15]
Eisenstat S and Walker H Globally Convergent Inexact Newton Methods SIAM J Optim. 1994 4 2 393-422
[16]
Birgin E, Krejić N, and Martínez JM Globally convergent inexact quasi-Newton methods for solving nonlinear systems Numer Algorithms. 2003 32 249-260
[17]
La Cruz W and Raydan M Nonmonotone Spectral Methods for Large- Scale Nonlinear Systems Optim Method Softw. 2003 18 5 583-599
[18]
La Cruz W, Martínez JM, and Raydan M Spectral residual method without gradient information for solving large-scale nonlinear systems of equations Math Comput. 2006 75 255 1429-1448
[19]
Lukšan, L., Vlček, J.: Sparse and Partially Separable Test Problems for Unconstrained and Equality Constrained Optimization. Technical Report 767, Institute of Computer Science, Academy of Sciences of the Czech Republic (1999). http://hdl.handle.net/11104/0123965
[20]
Tsoulos I and Athanassios S On locating all roots of systems of nonlinear equations inside bounded domain using global optimization methods Nonlinear Anal-Real. 2010 11 4 2465-2471
[21]
Zhou, W., Li, D.: Limited memory BFGS method for nonlinear monotone equations. J Comput Math. 25(1), 89 – 96 (2007). https://www.jstor.org/stable/43693347
[22]
Birgin, E., Martínez, J.M.: Secant acceleration of sequential residual methods for solving large-scale nonlinear systems of equations. SIAM J Numer Anal. 60(6), 3145–3180 (2022).
[23]
Pernice M and Walker HF NITSOL: a newton iterative solver for nonlinear systems SIAM J Sci Comput. 1998 19 1 302-318
[24]
Broyden CG A Class of Methods for Solving Nonlinear Simultaneous Equations Math Comput. 1965 19 92 577-593
[25]
Broyden CG, Dennis JE, and Moré JJ On the Local and Superlinear Convergence of Quasi-Newton Methods IMA J Appl Math. 1973 12 3 223-245
[26]
Gasparo M A nonmonotone hybrid method for nonlinear systems Optim Method Softw. 2000 13 2 79-94
[27]
Gomez-Ruggiero M, Martínez JM, and Moretti AC Comparing algorithms for solving sparse nonlinear systems of equations SIAM J Sci and Stat Comput. 1992 13 2 459-483
[28]
Raydan M The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem SIAM J opt. 1997 7 1 2-33
Recommendations
Descent Directions of Quasi-Newton Methods for Symmetric Nonlinear Equations
In general, when a quasi-Newton method is applied to solve a system of nonlinear equations, the quasi-Newton direction is not necessarily a descent direction for the norm function. In this paper, we show that when applied to solve symmetric nonlinear ...
Partitioned quasi-Newton methods for sparse nonlinear equations
In this paper, we present two partitioned quasi-Newton methods for solving partially separable nonlinear equations. When the Jacobian is not available, we propose a partitioned Broyden's rank one method and show that the full step partitioned Broyden's ...
Some superlinearly convergent inexact generalized Newton method for solving nonsmooth equations
This paper presents an inexact generalized Newton method for solving the nonlinear equation <italic>F</italic><italic>x</italic>=0, where <italic>F</italic> is locally Lipschitz continuous. The method with backtracking is globally and superlinearly ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s) 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 27 June 2023
Accepted: 27 February 2023
Received: 20 May 2022
Author Tags
Author Tags
Qualifiers
- Research-article
Funding Sources
- University of Cauca
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Dec 2024