Abstract
The effect of inexact line search on conjugacy is studied in unconstrained optimization. A generalized conjugate gradient method based on this effect is proposed and shown to have global convergence for a twice continuously differentiable function with a bounded level set.
Similar content being viewed by others
References
Daniel, J. W.,The Conjugate Gradient Method for Linear and Nonlinear Operator Equations, SIAM Journal on Numerical Analysis, Vol. 4, pp. 10–26, 1967.
Sorenson, H. W.,Comparison of Some Conjugate Direction Procedures for Function Minimization, Journal of the Franklin Institute, Vol. 288, pp. 421–441, 1969.
Polak, E., andRibiere, G.,Note sur la Convergence des Méthodes de Directions Conjuguées, Revue Française d'Informatique et de Recherche Operationelle, Vol. 16, pp. 35–43, 1969.
Fletcher, R., andReeves, C. M.,Function Minimization by Conjugate Gradients, Computer Journal, Vol. 7, pp. 149–154, 1964.
Powell, M. J. D.,Nonconvex Minimization Calculations and the Conjugate Gradient Method, Report No. DAMTP 1983/NA14, Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, England, 1983.
Al-Baali, M.,Descent Property and Global Convergence of the Fletcher-Reeves Method with Inexact Line Search, IMA Journal of Numerical Analysis, Vol. 5, pp. 121–124, 1985.
Shanno, D. F.,Globally Convergent Conjugate Gradient Algorithms, Mathematical Programming, Vol. 33, pp. 61–67, 1985.
Touati-Ahmed, D., andStorey, C.,Efficient Hybrid Conjugate Gradient Techniques, Journal of Optimization Theory and Applications, Vol. 64, No. 2, pp. 379–397, 1990.
Hu, Y. F., andStorey, C.,Efficient Generalized Conjugate Gradient Algorithms, Part 2: Implementation, Journal of Optimization Theory and Applications, Vol. 69, No. 1, pp. 139–152, 1991.
Author information
Authors and Affiliations
Additional information
Communicated by L. C. W. Dixon
Rights and permissions
About this article
Cite this article
Liu, Y., Storey, C. Efficient generalized conjugate gradient algorithms, part 1: Theory. J Optim Theory Appl 69, 129–137 (1991). https://doi.org/10.1007/BF00940464
Issue Date:
DOI: https://doi.org/10.1007/BF00940464