A sufficient descent LS-PRP-BFGS-like method for solving nonlinear monotone equations with application to image restoration
Abstract
In this paper, we propose a method for efficiently obtaining an approximate solution for constrained nonlinear monotone operator equations. The search direction of the proposed method closely aligns with the Broyden-Fletcher-Goldfarb-Shanno (BFGS) direction, known for its low storage requirement. Notably, the search direction is shown to be sufficiently descent and bounded without using the line search condition. Furthermore, under some standard assumptions, the proposed method converges globally. As an application, the proposed method is applied to solve image restoration problems. The efficiency and robustness of the method in comparison to other methods are tested by numerical experiments using some test problems.
References
[1]
Abdullahi M, Halilu AS, Awwal AM, and Pakkaranang N On efficient matrix-free method via quasi-newton approach for solving system of nonlinear equations Adv. Theory Nonlinear Anal. Appl. 2021 5 4 568-579
[2]
Abubakar AB, Kumam P, and Mohammad H A note on the spectral gradient projection method for nonlinear monotone equations with applications Comput. Appl. Math. 2020 39 129
[3]
Abubakar AB, Kumam P, Mohammad H, and Awwal AM A Barzilai-Borwein gradient projection method for sparse signal and blurred image restoration J. Frankl. Inst. 2020 357 11 7266-7285
[4]
Abubakar AB, Kumam P, Mohammad H, Awwal AM, and Kanokwan S A modified Fletcher-Reeves conjugate gradient method for monotone nonlinear equations with some applications Mathematics 2019 7 8 745
[5]
Ahookhosh M, Amini K, and Bahrami S Two derivative-free projection approaches for systems of large-scale nonlinear monotone equations Numer. Algorithms 2013 64 1 21-42
[6]
Awwal AM, Kumam P, Mohammad H, Watthayu W, and Abubakar AB A Perry-type derivative-free algorithm for solving nonlinear system of equations and minimizing regularized problem Optimization 2020 0 0 1-29
[7]
Barzilai J and Borwein JM Two-point step size gradient methods IMA J. Numer. Anal. 1988 8 1 141-148
[8]
Bovik, A.C.: Handbook of image and video processing. Academic press, (2010)
[9]
Dolan ED and Moré JJ Benchmarking optimization software with performance profiles Math. Program. 2002 91 2 201-213
[10]
Hager WW and Zhang H A survey of nonlinear conjugate gradient methods Pacific J. Optim. 2006 2 1 35-58
[11]
Ibrahim AH, Deepho J, Abubakar AB, and Adamu A A three-term Polak-Ribière-Polyak derivative-free method and its application to image restoration Sci. Afr. 2021 13 e00880
[12]
Ibrahim AH, Garba AI, Usman H, Abubakar J, and Abubakar AB Derivative-free RMIL conjugate gradient method for convex constrained equations Thai J. Math. 2019 18 1 212-232
[13]
Ibrahim AH, Kumam P, Abubakar AB, Jirakitpuwapat W, and Abubakar J A hybrid conjugate gradient algorithm for constrained monotone equations with application in compressive sensing Heliyon 2020 6 3 e03466
[14]
Ibrahim, A.H., Kumam, P., Abubakar, A.B., Abubakar, J., Muhammad, A.B.: Least-square-based three-term conjugate gradient projection method for -norm problems with application to compressed sensing. Mathematics 8(4) (2020)
[15]
Ibrahim AH, Kumam P, Abubakar AB, Yusuf UB, Yimer SE, and Aremu KO An efficient gradient-free projection algorithm for constrained nonlinear equations and image restoration AIMS Math. 2020 6 1 235
[16]
Ibrahim, A.H., Kumam, P., Hassan, B.A., Abubakar, A.B., Abubakar, J.: A derivative-free three-term Hestenes–Stiefel type method for constrained nonlinear equations and image restoration. Int. J. Comput. Math. 1–25 (2021)
[17]
Ibrahim AH, Kumam P, and Kumam W A family of derivative-free conjugate gradient methods for constrained nonlinear equations and image restoration IEEE Access 2020 8 162714-162729
[18]
Ibrahim AH, Muangchoo K, Abubakar AB, Adedokun AD, and Mohammed H Spectral conjugate gradient like method for signal reconstruction Thai J. Math. 2020 18 4 2013-2022
[19]
La Cruz W, Martínez J, and Raydan M Spectral residual method without gradient information for solving large-scale nonlinear systems of equations Math. Comput. 2006 75 255 1429-1448
[20]
Lajevardi SM Structural similarity classifier for facial expression recognition Signal Image Video Process. 2014 8 6 1103-1110
[21]
Li M A three term Polak-Ribire-Polyak conjugate gradient method close to the memoryless BFGS quasi-Newton method J. Ind. Manag. Optim. 2020 16 1 245-260
[22]
Li Q and Li DH A class of derivative-free methods for large-scale nonlinear monotone equations IMA J. Numer. Anal. 2011 31 4 1625-1635
[23]
Lukšan, L., Vlcek, J.: Test problems for unconstrained optimization. Acad. Sci. Czech Republ. Institute Comput. Sci. Tech. Rep. 897 (2003)
[24]
Meintjes K and Morgan AP A methodology for solving chemical equilibrium systems Appl. Math. Comput. 1987 22 4 333-361
[25]
Nocedal J Updating quasi-newton matrices with limited storage Math. Comput. 1980 35 151 773-782
[26]
Shanno DF Conjugate gradient methods with inexact searches Math. Oper. Res. 1978 3 3 244-256
[27]
Solodov, M.V., Svaiter, B.F.: A globally convergent inexact Newton method for systems of monotone equations. In: Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, pp. 355–369. Springer, (1998)
[28]
Sun M and Liu J New hybrid conjugate gradient projection method for the convex constrained equations Calcolo 2016 53 3 399-411
[29]
Wang, X., Tian, Y., Pang, L.: A class of three-term derivative-free methods for large-scale nonlinear monotone system of equations and applications to image restoration problems. J. Appl. Math. Comput. 1–28 (2022)
[30]
Wood, A.J., Wollenberg, B.F., Sheblé, G.B.: Power generation, operation, and control. John Wiley & Sons (2013)
[31]
Xiao Y and Zhu H A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing J. Math. Anal. Appl. 2013 405 1 310-319
[32]
Yin J, Jian J, Jiang X, Liu M, and Wang L A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications 2021 Algorithms Numer
[33]
Yu Z, Lin J, Sun J, Xiao Y, Liu L, and Li Z Spectral gradient projection method for monotone nonlinear equations with convex constraints Appl. Numer. Math. 2009 59 10 2416-2423
[34]
Zhang L and Zhou W Spectral gradient projection method for solving nonlinear monotone equations J. Comput. Appl. Math. 2006 196 2 478-484
Recommendations
A hybrid BFGS-Like method for monotone operator equations with applications
AbstractIn this paper, a hybrid three-term conjugate gradient (CG) method is proposed to solve constrained nonlinear monotone operator equations. The search direction is computed such that it is close to the direction obtained by the memoryless Broyden–...
Modified three-term derivative-free projection method for solving nonlinear monotone equations with application
AbstractIn this paper, we propose a new modification of a three-term derivative-free projection algorithm for solving a system of monotone nonlinear equations. The global convergence was proved under some suitable conditions, and the search direction of ...
An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints
In this paper, based on the hyperplane projection technique, we propose a three-term conjugate gradient method for solving nonlinear monotone equations with convex constraints. Due to the derivative-free feature and lower storage requirement, the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 20 October 2023
Accepted: 28 September 2023
Received: 07 July 2023
Author Tags
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 14 Dec 2024