Abstract
We consider the regularization of two proximal point algorithms (PPA) with errors for a maximal monotone operator in a real Hilbert space, previously studied, respectively, by Xu, and by Boikanyo and Morosanu, where they assumed the zero set of the operator to be nonempty. We provide a counterexample showing an error in Xu’s theorem, and then we prove its correct extended version by giving a necessary and sufficient condition for the zero set of the operator to be nonempty and showing the strong convergence of the regularized scheme to a zero of the operator. This will give a first affirmative answer to the open question raised by Boikanyo and Morosanu concerning the design of a PPA, where the error sequence tends to zero and a parameter sequence remains bounded. Then, we investigate the second PPA with various new conditions on the parameter sequences and prove similar theorems as above, providing also a second affirmative answer to the open question of Boikanyo and Morosanu. Finally, we present some applications of our new convergence results to optimization and variational inequalities.
Similar content being viewed by others
References
Rockafellar, R.T.: On the maximal monotonicity of subdifferential mappings. Pac. J. Math. 33, 209–216 (1970)
Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976)
Baillon, J.B.: Un théorème de type ergodique pour les contractions non linéaires dans un espace de Hilbert. Comptes R. Acad. Sci. Paris, Sér. A B 280, A1511–A1514 (1975)
Borwein, J.M.: Fifty years of maximal monotonicity. Optim. Lett. 4, 473–490 (2010)
Brézis, H.: Opérateurs Maximaux Monotones et Semi-Groupes de Contractions dans les Espaces de Hilbert, North-Holland Mathematics Studies, vol. 5. North-Holland, Amsterdam (1973)
Morosanu, G.: Nonlinear Evolution Equations and Applications. Reidel, Dordrecht (1988)
Pardalos, P.M., Rassias, T.M., Khan, A.A.: Nonlinear Analysis and Variational Problems, Springer Optimization and Its Applications, vol. 35. Springer, New York (2010)
Djafari Rouhani, B., Khatibzadeh, H.: On the proximal point algorithm. J. Optim. Theory Appl. 137, 411–417 (2008)
Djafari Rouhani, B.: Ergodic theorems for nonexpansive sequences in Hilbert spaces and related problems. Ph.D. Thesis, Yale University, part I, pp. 1–76 (1981)
Djafari Rouhani, B.: Asymptotic behaviour of quasi-autonomous dissipative systems in Hilbert spaces. J. Math. Anal. Appl. 147, 465–476 (1990)
Djafari Rouhani, B.: Asymptotic behaviour of almost nonexpansive sequences in a Hilbert space. J. Math. Anal. Appl. 151, 226–235 (1990)
Djafari Rouhani, B., Moradi, S.: Strong convergence of two proximal point algorithms with possible unbounded error sequences. J. Optim. Theory Appl. 172, 222–235 (2017)
Song, Y., Yang, C.: A note on a paper “A regularization method for the proximal point algorithm”. J. Glob. Optim. 43, 171–174 (2009)
Wang, F.: A note on the regularized proximal point algorithm. J. Glob. Optim. 50, 531–535 (2011)
Yao, Y., Shahzad, N.: Strong convergence of a proximal point algorithm with general errors. Optim. Lett. 6, 621–628 (2012)
Xu, H.K.: A regularization method for the proximal point algorithm. J. Glob. Optim. 36, 115–125 (2006)
Lehdili, N., Moudafi, A.: Combining the proximal algorithm and Tikhonov regularization. Optimization 37, 239–252 (1996)
Boikanyo, O.A., Morosanu, G.: A proximal point algorithm converging strongly for general errors. Optim. Lett. 4, 635–641 (2010)
Boikanyo, O.A., Morosanu, G.: Modified Rockafellar’s algorithm. Math. Sci. Res. J. 13, 101–122 (2009)
Güler, O.: On the convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 29, 403–419 (1991)
Wang, Y., Wang, F., Xu, H.K.: Error sensitivity for strongly convergent modifications of the proximal point algorithm. J. Optim. Theory Appl. 168, 901–916 (2016)
Cui, H., Ceng, L.: Convergence of over-relaxed contraction-proximal point algorithm in Hilbert spaces. Optimization 66, 793–809 (2017)
Acknowledgements
The authors are grateful to the editor and the referees for valuable suggestions leading to the improvement of the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Qamrul Hasan Ansari.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Djafari Rouhani, B., Moradi, S. Strong Convergence of Regularized New Proximal Point Algorithms. J Optim Theory Appl 181, 864–882 (2019). https://doi.org/10.1007/s10957-019-01497-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-019-01497-9