Abstract
In this paper, a class of smooth penalty functions is proposed for constrained optimization problem. It is put forward based on \(L_p\), a smooth function of a class of exact penalty function \({\ell _p}~\left( {p \in (0,1]} \right) \). Based on the class of penalty functions, a penalty algorithm is presented. Under the very weak condition, a perturbation theorem is set up. The global convergence of the algorithm is derived. This result generalizes some existing conclusions. Finally, numerical experiments on two examples demonstrate the effectiveness and efficiency of our algorithm.
Similar content being viewed by others
Data Availability
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
References
Auslender, A.: Penalty and barrier methods: a unified framework. SIAM J. Optim. 10(1), 211–230 (1999)
Auslender, A., Cominetti, R., Haddou, M.: Asymptotic analysis for penalty and barrier methods in convex and linear programming. Math. Oper. Res. 22(1), 43–62 (1997)
Ben-Tal, A., Teboulle, M.: A smoothing technique for nondifferentiable optimization problems. In: Optimization: Proceedings of the Fifth French-German Conference Held in Castel-Novel (Varetz), France, Oct. 3–8, 1988, pp. 1–11. Springer (2006)
Mangasarian, O., Chen, C.: A class of smoothing functions for nonlinear and mixed complementarity problems. Comput. Optim. Appl. 5(2), 97–138 (1996)
Chen, C., Mangasarian, O.L.: Smoothing methods for convex inequalities and linear complementarity problems. Math. Program. 71(1), 51–69 (1995)
Gonzaga, C.C., Castillo, R.A.: A nonlinear programming algorithm based on non-coercive penalty functions. Math. Program. 96, 87–101 (2003)
Pinar, M.Ç., Zenios, S.A.: On smoothing exact penalty functions for convex constrained optimization. SIAM J. Optim. 4(3), 486–511 (1994)
Rubinov, A.M., Glover, B.M., Yang, X.: Decreasing functions with applications to penalization. SIAM J. Optim. 10(1), 289–313 (1999)
Wang, C., Ma, C., Zhou, J.: A new class of exact penalty functions and penalty algorithms. J. Global Optim. 58(1), 51–73 (2014)
Luo, Z.-Q., Pang, J.-S., Ralph, D.: Mathematical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge (1996)
Babacan, S.D., Mancera, L., Molina, R., Katsaggelos, A.K.: Non-convex priors in Bayesian compressed sensing. In: 2009 17th European Signal Processing Conference, pp. 110–114 (2009). IEEE
Kloft, M., Brefeld, U., Laskov, P., Müller, K.-R., Zien, A., Sonnenburg, S.: Efficient and accurate \(\ell _p\)-norm multiple kernel learning. NIPS 22, 997–1005 (2009)
Zhang, C., Wang, J., Xiu, N.: Robust and sparse portfolio model for index tracking. J. Ind. Manag. Optim. 15(3), 1001–1015 (2019)
Acknowledgements
The authors would like to express their sincere thanks to the editor and the anonymous reviewers for their helpful comments and suggestions to improve this paper.
Funding
This research was supported by Natural Science Foundation of Shandong Province (ZR2021MA066).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhao, W., Wang, R. & Song, D. Global convergence of a class new smooth penalty algorithm for constrained optimization problem. J. Appl. Math. Comput. 69, 3987–3997 (2023). https://doi.org/10.1007/s12190-023-01911-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12190-023-01911-6
Keywords
- Exact penalty function
- Smooth penalty approach
- Perturbation function
- Penalty algorithm
- Global convergence