Abstract
Solving an optimal control problem consists in finding a control structure and corresponding switching times. Unlike in a bang-bang case, switching to a singular control perturbs the control structure. The perturbation of one of the switching times affects any subsequent singular intervals in the control, as the trajectories move along different singular arcs with different values of singular controls. It makes the problem of finding optimal solutions extremely difficult. In this paper, we discuss a gradient method for solving optimal control problems, when singular intervals are present in the optimal structure. The method is based on applying the necessary conditions of optimality given by the Pontryagin Maximum Principle, where the control variable enters the Hamiltonian linearly. To demonstrate the method, we formulate a nonlinear optimal control problem and then, using the proposed algorithm, we solve the problem and find the optimal control structure and corresponding switching times. Lastly, we compare the results with results obtained using three popular optimisation modelling languages: Pyomo, AMPL and JuMP. These languages serve as interfaces for solving the optimal control problem with the non-linear optimisation algorithm Ipopt. Our case study shows that the presented method not only computes the switching times accurately, but also moves precisely along the singular arc.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Atkins, S., Aghaee, M., Martcheva, M., Hager, W.: Computational and Mathematical Population Dynamics. World Scientific (2023). https://doi.org/10.1142/13045
Bajger, P., Bodzioch, M., Foryś, U.: Singularity of controls in a simple model of acquired chemotherapy resistance. Discrete Contin. Dyn. Syst. Ser. B 24(5), 2039–2052 (2019). https://doi.org/10.3934/dcdsb.2019083
Bajger, P., Bodzioch, M., Foryś, U.: Numerical optimisation of chemotherapy dosage under antiangiogenic treatment in the presence of drug resistance. Math. Methods Appl. Sci. 43, 10671–10689 (2020). https://doi.org/10.1002/mma.6958
Bodzioch, M., Bajger, P., Foryś, U.: Angiogenesis and chemotherapy resistance: optimizing chemotherapy scheduling using mathematical modeling. J. Cancer Res. Clin. Oncol. 147(8), 2281–2299 (2021). https://doi.org/10.1007/s00432-021-03657-9
Bodzioch, M., Bajger, P., Foryś, U.: Competition between populations: preventing domination of resistant population using optimal control. Appl. Math. Model. 114, 697–693 (2023). https://doi.org/10.1016/j.apm.2022.10.016
Bonnard, B., Chyba, M.: Singular Trajectories and their Role in Control Theory, Mathematics and Applications, vol. 40. Springer, Cham (2003)
Falcone, M., Ferretti, R., Grüne, L., McEneaney, W.M. (eds.): Numerical Methods for Optimal Control Problems. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-01959-4
Foroozandeh, Z., do Rosário de Pinho, M., Shamsi, M.: On numerical methods for singular optimal control problems: an application to an AUV problem. Discrete Contin. Dyn. Syst. Ser. B 24(5), 2219–2235 (2019). https://doi.org/10.3934/dcdsb.2019092
Schättler, H., Ledzewicz, U.: Optimal Control for Mathematical Models of Cancer Therapies. IAM, vol. 42. Springer, New York (2015). https://doi.org/10.1007/978-1-4939-2972-6
Pager, E.R., Rao, A.V.: Method for solving bang-bang and singular optimal control problems using adaptive Radau collocation. Comput. Optim. Appl. 81, 857–887 (2022). https://doi.org/10.1007/s10589-022-00350-6
Ruder, S.: An overview of gradient descent optimization algorithms. CoRR abs/1609.04747 (2016). http://arxiv.org/abs/1609.04747
Śmieja, J., Świerniak, A., Duda, Z.: Gradient method for finding optimal scheduling in infinite dimensional models of chemotherapy. J. Theoret. Med. 3, 25–36 (2000). https://doi.org/10.1080/10273660008833062
Wächter, A., Biegler, L.: On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math. Program. 106, 25–57 (2006). https://doi.org/10.1007/s10107-004-0559-y
Zelikin, M., Borisov, V.: Theory of chattering control: with applications to astronautics, robotics, economics, and engineering. Birkhäuser (1994). https://doi.org/10.1007/978-1-4612-2702-1
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bodzioch, M. (2024). Gradient Method for Solving Singular Optimal Control Problems. In: Franco, L., de Mulatier, C., Paszynski, M., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M.A. (eds) Computational Science – ICCS 2024. ICCS 2024. Lecture Notes in Computer Science, vol 14836. Springer, Cham. https://doi.org/10.1007/978-3-031-63775-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-63775-9_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-63774-2
Online ISBN: 978-3-031-63775-9
eBook Packages: Computer ScienceComputer Science (R0)