Abstract
We consider a class of optimal control problems with a state constraint and investigate a trajectory with a single boundary interval (subarc). Following R.V. Gamkrelidze, we differentiate the state constraint along the boundary subarc, thus reducing the original problem to a problem with mixed control-state constraints, and show that this way allows one to obtain the full system of stationarity conditions in the form of A.Ya. Dubovitskii and A.A. Milyutin, including the sign definiteness of the measure (state constraint multiplier), i.e., the nonnegativity of its density and atoms at junction points. The stationarity conditions are obtained by a two-stage variation approach, proposed in this paper. At the first stage, we consider only those variations, which do not affect the boundary interval, and obtain optimality conditions in the form of Gamkrelidze. At the second stage, the variations are concentrated on the boundary interval, thus making possible to specify the stationarity conditions and obtain the sign of density and atoms of the measure.
Similar content being viewed by others
Notes
For a function \(\mu (t)\) of bounded variation, its generalized derivative \(\dot{\mu }(t)= \mathrm{{d}}\mu (t)/\mathrm{{d}}t\) is a generalized function in the sense that \(\dot{\mu }(t)\,\mathrm{{d}}t = \mathrm{{d}}\mu (t)\) is the Riemann–Stieltjes measure generated by the function \(\mu (t).\) If \(\mu (t)\) is absolute continuous, then \(\dot{\mu }(t)\) is a usual Lebesgue integrable function; if \(\mu (t)\) is discontinuous at a point \(t_*\,,\) then \(\dot{\mu }(t)\) contains the Dirac \(\delta -\)function at \(t_*\,.\)
If \(\psi (t)\) is the adjoint variable in the Dubovitskii–Milyutin form, \(\varPhi (t,x(t))\le 0\) is the state constraint, and a monotone function \(\mu (t)\) generates the corresponding measure, then \(\widetilde{\psi }(t) = \psi (t) -\mu (t)\,\varPhi '_x(t, x^0(t))\) is the adjoint variable in the Gamkrelidze form.
References
Dubovitskii, A.Y., Milyutin, A.A.: Extremum problems in the presence of restrictions. USSR Comput. Math. Math. Phys 5(3), 1–80 (1965)
Girsanov, I.V.: Lectures on Mathematical Theory of Extremum Problems. Springer, Berlin (1972)
Ioffe, A.D., Tikhomirov, V.M.: Theory of Extremal Problems. North-Holland Publishing Company, Amsterdam (1974)
Pontryagin, L.S., Boltyanskii, V.G., Gamkrelidze, R.V., Mishechenko, E.F.: The Mathematical Theory of Optimal Processes. Wiley, New York (1962)
Hartl, F.H., Sethi, S.P., Vickson, R.G.: A survey of the maximum principles for optimal control problems with state constraints. SIAM Rev. 37(2), 181–218 (1995)
Arutyunov, A.V., Karamzin, D.Y., Pereira, F.L.: The maximum principle for optimal control problems with state constraints by R.V. Gamkrelidze: revisited. J. Optim. Theory Appl. 149(3), 474–493 (2011)
Dmitruk, A.V., Osmolovskii, N.P.: Necessary conditions for a weak minimum in optimal control problems with integral equations on a variable time interval. Discrete Contin. Dyn. Syst. 35(9), 4323–4343 (2015)
Dmitruk, A.V., Kaganovich, A.M.: The hybrid maximum principle is a consequence of Pontryagin maximum principle. Syst. Control Lett. 57(11), 964–970 (2008)
Denbow, C.H.: A Generalized Form of the Problem of Bolza. Contributions to the Calculus of Variations, 1933–1937, pp. 449–484. The University of Chicago Press, Chicago (1937)
Volin, Y.M., Ostrovskii, G.M.: Maximum principle for discontinuous systems and its application to problems with state constraints (In Russian). Izvestia Vuzov. Radiofzika 12, 1609–1621 (1969)
Augustin, D., Maurer, H.: Second order sufficient conditions and sensitivity analysis for optimal multiprocess control problems. Control Cybern. 29(1), 11–31 (2000)
Maurer, H., Buskens, C., Kim, J.-H.R., Kaya, C.Y.: Optimization methods for the verification of second order sufficient conditions for bang–bang controls. Optim. Control Appl. Methods 26, 129–156 (2005)
Oberle, H.J., Rosendahl, R.: On singular arcs in nonsmooth optimal control. Control Cybern. 37(2), 429–450 (2008)
Dmitruk, A.V., Kaganovich, A.M.: Maximum principle for optimal control problems with intermediate constraints. Comput. Math. Model. 22(2), 180–215 (2011)
Liu, Y., Teo, K.L., Jennings, L.S., Wang, S.: On a class of optimal control problems with state jumps. J. Optim. Theory Appl. 98(1), 65–82 (1998)
Milyutin, A.A., Osmolovskii, N.P.: Calculus of variations and optimal control. American Mathematical Society, Providence (1998)
Milyutin, A.A., Dmitruk, A.V., Osmolovskii, N.P.: Maximum principle in optimal control (Princip maksimuma v optimal’nom upravlenii, in Russian). Lomonosov Moscow State University, Faculty of Mathematics and Mechanics, Moscow (2004)
Dmitruk, A.V., Osmolovskii, N.P.: Necessary conditions for a weak minimum in optimal control problems with integral equations subject to state and mixed constraints. SIAM J. Control Optim. 52(6), 3437–3462 (2014)
Afanasyev, A.P., Dikusar, V.V., Milyutin, A.A., Chukanov, S.V.: Necessary Condition in Optimal Control (Neobchodimoye uslociye v optimal’nom upravlenii, in Russian). Nauka, Moscow (1990)
Maurer, H.: On optimal control problems with bounded state variables and control appearing linearly. SIAM J. Control Optim. 15(3), 345–362 (1977)
Bonnans, J.F., de la Vega, C.: Optimal control of state constrained integral equations. Set-Valued Anal. 18, 307–326 (2010)
de Pinho, M.R., Shvartsman, I.: Lipschitz continuity of optimal control and Lagrange multipliers in a problem with mixed and pure state constraints. Discrete Contin. Dyn. Syst. Ser. A 29(2), 505–522 (2011)
Arutyunov, A.V., Karamzin, D.Y., Pereira, F.: Conditions for the absence of jumps of the solution to the adjoint system of the maximum principle for optimal control problems with state constraints. Proc. Steklov Inst. Math. 292(1), 27–35 (2016)
Acknowledgements
This research was partially supported by the Russian Foundation for Basic Research under Grant No. 16-01-00585. The authors thank Nikolai Osmolovskii for useful discussions and the anonymous referees for valuable remarks.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Boris Vexler.
Rights and permissions
About this article
Cite this article
Dmitruk, A., Samylovskiy, I. On the Relation Between Two Approaches to Necessary Optimality Conditions in Problems with State Constraints. J Optim Theory Appl 173, 391–420 (2017). https://doi.org/10.1007/s10957-017-1089-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-017-1089-0
Keywords
- Optimal control problem
- State constraint
- Mixed constraint
- Boundary subarc
- Extremal
- Extended weak minimality
- Replication of variables
- Atoms of measure