A survey on sufficient optimality conditions for delayed optimal control problems
Ana P. Lemos-Paiao, Cristiana J. Silva, Delfim F. M. Torres
备注：
This is a preprint of the following paper: A. P. Lemos-Paião, C. J. Silva and D. F. M. Torres, A survey on sufficient optimality conditions for delayed optimal control problems, published in Mathematical Modelling and Analysis of Infectious Diseases, edited by K. Hattaf and H. Dutta, Springer Nature Switzerland AG. Submitted 2/Feb/2020; revised 16/Apr/2020; accepted 17/Apr/2020. arXiv admin note: substantial text overlap with arXiv:1901.04340, arXiv:1804.06937
发表信息：
Studies in Systems, Decision and Control 302 (2020), 323--342
The aim of this work is to make a survey on recent sufficient optimality conditions for optimal control problems with time delays in both state and control variables. The results are obtained by transforming delayed optimal control problems into equivalent non-delayed problems. Such approach allows to use standard theorems that ensure sufficient optimality conditions for non-delayed optimal control problems. Examples are given with the purpose to illustrate the results.
We prove a sufficient optimality condition for non-linear optimal control problems with delays in both state and control variables. Our result requires the verification of a Hamilton-Jacobi partial differential equation and is obtained through a transformation that allow us to rewrite a delayed optimal control problem as an equivalent non-delayed one.
We give answer to an open question by proving a sufficient optimality condition for state-linear optimal control problems with time delays in state and control variables. In the proof of our main result, we transform a delayed state-linear optimal control problem to an equivalent non-delayed problem. This allows us to use a well-known theorem that ensures a sufficient optimality condition for non-delayed state-linear optimal control problems. An example is given in order to illustrate the obtained result.
A linear quadratic (LQ) stochastic optimization problem with delay involving weakly-coupled large population is investigated in this paper. Different to classic mean field (MF) game, here agents cooperate with each other to minimize the so-called \emph{social} objective. With the aid of \emph{delayed person-by-person optimality} principle, one arrives at an auxiliary LQ delayed control problem by decentralized information. A decentralized strategy is obtained by feat of an MF type anticipated forward-backward stochastic differential delay equation (AFBSDDE) consistency condition. The discounti…
We establish sufficient conditions for the existence and uniqueness of mean-field backward stochastic differential equations with time delayed generator in the sense that at t, the generator may depend on previous values up to a delay constant δ not on the hole past as in Delong and Imkeller [10], [13]. For sufficiently small delay constant δ and for any finite time horizon, we get a unique solution.
This paper is concerned with the derivation of first- and second-order sufficient optimality conditions for optimistic bilevel optimization problems involving smooth functions. First-order sufficient optimality conditions are obtained by estimating the tangent cone to the feasible set of the bilevel program in terms of initial problem data. This is done by exploiting several different reformulations of the hierarchical model as a single-level problem. To obtain second-order sufficient optimality conditions, we exploit the so-called value function reformulation of the bilevel optimization probl…
This note establishes that a generalization of $c$-cyclical monotonicity from the Monge-Kantorovich problem with two marginals gives rise to a sufficient condition for optimality also in the multi-marginal version of that problem. To obtain the result, the cost function is assumed to be bounded by a sum of integrable functions. The proof rests on ideas from martingale transport.
In this note, we present an elementary proof for a well-known second-order sufficient optimality condition in nonlinear semidefinite optimization which does not rely on the enhanced theory of second-order tangents. Our approach builds on an explicit elementary computation of the so-called second subderivative of the indicator function associated with the semidefinite cone which recovers the best curvature term known in the literature.
In this paper, we present some second-order sufficient conditions in terms of the Demyanov-Pevnyi's second-order directional derivatives for efficiency of $C^1$ vector optimization problems with constraints. Our results improve and generalize conditions obtained by various authors in recent papers.
The case of time minimization for affine control systems with control on the disk is studied. After recalling the standard sufficient conditions for local optimality in the smooth case, the analysis focusses on the specific type of singularities encountered when the control is prescribed to the disk. Using a suitable stratification, the regularity of the flow is analyzed, which helps to devise verifiable sufficient conditions in terms of left and right limits of Jacobi fields at a switching point. Under the appropriate assumptions, piecewise regularity of the field of extremals is obtained.
We present a unified study of first and second order necessary and sufficient optimality conditions for minimax and Chebyshev optimisation problems with cone constraints. First order optimality conditions for such problems can be formulated in several different forms: in terms of a linearised problem, in terms of Lagrange multipliers (KKT-points), in terms of subdifferentials and normal cones, in terms of a nonsmooth penalty function, in terms of cadres with positive cadre multipliers, and in an alternance form. We describe interconnections between all these forms of necessary and sufficient o…
In mathematical economics, the used functions are, in general, considered to be quasiconcave. Moreover, they are, in many cases, separable of nature. It is known that a local maximum of a quasiconcave function is not, in general, a global maximum. In this paper we will show that this property is true when the quasiconcave function is furthermore separable. Sufficient optimality conditions for a separable quasiconcave programming will be studied in both differentiable and nondifferentiable cases. Thanks to separability condition, quasiconcave functions have nice properties in optimization probl…
In this paper we are concerned with generalised L 1-minimisation problems, i.e. Bolza problems involving the absolute value of the control with a control-affine dynamics. We establish sufficient conditions for the strong local optimality of extremals given by the concatenation of bang, singular and inactive (zero) arcs. The sufficiency of such conditions is proven by means of Hamiltonian methods. As a byproduct of the result, we provide an explicit invariant formula for the second variation along the singular arc.
In this article we study optimal control problems for systems that are affine with respect to some of the control variables and nonlinear in relation to the others. We consider finitely many equality and inequality constraints on the initial and final values of the state. We investigate singular optimal solutions for this class of problems, for which we obtain second order necessary and sufficient conditions for weak optimality in integral form. We also derive Goh pointwise necessary optimality conditions. We show an example to illustrate the results.
Throughout this paper, we focused our aim on the problem of optimal control under a risk-sensitive performance functional, where the system is given by a fully coupled forward-backward stochastic differential equation with jump. The risk neutral control system has been used as preliminary step, where the admissible controls are convex, and the optimal solution exists. The necessary as well as sufficient optimality conditions for risk-sensitive performance are proved. At the end of this work, we illustrate our main result by giving an example of mean-variance for risk sensitive control problem …
We establish sufficient conditions for the existence and uniqueness of different types of delayed BSDEs in finite time horizon. We consider then infinite horizon, replacing the terminal value condition in the finite horizon case with a condition of strong decay at infinity.
We study methods for solving stochastic control problems of systems of forward-backward mean-field equations with delay, in finite or infinite horizon. Necessary and sufficient maximum principles under partial information are given. The results are applied to solve a recursive utility optimal problem
In this paper we study strongly robust optimal control problems under volatility uncertainty. In the $G$-framework we adapt the stochastic maximum principle to find necessary and sufficient conditions for the existence of a strongly robust optimal control.
In the present work, we obtain the constants of motion for isoperimetric variational problems with time delay. We consider a constrained optimization problem where the Lagrangian function defining the functional depends on time delayed arguments. We prove the isoperimetric Euler--Lagrange and DuBois--Reymond type optimality conditions and, in order to investigate the constants of motion for this problem, we obtain a nonsmooth extension of Noether's symmetry theorem for isoperimetric variational problems with delayed arguments.
The idea of iterative process optimization based on collected output measurements, or "real-time optimization" (RTO), has gained much prominence in recent decades, with many RTO algorithms being proposed, researched, and developed. While the essential goal of these schemes is to drive the process to its true optimal conditions without violating any safety-critical, or "hard", constraints, no generalized, unified approach for guaranteeing this behavior exists. In this two-part paper, we propose an implementable set of conditions that can enforce these properties for any RTO algorithm. This seco…
This paper deals with second-order optimality conditions for a quasilinear elliptic control problem with a nonlinear coefficient in the principal part that is countably $PC^2$ (continuous and $C^2$ apart from countably many points). We prove that the control-to-state operator is continuously differentiable even though the nonlinear coefficient is non-smooth. This enables us to establish "no-gap" second-order necessary and sufficient optimality conditions in terms of an abstract curvature functional, i. e., for which the sufficient condition only differs from the necessary one in the fact that …
One of the most important optimality conditions to aid to solve a vector optimization problem is the first-order necessary optimality condition that generalizes the Karush-Kuhn-Tucker condition. However, to obtain the sufficient optimality conditions, it is necessary to impose additional assumptions on the objective functions and in the constraint set. The present work is concerned with the constrained vector quadratic fractional optimization problem. It shows that sufficient Pareto optimality conditions and the main duality theorems can be established without the assumption of generalized con…
In this paper we derive for a controlled stochastic evolution system on a Hilbert space sufficient conditions for optimality. Our result is derived by using its so-called adjoint backward stochastic evolution equation.
We study a multiobjective variational problem on time scales. For this problem, necessary and sufficient conditions for weak local Pareto optimality are given. We also prove a necessary optimality condition for the isoperimetric problem with multiple constraints on time scales.
The idea of iterative process optimization based on collected output measurements, or "real-time optimization" (RTO), has gained much prominence in recent decades, with many RTO algorithms being proposed, researched, and developed. While the essential goal of these schemes is to drive the process to its true optimal conditions without violating any safety-critical, or "hard", constraints, no generalized, unified approach for guaranteeing this behavior exists. In this two-part paper, we propose an implementable set of conditions that can enforce these properties for any RTO algorithm. The first…
While the Pontryagin Maximum Principle can be used to calculate candidate extremals for optimal orbital transfer problems, these candidates cannot be guaranteed to be at least locally optimal unless sufficient optimality conditions are satisfied. In this paper, through constructing a parameterized family of extremals around a reference extremal, some second-order necessary and sufficient conditions for the strong-local optimality of the free-time multi-burn fuel-optimal transfer are established under certain regularity assumptions. Moreover, the numerical procedure for computing these optimali…
We study the equivalence of several well-known sufficient optimality conditions for a general quadratically constrained quadratic program (QCQP). The conditions are classified in two categories. The first one is for determining an optimal solution and the second one is for finding an optimal value. The first category of conditions includes the existence of a saddle point of the Lagrangian function and the existence of a rank-1 optimal solution of the primal SDP relaxation of QCQP. The second category includes $η_p = ζ$, $η_d = ζ$, and $φ= ζ$, where $ζ$, $η_p$, $η_d$, and $φ$ denote the optimal…
In this paper we consider an optimal control problem governed by a semilinear heat equation with bilinear control-state terms and subject to control and state constraints. The state constraints are of integral type, the integral being with respect to the space variable. The control is multidimensional. The cost functional is of a tracking type and contains a linear term in the control variables. We derive second order sufficient conditions relying on the Goh transform. The appendix provides an example illustrating the applicability of our results.
Sufficient conditions for global stabilization of nonlinear systems with delayed input by means of approximate predictors are presented. An approximate predictor is a mapping which approximates the exact values of the stabilizing input for the corresponding system with no delay. A systematic procedure for the construction of approximate predictors is provided for globally Lipschitz systems. The resulting stabilizing feedback can be implemented by means of a dynamic distributed delay feedback law. Illustrating examples show the efficiency of the proposed control strategy.
In this paper, we propose second-order sufficient optimality conditions for a very general nonconvex constrained optimization problem, which covers many prominent mathematical programs.Unlike the existing results in the literature, our conditions prove to be sufficient, for an essential local minimizer of second order, under merely basic smoothness and closedness assumptions on the data defining the problem.In the second part, we propose a comprehensive first- and second-order variational analysis of disjunctive systems and demonstrate how the second-order objects appearing in the optimality c…
New form of sufficient optimality condition is obtained in comparison with the Mangasarian sufficiency theorem. Both finite and infinite values of objective functional are allowed since concepts of overtaking and weakly overtaking optimality are implied. Examples, where new conditions can be applied are presented. The conditions are shown to be both necessary and sufficient, when Hamiltonian is linear with respect to state and control.
In this paper we investigate admissibility of the control operator $B$ in a Hilbert space state-delayed dynamical system setting of the form $\dot{z}(t)=Az(t-τ)+Bu(t)$, where $A$ generates a diagonal semigroup and $u$ is a scalar input function. Our approach is based on the Laplace embedding between $L^2$ and the Hardy space. The sufficient conditions for infinite-time admissibility are stated in terms of eigenvalues of the generator and in terms of the control operator itself.
We consider a stochastic control problem where the set of strict (classical) controls is not necessarily convex, and the system is governed by a nonlinear backward stochastic differential equation. By introducing a new approach, we establish necessary as well as sufficient conditions of optimality for two models. The first concerns the relaxed controls, who are measure-valued processes. The second is a particular case of the first and relates to strict control problems.
This paper is concerned with a non-zero sum differential game problem of an anticipated forward-backward stochastic differential delayed equation under partial information. We establish a necessary maximum principle and sufficient verification theorem of the game system by virtue of the duality and convex variational method. We apply the theoretical results and stochastic filtering theory to study a linear-quadratic game system and derive the explicit form of the Nash equilibrium point and discuss the existence and uniqueness in particular cases. As an application, we consider a time-delayed p…
We consider the ramp metering problem for a freeway stretch modeled by the Cell Transmission Model. Assuming perfect model knowledge and perfect traffic demand prediction, the ramp metering problem can be cast as a finite horizon optimal control problem with the objective of minimizing the Total Time Spent, i.e., the sum of the travel times of all drivers. For this reason, the application of Model Predictive Control (MPC) to the ramp metering problem has been proposed. However, practical tests on freeways show that MPC may not outperform simple, distributed feedback policies. Until now, a theo…
The paper puts forward sufficient conditions for local controllability of a control dynamical system. The results obtained are meaningful in the case when the linear approximation to this system is not completely controllable. As a corollary, we obtain necessary second-order optimality conditions for a general optimal control problem.
We prove necessary optimality conditions of Euler-Lagrange type for a problem of the calculus of variations with time delays, where the delay in the unknown function is different from the delay in its derivative. Then, a more general optimal control problem with time delays is considered. Main result gives a convergence theorem, allowing to obtain a solution to the delayed optimal control problem by considering a sequence of delayed problems of the calculus of variations.
We obtain a nonsmooth higher-order extension of Noether's symmetry theorem for variational isoperimetric problems with delayed arguments. The result is proved to be valid in the class of Lipschitz functions, as long as the delayed higher-order Euler--Lagrange extremals are restricted to those that satisfy the delayed higher-order DuBois--Reymond necessary optimality condition. The important case of delayed isoperimetric optimal control problems is considered as well.
We provide a first-order necessary and sufficient condition for optimality of lower semicontinuous functions on Banach spaces using the concept of subdifferential. From the sufficient condition we derive that any subdifferential operator is monotone absorbing, hence maximal monotone when the function is convex.
We analyze a potentially risk-averse convex stochastic optimization problem, where the control is deterministic and the state is a Banach-valued essentially bounded random variable. We obtain strong forms of necessary and sufficient optimality conditions for problems subject to equality and conical constraints. We propose a Moreau--Yosida regularization for the conical constraint and show consistency of the optimality conditions for the regularized problem as the regularization parameter is taken to infinity.
In this paper, we introduce a new second-order directional derivative and a second-order subdifferential of Hadamard type for an arbitrary nondifferentiable function. We derive several second-order optimality conditions for a local and a global minimum and an isolated local minimum of second-order in unconstrained optimization. In particular, we obtain two types results with generalized convex functions. We also compare our conditions with the results of the recently published paper [Bednavrik, D., Pastor, K.: On second-order conditions in unconstrained optimization. Math. Program. Ser A, {\bf…
The present paper is devoted to the study of average consensus problems for undirected networks of dynamic agents having communication delays. The accent is put here on the study of the time-delays influence: both constant and time-varying delays are considered, as well as uniform and non uniform repartitions of the delays in the network. The main results provide sufficient conditions (also necessary in most cases) for existence of average consensus under bounded, but otherwise unknown, communication delays. Simulations are provided that show adequation with these results.
This article is devoted to the analysis of necessary and/or sufficient conditions for metric regularity in terms of Demyanov-Rubinov-Polyakova quasidifferentials. We obtain new necessary and sufficient conditions for the local metric regularity of a multifunction in terms of quasidifferentials of the distance function to this multifunction. We also propose a new MFCQ-type constraint qualification for a parametric system of quasidifferentiable equality and inequality constraints and prove that it ensures the metric regularity of a multifunction associated with this system. As an application, we…
In this paper, in terms of three types of generalized second-order derivatives of a nonsmooth function, we mainly study the corresponding second-order optimality conditions in a Hilbert space and prove the equivalence among these optimality conditions for paraconcave functions. As applications, we use these second-order optimality conditions to study strict local minimizers of order two and provide sufficient and/or necessary conditions for ensuring the local minimizer. This work extends and generalizes the study on second-order optimality conditions from the finite-dimensional space to the Hi…
