Turnpike properties have been established long time ago in finite-dimensional optimal control problems arising in econometry. They refer to the fact that, under quite general assumptions, the optimal solutions of a given optimal control problem settled in large time consist approximately of three pieces, the first and the last of which being transient short-time arcs, and the middle piece being a long-time arc staying exponentially close to the optimal steady-state solution of an associated static optimal control problem. We provide in this paper a general version of a turnpike theorem, valuable for nonlinear dynamics without any specific assumption, and for very general terminal conditions. Not only the optimal trajectory is shown to remain exponentially close to a steady-state, but also the corresponding adjoint vector of the Pontryagin maximum principle. The exponential closedness is quantified with the use of appropriate normal forms of Riccati equations. We show then how the property on the adjoint vector can be adequately used in order to initialize successfully a numerical direct method, or a shooting method. In particular, we provide an appropriate variant of the usual shooting method in which we initialize the adjoint vector, not at the initial time, but at the middle of the trajectory.
An exponential turnpike property for a semilinear control problem is proved. The state-target is assumed to be small, whereas the initial datum can be arbitrary. Turnpike results are also obtained for large targets, requiring that the control acts everywhere. In this case, we prove the convergence of the infimum of the averaged time-evolution functional towards the steady one. Numerical simulations are performed.
This paper is devoted to the study of the turnpike phenomenon arising in the optimal distributed control tracking-type problem for the Navier-Stokes equations. We obtain a positive answer to this property in the case when the controls are time-dependent functions, and also when are independent of time. In both cases we prove an exponential turnpike property assuming that the stationary optimal state satisfy certain properties of smallness.
This paper presents, using dynamical system theory, a framework for investigating the turnpike property in nonlinear optimal control. First, it is shown that a turnpike-like property appears in general dynamical systems with hyperbolic equilibrium and then, apply it to optimal control problems to obtain sufficient conditions for the turnpike occurs. The approach taken is geometric and gives insights for the behaviors of controlled trajectories, allowing us to find simpler proofs for existing results on the turnpike properties. Attempts to remove smallness restrictions for initial and target st…
We first derive a general integral-turnpike property around a set for infinite-dimensional non-autonomous optimal control problems with any possible terminal state constraints, under some appropriate assumptions. Roughly speaking, the integral-turnpike property means that the time average of the distance from any optimal trajectory to the turnpike set con- verges to zero, as the time horizon tends to infinity. Then, we establish the measure-turnpike property for strictly dissipative optimal control systems, with state and control constraints. The measure-turnpike property, which is slightly st…
Turnpike phenomena of nonlinear port-Hamiltonian descriptor systems under minimal energy supply are studied. Under assumptions on the smoothness of the system nonlinearities, it is shown that the optimal control problem is dissipative with respect to a manifold. Then, under controllability assumptions, it is shown that the optimal control problem exhibits a manifold turnpike property.
This paper presents analyses for the maximum hands-off control using the geometric methods developed for the theory of turnpike in optimal control. First, a sufficient condition is proved for the existence of the maximum hands-off control for linear time-invariant systems with arbitrarily fixed initial and terminal points using the relation with $L^1$ optimal control. Next, a sufficient condition is derived for the maximum hands-off control to have the turnpike property, which may be useful for approximate design of the control.
Polynomial Turnpike Property for a Class of Infinite-Dimensional Oscillating Systems
Max Planck Institute for Dynamics of Complex Technical Systems（马克斯·普朗克复杂技术系统动力学研究所）；Institute of Applied Mathematics and Mechanics, National Academy of Sciences of Ukraine（乌克兰国家科学院应用数学与力学研究所）；Sorbonne Université（索邦大学）；Université Paris Cité（巴黎西岱大学）；CNRS（法国国家科学研究中心）；Inria（法国国家数字科学研究所）；Laboratoire Jacques-Louis Lions, LJLL（雅克-路易·利翁斯实验室）
In this work, we study the steady-state (or periodic) exponential turnpike property of optimal control problems in Hilbert spaces. The turnpike property, which is essentially due to the hyperbolic feature of the Hamiltonian system resulting from the Pontryagin maximum principle, reflects the fact that, in large time, the optimal state, control and adjoint vector remain most of the time close to an optimal steady-state. A similar statement holds true as well when replacing an optimal steady-state by an optimal periodic trajectory. To establish the result, we design an appropriate dichotomy tran…
In this paper the turnpike property is established for a non-convex optimal control problem in discrete time. The functional is defined by the notion of the ideal convergence and can be considered as an analogue of the terminal functional defined over infinite time horizon. The turnpike property states that every optimal solution converges to some unique optimal stationary point in the sense of ideal convergence if the ideal is invariant under translations. This kind of convergence generalizes, for example, statistical convergence and convergence with respect to logarithmic density zero sets.
Optimal control problems with a very large time horizon can be tackled with the Receding Horizon Control (RHC) method, which consists in solving a sequence of optimal control problems with small prediction horizon. The main result of this article is the proof of the exponential convergence (with respect to the prediction horizon) of the control generated by the RHC method towards the exact solution of the problem. The result is established for a class of infinite-dimensional linear-quadratic optimal control problems with time-independent dynamics and integral cost. Such problems satisfy the tu…
In this work we derive an interval turnpike result for adjoints of finite- and infinite-dimensional nonlinear optimal control problems under the assumption of an interval turnpike on states and controls. We consider stabilizable dynamics governed by a generator of a semigroup with finite-dimensional unstable part satisfying a spectral decomposition condition and show the desired turnpike property under continuity assumptions on the first-order optimality conditions. We further give stronger estimates for analytic semigroups and provide a numerical example with a boundary controlled semilinear …
Exponential Turnpike Theorems for Nonlinear Deterministic Meanfield Optimal Control Problems
Université Paris-Saclay, CNRS, CentraleSupélec（巴黎萨克雷大学）；Università degli Studi di Padova（帕多瓦大学）；Sorbonne Université, Université Paris Cité, CNRS, Inria, Laboratoire Jacques-Louis Lions（索邦大学，巴黎西岱大学）
Recent results in the literature have provided connections between the so-called turnpike property, near optimality of closed-loop solutions, and strict dissipativity. Motivated by applications in economics, optimal control problems with discounted stage cost are of great interest. In contrast to non-discounted optimal control problems, it is more likely that several asymptotically stable optimal equilibria coexist. Due to the discounting and transition cost from a local to the global equilibrium, it may be more favourable staying in a local equilibrium than moving to the global - cheaper - eq…
We analyze the consequences that the so-called turnpike property has on the long-time behavior of the value function corresponding to a finite-dimensional linear-quadratic optimal control problem with general terminal cost and constrained controls. We prove that, when the time horizon $T$ tends to infinity, the value function asymptotically behaves as $W(x) + c\, T + λ$, and we provide a control interpretation of each of these three terms, making clear the link with the turnpike property. As a by-product, we obtain the long-time behavior of the solution to the associated Hamilton-Jacobi-Bellma…
We investigate the long time behavior of weakly dissipative semilinear Hamilton-Jacobi-Bellman (HJB) equations and the turnpike property for the corresponding stochastic control problems. To this aim, we develop a probabilistic approach based on a variant of coupling by reflection adapted to the study of controlled diffusion processes. We prove existence and uniqueness of solutions for the ergodic Hamilton-Jacobi-Bellman equation and different kind of quantitative exponential convergence results at the level of the value function, of the optimal controls and of the optimal processes. Moreover,…
This paper is devoted to analysing the explicit slow decay rate and turnpike in the infinite-horizon linear quadratic optimal control problems for hyperbolic systems. Assume that some weak observability or controllability are satisfied, by which, the lower and upper bounds of the corresponding algebraic Riccati operator are estimated, respectively. Then based on these two bounds, the explicit slow decay rate of the closed-loop system with Riccati-based optimal feedback control is obtained. The averaged turnpike property for this problem is also further discussed. We then apply these results to…
This note discusses properties of parametric discrete-time Mixed-Integer Optimal Control Problems (MIOCPs) as they often arise in mixed-integer NMPC. We argue that in want for a handle on similarity properties of parametric MIOCPs the classical turnpike notion from optimal control is helpful. We provide sufficient turnpike conditions based on a dissipativity notion of MIOCPs, and we show that the turnpike property allows specific and accurate guesses for the integer-valued controls. Moreover, we show how the turnpike property can be used to derive efficient node-weighted branch-and-bound schem…
We introduce and study the turnpike property for time-varying shapes, within the viewpoint of optimal control. We focus here on second-order linear parabolic equations where the shape acts as a source term and we seek the optimal time-varying shape that minimizes a quadratic criterion. We first establish existence of optimal solutions under some appropriate sufficient conditions. We then provide necessary conditions for optimality in terms of adjoint equations and, using the concept of strict dissipativity, we prove that state and adjoint satisfy the measure-turnpike property, meaning that the…
We analyze the sensitivity of the extremal equations that arise from the first order necessary optimality conditions of nonlinear optimal control problems with respect to perturbations of the dynamics and of the initial data. To this end, we present an abstract implicit function approach with scaled spaces. We will apply this abstract approach to problems governed by semilinear PDEs. In that context, we prove an exponential turnpike result and show that perturbations of the extremal equation's dynamics, e.g., discretization errors decay exponentially in time. The latter can be used for very ef…
This work is concerned with two optimisation problems that we tackle from a qualitative perspective. The first one deals with quantitative inequalities for spectral optimisation problems for Schrödinger operators in general domains, the second one deals with the turnpike property for optimal bilinear control problems. In the first part of this article, we prove, under mild technical assumptions, quantitative inequalities for the optimisation of the first eigenvalue of $-Δ-V$ with Dirichlet boundary conditions with respect to the potential $V$, under $L^\infty$ and $L^1$ constraints. This is do…
We consider a vibrating string that is fixed at one end with Neumann control action at the other end. We investigate the optimal control problem of steering this system from given initial data to rest, in time T , by minimizing an objective functional that is the convex sum of the L 2-norm of the control and of a boundary Neumann tracking term. We provide an explicit solution of this optimal control problem, showing that if the weight of the tracking term is positive, then the optimal control action is concentrated at the beginning and at the end of the time interval, and in-between it decays …
We present a new proof of the turnpike property for nonlinear optimal control problems, when the running target is a steady control-state pair of the underlying system. Our strategy combines the construction of quasi-turnpike controls via controllability, and a bootstrap argument, and does not rely on analyzing the optimality system or linearization techniques. This in turn allows us to address several optimal control problems for finite-dimensional, control-affine systems with globally Lipschitz (possibly nonsmooth) nonlinearities, without any smallness conditions on the initial data or the r…
The turnpike property refers to the phenomenon that in many optimal control problems, the solutions for different initial conditions and varying horizons approach a neighborhood of a specific steady state, then stay in this neighborhood for the major part of the time horizon, until they may finally depart. While early observations of the phenomenon can be traced back to works of Ramsey and von Neumann on problems in economics in 1928 and 1938, the turnpike property received continuous interest in economics since the 1960s and recent interest in systems and control. The present chapter provides…
We consider the singular optimal control problem of minimizing the energy supply of linear dissipative port-Hamiltonian descriptor systems subject to control and terminal state constraints. To this end, after reducing the problem to an ODE with feed-through term, we derive an input-state turnpike towards a subspace for optimal control of generalized port-Hamiltonian ordinary differential equations. We study the reachability properties of the system and prove that optimal states exhibit a turnpike behavior with respect to the conservative subspace. By means of the port-Hamiltonian structure, we…
The \emph{turnpike property} in contemporary macroeconomics asserts that if an economic planner seeks to move an economy from one level of capital to another, then the most efficient path, as long as the planner has enough time, is to rapidly move stock to a level close to the optimal stationary or constant path, then allow for capital to develop along that path until the desired term is nearly reached, at which point the stock ought to be moved to the final target. Motivated in part by its nature as a resource allocation strategy, over the past decade, the turnpike property has also been show…
