An exponential turnpike property for a semilinear control problem is proved. The state-target is assumed to be small, whereas the initial datum can be arbitrary.
Turnpike results are also obtained for large targets, requiring that the control acts everywhere. In this case, we prove the convergence of the infimum of the averaged time-evolution functional towards the steady one.
Numerical simulations are performed.
We analyze the sensitivity of the extremal equations that arise from the first order necessary optimality conditions of nonlinear optimal control problems with respect to perturbations of the dynamics and of the initial data. To this end, we present an abstract implicit function approach with scaled spaces. We will apply this abstract approach to problems governed by semilinear PDEs. In that context, we prove an exponential turnpike result and show that perturbations of the extremal equation's dynamics, e.g., discretization errors decay exponentially in time. The latter can be used for very ef…
This paper presents, using dynamical system theory, a framework for investigating the turnpike property in nonlinear optimal control. First, it is shown that a turnpike-like property appears in general dynamical systems with hyperbolic equilibrium and then, apply it to optimal control problems to obtain sufficient conditions for the turnpike occurs. The approach taken is geometric and gives insights for the behaviors of controlled trajectories, allowing us to find simpler proofs for existing results on the turnpike properties. Attempts to remove smallness restrictions for initial and target st…
This paper presents analyses for the maximum hands-off control using the geometric methods developed for the theory of turnpike in optimal control. First, a sufficient condition is proved for the existence of the maximum hands-off control for linear time-invariant systems with arbitrarily fixed initial and terminal points using the relation with $L^1$ optimal control. Next, a sufficient condition is derived for the maximum hands-off control to have the turnpike property, which may be useful for approximate design of the control.
Polynomial Turnpike Property for a Class of Infinite-Dimensional Oscillating Systems
Max Planck Institute for Dynamics of Complex Technical Systems（马克斯·普朗克复杂技术系统动力学研究所）；Institute of Applied Mathematics and Mechanics, National Academy of Sciences of Ukraine（乌克兰国家科学院应用数学与力学研究所）；Sorbonne Université（索邦大学）；Université Paris Cité（巴黎西岱大学）；CNRS（法国国家科学研究中心）；Inria（法国国家数字科学研究所）；Laboratoire Jacques-Louis Lions, LJLL（雅克-路易·利翁斯实验室）
In this work we derive an interval turnpike result for adjoints of finite- and infinite-dimensional nonlinear optimal control problems under the assumption of an interval turnpike on states and controls. We consider stabilizable dynamics governed by a generator of a semigroup with finite-dimensional unstable part satisfying a spectral decomposition condition and show the desired turnpike property under continuity assumptions on the first-order optimality conditions. We further give stronger estimates for analytic semigroups and provide a numerical example with a boundary controlled semilinear …
In this paper the turnpike property is established for a non-convex optimal control problem in discrete time. The functional is defined by the notion of the ideal convergence and can be considered as an analogue of the terminal functional defined over infinite time horizon. The turnpike property states that every optimal solution converges to some unique optimal stationary point in the sense of ideal convergence if the ideal is invariant under translations. This kind of convergence generalizes, for example, statistical convergence and convergence with respect to logarithmic density zero sets.
Optimal control problems with a very large time horizon can be tackled with the Receding Horizon Control (RHC) method, which consists in solving a sequence of optimal control problems with small prediction horizon. The main result of this article is the proof of the exponential convergence (with respect to the prediction horizon) of the control generated by the RHC method towards the exact solution of the problem. The result is established for a class of infinite-dimensional linear-quadratic optimal control problems with time-independent dynamics and integral cost. Such problems satisfy the tu…
Turnpike phenomena of nonlinear port-Hamiltonian descriptor systems under minimal energy supply are studied. Under assumptions on the smoothness of the system nonlinearities, it is shown that the optimal control problem is dissipative with respect to a manifold. Then, under controllability assumptions, it is shown that the optimal control problem exhibits a manifold turnpike property.
Recent results in the literature have provided connections between the so-called turnpike property, near optimality of closed-loop solutions, and strict dissipativity. Motivated by applications in economics, optimal control problems with discounted stage cost are of great interest. In contrast to non-discounted optimal control problems, it is more likely that several asymptotically stable optimal equilibria coexist. Due to the discounting and transition cost from a local to the global equilibrium, it may be more favourable staying in a local equilibrium than moving to the global - cheaper - eq…
We investigate the long time behavior of weakly dissipative semilinear Hamilton-Jacobi-Bellman (HJB) equations and the turnpike property for the corresponding stochastic control problems. To this aim, we develop a probabilistic approach based on a variant of coupling by reflection adapted to the study of controlled diffusion processes. We prove existence and uniqueness of solutions for the ergodic Hamilton-Jacobi-Bellman equation and different kind of quantitative exponential convergence results at the level of the value function, of the optimal controls and of the optimal processes. Moreover,…
A counterexample to uniqueness of global minimizers of semilinear optimal control problems is given. The lack of uniqueness occurs for a special choice of the state-target in the cost functional. Our arguments show also that, for some state-targets, there exist local minimizers, which are not global. When this occurs, gradient-type algorithms may be trapped by the local minimizers, thus missing the global ones. Furthermore, the issue of convexity of quadratic functional in optimal control is analyzed in an abstract setting. As a Corollary of the nonuniqueness of the minimizers, a nonuniqueness…
We analyze the consequences that the so-called turnpike property has on the long-time behavior of the value function corresponding to a finite-dimensional linear-quadratic optimal control problem with general terminal cost and constrained controls. We prove that, when the time horizon $T$ tends to infinity, the value function asymptotically behaves as $W(x) + c\, T + λ$, and we provide a control interpretation of each of these three terms, making clear the link with the turnpike property. As a by-product, we obtain the long-time behavior of the solution to the associated Hamilton-Jacobi-Bellma…
This paper is devoted to analysing the explicit slow decay rate and turnpike in the infinite-horizon linear quadratic optimal control problems for hyperbolic systems. Assume that some weak observability or controllability are satisfied, by which, the lower and upper bounds of the corresponding algebraic Riccati operator are estimated, respectively. Then based on these two bounds, the explicit slow decay rate of the closed-loop system with Riccati-based optimal feedback control is obtained. The averaged turnpike property for this problem is also further discussed. We then apply these results to…
We present a new proof of the turnpike property for nonlinear optimal control problems, when the running target is a steady control-state pair of the underlying system. Our strategy combines the construction of quasi-turnpike controls via controllability, and a bootstrap argument, and does not rely on analyzing the optimality system or linearization techniques. This in turn allows us to address several optimal control problems for finite-dimensional, control-affine systems with globally Lipschitz (possibly nonsmooth) nonlinearities, without any smallness conditions on the initial data or the r…
This note discusses properties of parametric discrete-time Mixed-Integer Optimal Control Problems (MIOCPs) as they often arise in mixed-integer NMPC. We argue that in want for a handle on similarity properties of parametric MIOCPs the classical turnpike notion from optimal control is helpful. We provide sufficient turnpike conditions based on a dissipativity notion of MIOCPs, and we show that the turnpike property allows specific and accurate guesses for the integer-valued controls. Moreover, we show how the turnpike property can be used to derive efficient node-weighted branch-and-bound schem…
We introduce and study the turnpike property for time-varying shapes, within the viewpoint of optimal control. We focus here on second-order linear parabolic equations where the shape acts as a source term and we seek the optimal time-varying shape that minimizes a quadratic criterion. We first establish existence of optimal solutions under some appropriate sufficient conditions. We then provide necessary conditions for optimality in terms of adjoint equations and, using the concept of strict dissipativity, we prove that state and adjoint satisfy the measure-turnpike property, meaning that the…
This work is concerned with two optimisation problems that we tackle from a qualitative perspective. The first one deals with quantitative inequalities for spectral optimisation problems for Schrödinger operators in general domains, the second one deals with the turnpike property for optimal bilinear control problems. In the first part of this article, we prove, under mild technical assumptions, quantitative inequalities for the optimisation of the first eigenvalue of $-Δ-V$ with Dirichlet boundary conditions with respect to the potential $V$, under $L^\infty$ and $L^1$ constraints. This is do…
The turnpike property refers to the phenomenon that in many optimal control problems, the solutions for different initial conditions and varying horizons approach a neighborhood of a specific steady state, then stay in this neighborhood for the major part of the time horizon, until they may finally depart. While early observations of the phenomenon can be traced back to works of Ramsey and von Neumann on problems in economics in 1928 and 1938, the turnpike property received continuous interest in economics since the 1960s and recent interest in systems and control. The present chapter provides…
We consider the singular optimal control problem of minimizing the energy supply of linear dissipative port-Hamiltonian descriptor systems subject to control and terminal state constraints. To this end, after reducing the problem to an ODE with feed-through term, we derive an input-state turnpike towards a subspace for optimal control of generalized port-Hamiltonian ordinary differential equations. We study the reachability properties of the system and prove that optimal states exhibit a turnpike behavior with respect to the conservative subspace. By means of the port-Hamiltonian structure, we…
The \emph{turnpike property} in contemporary macroeconomics asserts that if an economic planner seeks to move an economy from one level of capital to another, then the most efficient path, as long as the planner has enough time, is to rapidly move stock to a level close to the optimal stationary or constant path, then allow for capital to develop along that path until the desired term is nearly reached, at which point the stock ought to be moved to the final target. Motivated in part by its nature as a resource allocation strategy, over the past decade, the turnpike property has also been show…
