We consider the class of nonlinear optimal control problems (OCP) with polynomial data, i.e., the differential equation, state and control con- straints and cost are all described by polynomials, and more generally for OCPs with smooth data. In addition, state constraints as well as state and/or action constraints are allowed. We provide a simple hierarchy of LMI (lin- ear matrix inequality)-relaxations whose optimal values form a nondecreasing sequence of lower bounds on the optimal value. Under some convexity assump- tions, the sequence converges to the optimal value of the OCP. Preliminary results show that good approximations are obtained with few moments.
Obtaining initial conditions and parameterizations leading to a model consistent with available measurements or safety specifications is important for many applications. Examples include model (in-)validation, prediction, fault diagnosis, and controller design. We present an approach to determine inner- and outer-approximations of the set containing all consistent initial conditions/parameterizations for nonlinear continuous-time systems. These approximations are found by occupation measures that encode the system dynamics and measurements, and give rise to an infinite-dimensional linear progr…
We propose a new LMI approach to the design of optimal switching sequences for polynomial dynamical systems with state constraints. We formulate the switching design problem as an optimal control problem which is then relaxed to a linear programming (LP) problem in the space of occupation measures. This infinite-dimensional LP can be solved numerically and approximately with a hierarchy of convex finite-dimensional LMIs. In contrast with most of the existing work on LMI methods, we have a guarantee of global optimality, in the sense that we obtain an asympotically converging (i.e. with vanishi…
We consider nonlinear optimal control problems (OCPs) for which all problem data are polynomial. In the first part of the paper, we review how occupation measures can be used to approximate pointwise the optimal value function of a given OCP, using a hierarchy of linear matrix inequality (LMI) relaxations. In the second part, we extend the methodology to approximate the optimal value function on a given set and we use such a function to constructively and computationally derive an almost optimal control law. Numerical examples show the effectiveness of the approach.
This paper considers the class of deterministic continuous-time optimal control problems (OCPs) with piecewise-affine (PWA) vector field, polynomial Lagrangian and semialgebraic input and state constraints. The OCP is first relaxed as an infinite-dimensional linear program (LP) over a space of occupation measures. This LP, a particular instance of the generalized moment problem, is then approached by an asymptotically converging hierarchy of linear matrix inequality (LMI) relaxations. The relaxed dual of the original LP returns a polynomial approximation of the value function that solves the H…
Occupation measures and linear matrix inequality (LMI) relax-ations (called the moment sums of squares or Lasserre hierarchy) have been used previously as a means for solving control law verification and validation (VV) problems. However, these methods have been restricted to relatively simple control laws and a limited number of states. In this document, we extend these methods to model reference adaptive control (MRAC) configurations typical of the aircraft industry. The main contribution is a validation scheme that exploits the specific nonlinearities and structure of MRAC. A nonlinear F-16…
Occupation measures and linear matrix inequality (LMI) relax-ations (called the moment sums of squares or Lasserre hierarchy) are state-of-the-art methods for verification and validation (VV) in aerospace. In this document, we extend these results to a full F-16 closed-loop nonlinear dutch roll polynomial model complete with model reference adaptive control (MRAC). This is done through a new technique of approximating the reference trajectory by exploiting sparse ordinary differential equations (ODEs) with parsimony. The VV problem is then solved directly using moment LMI relaxations and off-t…
This paper shows how to find lower bounds on, and sometimes solve globally, a large class of nonlinear optimal control problems with impulsive controls using semi-definite programming (SDP). This is done by relaxing an optimal control problem into a measure differential problem. The manipulation of the measures by their moments reduces the problem to a convergent series of standard linear matrix inequality (LMI) relaxations. After providing numerous academic examples, we apply the method to the impulsive rendezvous of two orbiting spacecrafts. As the method provides lower bounds on the global …
This work addresses the occupation measure relaxation of calculus of variations problems, which is an infinite-dimensional linear programming relaxation amenable to numerical approximation by a hierarchy of semidefinite optimization problems. We address the problem of equivalence of this relaxation to the original problem. Our main result provides sufficient conditions for this equivalence. These conditions, revolving around the convexity of the data, are simple and apply in very general settings that may be of arbitrary dimensions and may include pointwise and integral constraints, thereby co…
We describe a new temporal verification framework for safety and robustness analysis of nonlinear control laws, our target application being a space launcher vehicle. Robustness analysis, formulated as a nonconvex nonlinear optimization problem on admissible trajectories corresponding to piecewise polynomial dynamics, is relaxed into a convex linear programming problem on measures. This infinite-dimensional problem is then formulated as a generalized moment problem, which allows for a numerical solution via a hierarchy of linear matrix inequality relaxations solved by semidefinite programming.…
This paper addresses the problem of solving a class of nonlinear optimal control problems (OCP) with infinite-dimensional linear state constraints involving Riesz-spectral operators. Each instance within this class has time/control dependent polynomial Lagrangian cost and control constraints described by polynomials. We first perform a state-mode discretization of the Riesz-spectral operator. Then, we approximate the resulting finite-dimensional OCPs by using a previously known hierarchy of semidefinite relaxations. Under certain compactness assumptions, we provide a converging hierarchy of se…
We characterize the maximum controlled invariant (MCI) set for discrete- as well as continuous-time nonlinear dynamical systems as the solution of an infinite-dimensional linear programming problem. For systems with polynomial dynamics and compact semialgebraic state and control constraints, we describe a hierarchy of finite-dimensional linear matrix inequality (LMI) relaxations whose optimal values converge to the volume of the MCI set; dual to these LMI relaxations are sum-of-squares (SOS) problems providing a converging sequence of outer approximations to the MCI set. The approach is simple…
The gap between a variational problem and its occupation measure relaxation
CNRS（法国国家科学研究中心；系统分析与实验室）；LAAS（布拉格捷克理工大学电气工程学院）；Faculty of Electrical Engineering, Czech Technical University in Prague（挪威北极大学数学与统计系）；Department of Mathematics and Statistics, UiT The Arctic University of Norway
Concentration of measure-valued solutions for semilinear parabolic equations
Fédération ENAC ISAE-SUPAERO ONERA, Université de Toulouse（法国图卢兹大学）；LAAS-CNRS, Université de Toulouse（法国图卢兹大学）；Czech Technical University in Prague（布拉格捷克理工大学）
Infinite-dimensional linear conic formulations are described for nonlinear optimal control problems. The primal linear problem consists of finding occupation measures supported on optimal relaxed controlled trajectories, whereas the dual linear problem consists of finding the largest lower bound on the value function of the optimal control problem. Various approximation results relating the original optimal control problem and its linear conic formulations are developed. As illustrated by a couple of simple examples, these results are relevant in the context of finite-dimensional semidefinite …
