This paper characterizes the solution to a finite horizon min-max optimal control problem where the system is linear and discrete-time with control and state constraints, and the cost quadratic; the disturbance is negatively costed, as in the standard H-infinity problem, and is constrained. The cost is minimized over control policies and maximized over disturbance sequences so that the solution yields a feedback control. It is shown that the value function is piecewise quadratic and the optimal control policy piecewise affine, being quadratic and affine, respectively, in polytopes that partition the domain of the value function.
This note considers the constrained H-infinity consensus of multi-agent networks with nonidentical constraint sets. An improved distributed algorithm is adopted and a nonlinear controlled output function is defined to evaluate the effect of disturbances. Then, it is shown that the constrained H-infinity consensus can be achieved if some linear matrix inequality has positive solution.
H-infinity optimal control and estimation are addressed for a class of systems governed by partial differential equations with bounded input and output operators. Diffusion equations are an important example in this class. Explicit formulas for the optimal state feedback controller as well as the optimal state estimator are given. Unlike traditional methods for H-infinity synthesis, no iteration is needed to obtain the optimal solution. Moreover, the optimal performance for both the state feedback and state estimation problems are explicitly calculated. This is shown to be useful for problems …
We construct structured H-Infinity optimal model matching problems with rational coefficients, in which the optimal solution is not rational, in the sense that the cost does not achieve its maximal lower bound on the set of rational matching models, but the same maximal lower bound can be reached by using a continuous non-rational matching model.
A multi-variable PI (proportional integrating) controller is proved to be optimal for an important class of control problems where performance is specified in terms of frequency weighted H-infinity norms. The problem class includes networked systems with a subsystem in each node and control action along each edge. For such systems, the optimal PI controller is decentralized in the sense that control action along a given network edge is entirely determined by states at nodes connected by that edge.
We address a class of systems for which the solution to an H-infinity optimal control problem can be given on a very simple closed form. In fact, both the control law and optimal performance value are explicitly given. The class of systems include models for large-scale systems such as temperature dynamics in buildings, buffer networks and transportations systems. Furthermore, the structure of the control law is suitable for distributed control of such large-scale systems, which is illustrated through examples.
In this paper we study necessary optimality conditions for the optimization problem $$\textrm{infimum}f_0(x) \quad \textrm{ subject to } \quad x \in S,$$ where $f_0 \colon \mathbb{R}^n \rightarrow \mathbb{R}$ is a polynomial function and $S \subset \mathbb{R}^n$ is a set defined by polynomial inequalities. Assume that the problem is bounded below and has the Mangasarian--Fromovitz property at infinity. We first show that if the problem does {\em not} have an optimal solution, then a version at infinity of the Fritz-John optimality conditions holds. From this we derive a version at infinity of …
We address H-infinity structured static state feedback and give a simple form for an optimal control law applicable to linear time invariant systems with symmetric and Hurwitz state matrix. More specifically, the control law as well as the minimal value of the norm can be expressed in the matrices of the system's state space representation, given separate cost on state and control input. Thus, the control law is transparent, easy to synthesize and scalable. Furthermore, if the plant possess a compatible sparsity pattern it is also distributed. Examples of such sparsity patterns are included. F…
The Monge-Kantorovich problem for the infinite Wasserstein distance presents several peculiarities. Among them the lack of convexity and then of a direct duality. We study in dimension 1 the dual problem introduced by Barron, Bocea and Jensen. We construct a couple of Kantorovich potentials which is "as less trivial as possible". More precisely, we build a potential which is non constant around any point that the plan which is locally optimal moves at maximal distance. As an application, we show that the set of points which are displaced to maximal distance by a locally optimal transport plan …
We present a suboptimal control design algorithm for a family of continuous-time parameter-dependent linear systems that are composed of interconnected subsystems. We are interested in designing the controller for each subsystem such that it only utilizes partial state measurements (characterized by a directed graph called the control graph) and limited model parameter information (characterized by the design graph). The algorithm is based on successive local minimizations and maximizations (using the subgradients) of the $H_\infty$--norm of the closed-loop transfer function with respect to th…
A general problem in optimal control consists of finding a terminal reward that makes the value function independent of the horizon. Such a terminal reward can be interpreted as a max-plus eigenvector of the associated Lax-Oleinik semigroup. We give a representation formula for all these eigenvectors, which applies to optimal control problems in which the state space is non compact. This representation involves an abstract boundary of the state space, which extends the boundary of metric spaces defined in terms of Busemann functions (the horoboundary). Extremal generators of the eigenspace cor…
We propose dynamical optimal transport (OT) problems constrained in a parameterized probability subset. In application problems such as deep learning, the probability distribution is often generated by a parameterized mapping function. In this case, we derive a simple formulation for the constrained dynamical OT.
We develop a novel frequency-based H-infinity control method for a large class of infinite-dimensional Linear-Time-Invariant systems in transfer function form. Major benefits of our approach is that reduction or identification techniques are not needed thereby avoiding possible distortions. It can exploit either transfer function models or input/output frequency response data when available. It computes simple practical controllers of any size and structure. We use a non-smooth trust-region method to compute arbitrarily structured locally optimal H-infinity controllers for a frequency sampled …
In this study, we propose a varying terminal time structure for the optimal control problem under state constraints, in which the terminal time follows the varying of the control via the constrained condition. Focusing on this new optimal control problem, we investigate a novel stochastic maximum principle, which differs from the traditional optimal control problem under state constraints. The optimal pair of the optimal control model can be verified via this new stochastic maximum principle.
This paper concerns a class of infinite horizon optimal control problems with state constraints. By extending the needle variation method to the infinite horizon case we obtain a complete set of necessary optimality conditions for a strong local minimizer in form of the Pontryagin maximum principle and the validity of several transversality conditions at infinity. To this purpose, we develop an approach in the space of continuous functions converging at infinity. The considerations including new results on optimality and transversality conditions, on Banach spaces of continuous functions, on t…
In this paper, we consider optimal control of stochastic differential equations subject to an expected path constraint. The stochastic maximum principle is given for a general optimal stochastic control in terms of constrained FBSDEs. In particular, the compensated process in our adjoint equation is deterministic, which seems to be new in the literature. For the typical case of linear stochastic systems and quadratic cost functionals (i.e., the so-called LQ optimal stochastic control), a verification theorem is established, and the existence and uniqueness of the constrained reflected FBSDEs a…
A method is developed to numerically solve chance constrained optimal control problems. The chance constraints are reformulated as nonlinear constraints that retain the probability properties of the original constraint. The reformulation transforms the chance constrained optimal control problem into a deterministic optimal control problem that can be solved numerically. The new method developed in this paper approximates the chance constraints using Markov Chain Monte Carlo (MCMC) sampling and kernel density estimators whose kernels have integral functions that bound the indicator function. Th…
This paper deals with optimal control problems of integral equations, with initial-final and running state constraints. The order of a running state constraint is defined in the setting of integral dynamics, and we work here with constraints of arbitrary high orders. First and second-order necessary conditions of optimality are obtained, as well as second-order sufficient conditions.
In this paper we study second-order optimality conditions for non-convex set-constrained optimization problems. For a convex set-constrained optimization problem, it is well-known that second-order optimality conditions involve the support function of the second-order tangent set. In this paper we propose two approaches for establishing second-order optimality conditions for the non-convex case. In the first approach we extend the concept of the support function so that it is applicable to general non-convex set-constrained problems, whereas in the second approach we introduce the notion of th…
In an infinite-horizon optimal control problem the stability of the adjoint variable implying the vanishing of the adjoint variable at infinity along optimal solution.
This paper studies a multi-agent system starting from a single agent dynamics which is a nonlinear affine control system. It analyze what happens when the number of agents goes to infinity using two different approaches, a granular mean-field one, trying to control only a finite number of agents while all the others goes to infinity, and a kinetic one, when in the limit the percentage of controlled agents is preserved. In both cases the optimal control problem starting from the solution for the finite dimensional one is stated.
Minimax optimization problems arises from both modern machine learning including generative adversarial networks, adversarial training and multi-agent reinforcement learning, as well as from tradition research areas such as saddle point problems, numerical partial differential equations and optimality conditions of equality constrained optimization. For the unconstrained continuous nonconvex-nonconcave situation, Jin, Netrapalli and Jordan (2019) carefully considered the very basic question: what is a proper definition of local optima of a minimax optimization problem, and proposed a proper de…
Optimality conditions in the form of a variational inequality are proved for a class of constrained optimal control problems of stochastic differential equations. The cost function and the inequality constraints are functions of the probability distribution of the state variable at the final time. The analysis uses in an essential manner a convexity property of the set of reachable probability distributions. An augmented Lagrangian method based on the obtained optimality conditions is proposed and analyzed for solving iteratively the problem. At each iteration of the method, a standard stochas…
This paper shows that the OSGA algorithm -- which uses first-order information to solve convex optimization problems with optimal complexity -- can be used to efficiently solve arbitrary bound-constrained convex optimization problems. This is done by constructing an explicit method as well as an inexact scheme for solving the bound-constrained rational subproblem required by OSGA. This leads to an efficient implementation of OSGA on large-scale problems in applications arising signal and image processing, machine learning and statistics. Numerical experiments demonstrate the promising performa…
The constrained $\ell_0$ regularization plays an important role in sparse reconstruction. A widely used approach for solving this problem is the penalty method, of which the least square penalty problem is a special case. However, the connections between global minimizers of the constrained $\ell_0$ problem and its penalty problem have never been studied in a systematic way. This work provides a comprehensive investigation on optimal solutions of these two problems and their connections. We give detailed descriptions of optimal solutions of the two problems, including existence, stability with…
This paper provides necessary and sufficient optimality conditions for abstract constrained mathematical programming problems in locally convex spaces under new qualification conditions. Our approach exploits the geometrical properties of certain mappings, in particular their structure as difference of convex functions, and uses techniques of generalized differentiation (subdifferential and coderivative). It turns out that these tools can be used fruitfully out of the scope of Asplund spaces. Applications to infinite, stochastic and semi-definite programming are developed in separate sections.
We consider nonlinear optimization problems with cardinality constraints. Based on a continuous reformulation we introduce second order necessary and sufficient optimality conditions. Under such a second order condition, we can guarantee local uniqueness of M-stationary points. Finally, we use this observation to provide extended local convergence theory for a Scholtes-type relaxation method for cardinality constrained optimization problems, which guarantees the existence and convergence of the iterates under suitable assumptions.
We consider Tikhonov regularization of control-constrained optimal control problems. We present new a-priori estimates for the regularization error assuming measure and source-measure conditions. In the special case of bang-bang solutions, we introduce another assumption to obtain the same convergence rates. This new condition turns out to be useful in the derivation of error estimates for the discretized problem. The necessity of the just mentioned assumptions to obtain certain convergence rates is analyzed. Finally, a numerical example confirms the analytical findings.
In this letter, we apply optimal control theory to design minimum-energy $π/2$ and $π$ pulses for the Bloch system in the presence of relaxation with constrained control amplitude. We consider a commonly encountered case in which the transverse relaxation rate is much larger than the longitudinal one so that the latter can be neglected. Using the Pontryagin's Maximum Principle, we derive optimal feedback laws which are characterized by the number of switches, depending on the control bound and the coordinates of the desired final state.
In this paper, we introduce a kind of approximate Karush--Kuhn--Tucker condition (AKKT) for a smooth cone-constrained vector optimization problem. We show that, without any constraint qualification, the AKKT condition is a necessary for a local weak efficient solution of the considered problem. For convex problems, we prove that the AKKT condition is a necessary and sufficient optimality condition for a global weak efficient solution. We also introduce some strict constraint qualifications associated with the AKKT condition.
In this paper, we prove a Pontryagin Maximum Principle for constrained optimal control problems in the Wasserstein space of probability measures. The dynamics, is described by a transport equation with non-local velocities and is subject to end-point and running state constraints. Building on our previous work, we combine the classical method of needle-variations from geometric control theory and the metric differential structure of the Wasserstein spaces to obtain a maximum principle stated in the so-called Gamkrelidze form.
A warm start method is developed for efficiently solving complex chance constrained optimal control problems. The warm start method addresses the computational challenges of solving chance constrained optimal control problems using biased kernel density estimators and Legendre-Gauss-Radau collocation with an $hp$ adaptive mesh refinement method. To address the computational challenges, the warm start method improves both the starting point for the chance constrained optimal control problem, as well as the efficiency of cycling through mesh refinement iterations. The improvement is accomplished…
We study the equivalence of several well-known sufficient optimality conditions for a general quadratically constrained quadratic program (QCQP). The conditions are classified in two categories. The first one is for determining an optimal solution and the second one is for finding an optimal value. The first category of conditions includes the existence of a saddle point of the Lagrangian function and the existence of a rank-1 optimal solution of the primal SDP relaxation of QCQP. The second category includes $η_p = ζ$, $η_d = ζ$, and $φ= ζ$, where $ζ$, $η_p$, $η_d$, and $φ$ denote the optimal…
This paper studies symmetric constrained linear-quadratic optimal control problems and their parametric solutions. The parametric solution of such a problem is a piecewise-affine feedback law that can be equivalently expressed as a set of active sets. We show symmetries of the optimal control problem entail symmetries of the active sets, which can be used to simplify finding the set of active sets considerably. Specifically, we improve a recently proposed method for the dynamic-programming-based enumeration of all active sets. The achieved reduction of the computational effort is illustrated w…
We study a cardinality-constrained optimization problem with nonnegative variables in this paper. This problem is often encountered in practice. Firstly we study some properties on the optimal solutions of this optimization problem under some conditions. An equivalent reformulation of the problem under consideration is proposed. Based on the reformulation, we present a successive convex approximation method for the cardinality constrained optimization problem. We prove that the method converges to a KKT point of the reformulation problem. Under some conditions, the KKT points of the reformulat…
We obtain a generalization of Noether's invariance principle for optimal control problems with equality and inequality state-input constraints. The result relates the invariance properties of the problems with the existence of conserved quantities along the constrained Pontryagin extremals. A result of this kind was posed as an open question by Vladimir Tikhomirov, in 1986.
In this paper, we consider a class of optimal control problems for a one-dimensional time-discrete constrained quasilinear diffusion state-systems of singular Allen--Cahn types and its regularized approximating problems. We note that the control parameter for each system is given by physical temperature. The principal part of this paper is started with the verification of a Key-Theorem dealing with the decompositions of the subdifferentials of the governing convex energies of the state-systems. On this basis, we will prove five Main Theorems, concerned with: the solvability and precise regular…
The solution of a constrained linear-quadratic regulator problem is determined by the set of its optimal active sets. We propose an algorithm that constructs this set of active sets for a desired horizon N from that for horizon N-1. While it is not obvious how to extend the optimal feedback law itself for horizon N-1 to horizon N, a simple relation between the optimal active sets for two successive horizon lengths exists. Specifically, every optimal active set for horizon N is a superset of an optimal active set for horizon N-1 if the constraints are ordered stage by stage. The stagewise treat…
Lagrangian particle formulations of the large deformation diffeomorphic metric mapping algorithm (LDDMM) only allow for the study of a single shape. In this paper, we introduce and discuss both a theoretical and practical setting for the simultaneous study of multiple shapes that are either stitched to one another or slide along a submanifold. The method is described within the optimal control formalism, and optimality conditions are given, together with the equations that are needed to implement augmented Lagrangian methods. Experimental results are provided for stitched and sliding surfaces.
Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In this paper, we devise an algorithm for the computation of an optimal control of constrained nonlinear switched dynamical systems. The control parameter for such systems include a continuous-valued input and discrete-valued input, where the latter corresponds to the mode of the switched system that is active at a particular instance in time. Our approach, which…
In recent years, there has been a huge trend to penetrate renewable energy sources into energy networks. However, these sources introduce uncertain power generation depending on environmental conditions. Therefore, finding 'optimal' and 'feasible' operation strategies is still a big challenge for network operators and thus, an appropriate optimization approach is of utmost importance. In this paper, we formulate the optimal power flow (OPF) with uncertainties as a chance constrained optimization problem. Since uncertainties in the network are usually 'non-Gaussian' distributed random variables…
Time-consistency is an essential requirement in risk sensitive optimal control problems to make rational decisions. An optimization problem is time consistent if its solution policy does not depend on the time sequence of solving the optimization problem. On the other hand, a dynamic risk measure is time consistent if a certain outcome is considered less risky in the future implies this outcome is also less risky at current stage. In this paper, we study time-consistency of risk constrained problem where the risk metric is time consistent. From the Bellman optimality condition in [1], we estab…
A decomposition algorithm for solving large-scale security-constrained AC optimal power flow problems is presented. The formulation considered is the one used in the ARPA-E Grid Optimization (GO) Competition, Challenge 1, held from November 2018 through October 2019. The techniques found to be most effective in terms of performance in the challenge are presented, including strategies for contingency selection, fast contingency evaluation, handling complementarity constraints, avoiding issues related to degeneracy, and exploiting parallelism. The results of numerical experiments are provided to…
We analyze an optimal control problem governed by a rate-independent system in an abstract infinite-dimensional setting. The rate-independent system is characterized by a nonconvex stored energy functional, which depends on time via a time-dependent external loading, and by a convex dissipation potential, which is assumed to be bounded and positively homogeneous of degree one. The optimal control problem uses the external load as control variable and is constrained to normalized parametrized balanced viscosity solutions (BV solutions) of the rate-independent system. Solutions of this type appe…
Vehicle platooning using connected and automated vehicles (CAVs) has attracted considerable attention. In this paper, we address the problem of optimal coordination of CAV platoons at a highway on-ramp merging. We present a single-level constrained optimal control framework that optimizes fuel economy and travel time of the platoons while satisfying the state, control, and safety constraints. We also explore the effect of delayed communication among the CAV platoons and propose a robust coordination framework to enforce lateral and rear-end collision avoidance constraints in the presence of bo…
We address the optimal covariance steering (OCS) problem for stochastic discrete linear systems with additive Gaussian noise under state chance constraints and input hard constraints. Because the system state can be unbounded due to the unbounded noise, the state constraints are formulated as probabilistic (chance) constraints, i.e., the maximum probability of constraint violation is constrained. In contrast, because it is hard to interpret the appropriate control action when the control command violates the constraints, probabilistically formulating the control constraints are difficult, and …
In this paper we apply an augmented Lagrange method to a class of semilinear elliptic optimal control problems with pointwise state constraints. We show strong convergence of subsequences of the primal variables to a local solution of the original problem as well as weak convergence of the adjoint states and weak* convergence of the multipliers associated to the state constraint. Moreover, we show existence of stationary points in arbitrary small neighborhoods of local solutions of the original problem. Additionally, various numerical results are presented.
In this paper we present a stochastic scenario-based model predictive control (MPC) approach for the operation of islanded microgrids with high share of renewable energy sources. We require that the stored energy remains within given bounds with a certain probability using risk-based constraints as convex approximations of chance constraints. We show that risk constraints can generally be cast as conic constraints and, unlike chance constraints, can control both the number and average magnitude of constraint violations. Lastly, we demonstrate the risk-constrained stochastic MPC in a numerical …
