This paper is concerned with uniform stabilization and social optimality for general mean field linear quadratic control systems, where subsystems are coupled via individual dynamics and costs, and the state weight is not assumed with the definiteness condition. For the finite-horizon problem, we first obtain a set of forward-backward stochastic differential equations (FBSDEs) from variational analysis, and construct a feedback-type control by decoupling the FBSDEs. For the infinite-horizon problem, by using solutions to two Riccati equations, we design a set of decentralized control laws, which is further proved to be asymptotically social optimal. Some equivalent conditions are given for uniform stabilization of the systems in different cases, respectively. Finally, the proposed decentralized controls are compared to the asymptotic optimal strategies in previous works.
The paper addresses the stabilization of nonlinear systems with semi-quadratic cost: quadratic with respect to controls and nonlinear for state variables. Paper presents the effective new feedback synthesis procedure. The novel feedback design procedure is based on the ideas borrowed from nonlinear optics and the theory of semi-classical asymptotics.
We propose a necessary and sufficient test to determine whether a solution for a general quadratic program with two quadratic constraints (QC2QP) can be computed from that of a specific convex semidefinite relaxation, in which case we say that there is no optimality gap. Originally intended to solve a nonconvex optimal control problem, we consider the case in which the cost and both constraints of the QC2QP may be nonconvex. We obtained our test, which also ascertains when strong duality holds, by generalizing a closely-related method by Ai and Zhang. An extension was necessary because, while …
One of the most important optimality conditions to aid to solve a vector optimization problem is the first-order necessary optimality condition that generalizes the Karush-Kuhn-Tucker condition. However, to obtain the sufficient optimality conditions, it is necessary to impose additional assumptions on the objective functions and in the constraint set. The present work is concerned with the constrained vector quadratic fractional optimization problem. It shows that sufficient Pareto optimality conditions and the main duality theorems can be established without the assumption of generalized con…
We study the equivalence of several well-known sufficient optimality conditions for a general quadratically constrained quadratic program (QCQP). The conditions are classified in two categories. The first one is for determining an optimal solution and the second one is for finding an optimal value. The first category of conditions includes the existence of a saddle point of the Lagrangian function and the existence of a rank-1 optimal solution of the primal SDP relaxation of QCQP. The second category includes $η_p = ζ$, $η_d = ζ$, and $φ= ζ$, where $ζ$, $η_p$, $η_d$, and $φ$ denote the optimal…
There are several concepts and definitions that characterize and give optimality conditions for solutions of a vector optimization problem. One of the most important is the first-order necessary optimality condition that generalizes the Karush-Kuhn-Tucker condition. This condition ensures the existence of an arbitrary neighborhood that contains an local optimal solution. The present work we introduce an alternative concept to identify the local optimal solution neighborhood in vector optimization problems. The main aspect of this contribution is the development of necessary and sufficient Pare…
We propose the application of Koopman operator theory for the design of stabilizing feedback controller for a nonlinear control system. The proposed approach is data-driven and relies on the use of time-series data generated from the control dynamical system for the lifting of a nonlinear system in the Koopman eigenfunction coordinates. In particular, a finite-dimensional bilinear representation of a control-affine nonlinear dynamical system is constructed in the Koopman eigenfunction coordinates using time-series data. Sample complexity results are used to determine the data required to achie…
This paper mainly investigates the optimal control and stabilization problems for linear discrete-time Markov jump systems. The general case for the finite-horizon optimal controller is considered, where the input weighting matrix in the performance index is just required to be positive semi-definite. The necessary and sufficient condition for the existence of the optimal controller in finite-horizon is given explicitly from a set of coupled difference Riccati equations (CDRE). One of the key techniques is to solve the forward and backward stochastic difference equation (FDSDE) which is obtain…
We consider the problem of voltage stability and reactive power balancing in islanded small-scale electrical networks outfitted with DC/AC inverters ("microgrids"). A droop-like voltage feedback controller is proposed which is quadratic in the local voltage magnitude, allowing for the application of circuit-theoretic analysis techniques to the closed-loop system. The operating points of the closed-loop microgrid are in exact correspondence with the solutions of a reduced power flow equation, and we provide explicit solutions and small-signal stability analyses under several static and dynamic …
This paper studies switching stabilization problems for general switched nonlinear systems. A piecewise smooth control-Lyapunov function (PSCLF) approach is proposed and a constructive way to design a stabilizing switching law is developed. The switching law is constructed via the directional derivatives of the PSCLF with a careful discussion on various technical issues that may occur on the nonsmooth surfaces. Sufficient conditions are derived to ensure stability of the closed-loop Filippov solutions including possible sliding motions. The proposed PSCLF approach contains many existing result…
In this paper we consider three minimization problems, namely quadratic, $ρ$-convex and quadratic fractional programing problems. The quadratic problem is considered with quadratic inequality constraints with bounded continuous and discrete mixed variables. The $ρ$-convex problem is considered with $ρ$-convex inequality constraints in mixed variables. The quadratic fractional problem is studied with quadratic fractional constraints in mixed variables. For all three problems we reformulate the problem as a mathematical programming problem and apply standard Karush Kuhn Tucker necessary conditio…
This paper is concerned with a linear-quadratic (LQ, for short) optimal control problem for backward stochastic differential equations (BSDEs, for short), where the coefficients of the backward control system and the weighting matrices in the cost functional are allowed to be random. By a variational method, the optimality system, which is a coupled linear forward-backward stochastic differential equation (FBSDE, for short), is derived, and by a Hilbert space method, the unique solvability of the optimality system is obtained. In order to construct the optimal control, a new stochastic Riccati…
On Partial Optimality in QUBO via Quadratic Posiform Autarkies
TU Dresden（德累斯顿工业大学）；Faculty of Computer Science, TU Dresden（德累斯顿工业大学计算机学院）；Center for Scalable Data Analytics and AI, Dresden/Leipzig（德累斯顿/莱比锡可扩展数据分析与人工智能中心）
This paper is concerned with linear quadratic optimal control problems for mean-field backward stochastic differential equations (MF-BSDEs, for short) with deterministic coefficients. The optimality system, which is a linear mean-field forward-backward stochastic differential equation with constraint, is obtained by a variational method. By decoupling the optimality system, two coupled Riccati equations and an MF-BSDE are derived. It turns out that the coupled two Riccati equations are uniquely solvable. Then a complete and explicit representation is obtained for the optimal control.
A linear quadratic (LQ) stochastic optimization problem with delay involving weakly-coupled large population is investigated in this paper. Different to classic mean field (MF) game, here agents cooperate with each other to minimize the so-called \emph{social} objective. With the aid of \emph{delayed person-by-person optimality} principle, one arrives at an auxiliary LQ delayed control problem by decentralized information. A decentralized strategy is obtained by feat of an MF type anticipated forward-backward stochastic differential delay equation (AFBSDDE) consistency condition. The discounti…
This paper studies asymptotic solvability of a linear quadratic (LQ) mean field social optimization problem with controlled diffusions and indefinite state and control weights. Starting with an $N$-agent model, we employ a rescaling approach to derive a low-dimensional Riccati ordinary differential equation (ODE) system, which characterizes a necessary and sufficient condition for asymptotic solvability. The decentralized control obtained from the mean field limit ensures a bounded optimality loss in minimizing the social cost having magnitude $O(N)$, which implies an optimality loss of $O(1/N…
This paper studies an infinite horizon optimal control problem for discrete-time linear systems and quadratic criteria, both with random parameters which are independent and identically distributed with respect to time. A classical approach is to solve an algebraic Riccati equation that involves mathematical expectations and requires certain statistical information of the parameters. In this paper, we propose an online iterative algorithm in the spirit of Q-learning for the situation where only one random sample of parameters emerges at each time step. The first theorem proves the equivalence …
This paper is devoted to the study of second order optimality conditions for strong local minimizers in the frameworks of unconstrained and constrained optimization problems in finite dimensions via subgradient graphical derivative. We prove that the positive definiteness of the subgradient graphical derivative of an extended-real-valued lower semicontinuous proper function at a proximal stationary point is sufficient for the quadratic growth condition. It is also a necessary condition for the latter property when the function is either subdifferentially continuous, prox-regular, twice epi-dif…
In this paper, we study the social optimality for mean field linear quadratic control systems following the direct approach, where subsystems are coupled via individual dynamics and costs according to a network topology. A graph is introduced to represent the network topology of the large-population system, where nodes represent subpopulations called clusters and edges represent communication relationship. By the direct approach, we first seek the optimal controller under centralized information structure, which characterized by a set of forward-backward stochastic differential equations. Then…
We present a framework of sequential action control (SAC) for stabilization of systems of partial differential equations which can be posed as abstract semilinear control problems in Hilbert spaces. We follow a late-lumping approach and show that the control action can be explicitly obtained from variational principles using adjoint information. Moreover, we analyze the closed-loop system obtained from the SAC feedback for the linear problem with quadratic stage costs. We apply this theory to a prototypical example of an unstable heat equation and provide numerical results as the verification …
This paper investigates a linear quadratic mean field leader-follower team problem, where the model involves one leader and a large number of weakly-coupled interactive followers. The leader and the followers cooperate to optimize the social cost. Specifically, for any strategy provided first by the leader, the followers would like to choose a strategy to minimize social cost functional. Using variational analysis and person-by-person optimality, we construct two auxiliary control problems. By solving sequentially the auxiliary control problems with consistent mean field approximations, we can…
We study nonconvex homogeneous quadratically constrained quadratic optimization with one or two constraints, denoted by (QQ1) and (QQ2), respectively. (QQ2) contains (QQ1), trust region subproblem (TRS) and ellipsoid regularized total least squares problem as special cases. It is known that there is a necessary and sufficient optimality condition for the global minimizer of (QQ2). In this paper, we first show that any local minimizer of (QQ1) is globally optimal. Unlike its special case (TRS) with at most one local non-global minimizer, (QQ2) may have infinitely many local non-global minimizer…
This paper studies several problems related to quadratic matrix inequalities (QMI's), i.e., inequalities in the Loewner order involving quadratic functions of matrix variables. In particular, we provide conditions under which the solution set of a QMI is nonempty, convex, bounded, or has nonempty interior. We also provide a parameterization of the solution set of a given QMI. In addition, we state results regarding the image of such sets under linear maps, which characterize a subset of ``structured" solutions to a QMI. Thereafter, we derive matrix versions of the classical S-lemma and Finsler…
This paper considers a linear-quadratic (LQ) mean field control problem involving a major player and a large number of minor players, where the dynamics and costs depend on random parameters. The objective is to optimize a social cost as a weighted sum of the individual costs under decentralized information. We apply the person-by-person optimality principle in team decision theory to the finite population model to construct two limiting variational problems whose solutions, subject to the requirement of consistent mean field approximations, yield a system of forward-backward stochastic differ…
In this paper, we prove the stabilizability of abstract Parabolic Integro-Differential Equations (PIDE) in a Hilbert space with decay rate $e^{-γt} $ for certain $γ> 0,$ by means of a finite dimensional controller in the feedback form. We determine a linear feedback law which is obtained by solving an algebraic Riccati equation. To prove the existence of the Riccati operator, we consider a linear quadratic optimal control problem with unbounded observation operator. The abstract theory of stabilization developed here is applied to specific problems related to viscoelastic fluids, e.g. Oldroyd …
This paper studies uniform stabilization and social optimality for linear quadratic (LQ) mean field control problems with multiplicative noise, where agents are coupled via dynamics and individual costs. The state and control weights in cost functionals are not limited to be positive semi-definite. This leads to an indefinite LQ mean field control problem, which may still be well-posed due to deep nature of multiplicative noise. We first obtain a set of forward-backward stochastic differential equations (FBSDEs) from variational analysis, and construct a feedback control by decoupling the FBSD…
A linear-quadratic optimal control problem for a forward stochastic Volterra integral equation (FSVIE, for short) is considered. Under the usual convexity conditions, open-loop optimal control exists, which can be characterized by the optimality system, a coupled system of an FSVIE and a Type-II backward SVIE (BSVIE, for short). To obtain a causal state feedback representation for the open-loop optimal control, a path-dependent Riccati equation for an operator-valued function is introduced, via which the optimality system can be decoupled. In the process of decoupling, a Type-III BSVIE is intr…
We show that quadratic growth of a semi-algebraic function is equivalent to strong metric subregularity of the subdifferential --- a kind of stability of generalized critical points. In contrast, this equivalence can easily fail outside of the semi-algebraic setting. As a consequence, we derive necessary conditions and sufficient conditions for optimality in subdifferential terms.
Optimal Power Flow (OPF) can be modeled as a non-convex Quadratically Constrained Quadratic Program (QCQP). Our purpose is to solve OPF to global optimality. To this end, we specialize the Mixed-Integer Quadratic Convex Reformulation method (MIQCR) to (OPF). This is a method in two steps. First, a Semi-Definite Programming (SDP) relaxation of (OPF) is solved. Then the optimal dual variables of this relaxation are used to reformulate OPF into an equivalent new quadratic program, where all the non-convexity is moved to one additional constraint. In the second step, this reformulation is solved w…
In standard linear quadratic (LQ) control, the first step in investigating infinite-horizon optimal control is to derive the stabilization condition with the optimal LQ controller. This paper focuses on the stabilization of an Ito stochastic system with indefinite control and state weighting matrices in the cost functional. A generalized algebraic Riccati equation (GARE) is obtained via the convergence of the generalized differential Riccati equation (GDRE) in the finite-horizon case. More importantly, the necessary and sufficient stabilization conditions for indefinite stochastic control are …
A quadratically constrained quadratic program (QCQP) is an optimization problem in which the objective function is a quadratic function and the feasible region is defined by quadratic constraints. Solving non-convex QCQP to global optimality is a well-known NP-hard problem and a traditional approach is to use convex relaxations and branch-and-bound algorithms. This paper makes a contribution in this direction by showing that the exact convex hull of a general quadratic equation intersected with any bounded polyhedron is second-order cone representable. We present a simple constructive proof of…
Department of Operations Research and Financial Engineering, Princeton University（普林斯顿大学运筹学与金融工程系）
In this paper, zero-sum mean-field type games (ZSMFTG) with linear dynamics and quadratic cost are studied under infinite-horizon discounted utility function. ZSMFTG are a class of games in which two decision makers whose utilities sum to zero, compete to influence a large population of indistinguishable agents. In particular, the case in which the transition and utility functions depend on the state, the action of the controllers, and the mean of the state and the actions, is investigated. The optimality conditions of the game are analysed for both open-loop and closed-loop controls, and expl…
A switched equilibrium of a switched system of two subsystems is a such a point where the vector fields of the two subsystems point strictly towards one another. Using the concept of stable convex combination that was developed by Wicks-Peleties-DeCarlo (1998) for linear systems, Bolzern-Spinelli (2004) offered a design of a state feedback switching rule that is capable to stabilize an affine switched system to any switched equilibrium. The state feedback switching rule of Bolzern-Spinelli gives a nonlinear (quadratic) switching threshold passing through the switched equilibrium. In this paper…
It has been widely recognized that the 0/1 loss function is one of the most natural choices for modelling classification errors, and it has a wide range of applications including support vector machines and 1-bit compressed sensing. Due to the combinatorial nature of the 0/1 loss function, methods based on convex relaxations or smoothing approximations have dominated the existing research and are often able to provide approximate solutions of good quality. However, those methods are not optimizing the 0/1 loss function directly and hence no optimality has been established for the original prob…
In this paper, we study the monitoring and control of long-term voltage stability considering load tap-changer (LTC) dynamics. We show that under generic conditions, the LTC dynamics always admit a unique stable equilibrium. For the stable equilibrium, we characterize an explicit inner approximation of its region of attraction (ROA). Compared to existing results, the computational complexity of the ROA characterization is drastically reduced. A quadratically constrained linear program formulation for the ROA characterization problem is proposed. In addition, we formulate a second-order cone pr…
The mean square stabilization problem for discrete-time networked control systems (NCSs) is investigated in this article. What the difference from most previous works is that input delay and packet losses occur simultaneously in the communication channel, moreover, the data packet dropout is modeled as a time-homogeneous Markov process which will bring some difficulties in solving the problem due to the temporal correlation. The contributions in this paper can be summarized as two points. Firstly, the equivalence condition for the solvability of linear quadratic optimal problem in finite horiz…
This paper deals with a class of time inconsistent stochastic linear quadratic (SLQ) optimal control problems in Markovian framework. Three notions, i.e., closed-loop equilibrium controls/strategies, open-loop equilibrium controls and their closed-loop representations, are characterized in unified manners. These results indicate clearer and deeper distinctions among these notions. For example, in particular time consistent setting, the open-loop equilibrium controls are fully characterized by first-order, second-order necessary optimality conditions, and become needlessly optimal, while the cl…
