A decentralized linear quadratic system with a major agent and a collection of minor agents is considered. The major agent affects the minor agents, but not vice versa. The state of the major agent is observed by all agents. In addition, the minor agents have a noisy observation of their local state. The noise processes is \emph{not} assumed to be Gaussian. The structures of the optimal strategy and the best linear strategy are characterized. It is shown that major agent's optimal control action is a linear function of the major agent's MMSE (minimum mean squared error) estimate of the system state while the minor agent's optimal control action is a linear function of the major agent's MMSE estimate of the system state and a "correction term" which depends on the difference of the minor agent's MMSE estimate of its local state and the major agent's MMSE estimate of the minor agent's local state. Since the noise is non-Gaussian, the minor agent's MMSE estimate is a non-linear function of its observation. It is shown that replacing the minor agent's MMSE estimate by its LLMS (linear least mean square) estimate gives the best linear control strategy. The results are proved using a direct method based on conditional independence, common-information-based splitting of state and control actions, and simplifying the per-step cost based on conditional independence, orthogonality principle, and completion of squares.
Cooperative Distributed MPC via Decentralized Real-Time Optimization: Implementation Results for Robot Formations
Institute for Energy Systems, Energy Efficiency and Energy Economics, TU Dortmund University(能源系统、能源效率与能源经济学研究所,德累斯顿理工大学);Institute of Engineering and Computational Mechanics, University of Stuttgart(工程与计算力学研究所,斯图加特大学)
Decentralized MPC based Obstacle Avoidance for Multi-Robot Target Tracking Scenarios
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Tübingen(图宾根大学);International Institute for Information Technology(国际信息技术研究所)
Learning Decentralized Linear Quadratic Regulators with $\sqrt{T}$ Regret
School of Artificial Intelligence and Automation at the Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);College of Petroleum Engineering, Yangtze University(长江大学石油工程学院);Elmore Family School of Electrical and Computer Engineering at Purdue University(普渡大学埃尔莫尔家族电气与计算机工程学院)