Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the Hamilton-Jacobi-Bellman (HJB) equation are essential. The numerical treatment of these equations poses formidable challenges due to their non-linearity and their (possibly) high-dimensionality.
In this paper we consider a finite horizon control system with associated Bellman equation. After a time-discretization, we obtain a sequence of short time horizon problems which we call local optimal control problems. For solving the local optimal control problems we apply two different methods, one being the well-known policy iteration, where a fixed-point iteration is required for every time step. The other algorithm borrows ideas from Model Predictive Control (MPC), by solving the local optimal control problem via open-loop control methods on a short time horizon, allowing us to replace the fixed-point iteration by an adjoint method.
For high-dimensional systems we apply low rank hierarchical tensor product approximation/tree-based tensor formats, in particular tensor trains (TT tensors) and multi-polynomials, together with high-dimensional quadrature, e.g. Monte-Carlo.
We prove a linear error propagation with respect to the time discretization and give numerical evidence by controlling a diffusion equation with unstable reaction term and an Allen-Kahn equation.
Optimal Universal Controllers for Roll Stabilization
Oceaneering AGV Systems B.V.(Oceaneering AGV系统有限公司);University of Groningen(格罗宁根大学);Politecnico di Torino(都灵理工大学);Institute for Problems of Mechanical Engineering(机械工程学院问题研究所)
Separated design of encoder and controller for networked linear quadratic optimal control
School of Computing and Electrical Engineering, Indian Institute of Technology, Mandi, India(印度曼迪印度理工学院计算与电气工程学院);School of Electrical Engineering, Royal Institute of Technology, Stockholm, Sweden(瑞典斯德哥尔摩皇家理工学院电气工程学院)
Element-based Formation Control: a Unified Perspective from Continuum Mechanics
Department of Control Science and Engineering, College of Electronics and Information Engineering, Tongji University(同济大学电子与信息工程学院控制科学与工程系);Shanghai Institute of Intelligent Science and Technology(上海智能科学与技术研究院);National Key Laboratory of Autonomous Intelligent Unmanned Systems(自主智能无人系统全国重点实验室);Frontiers Science Center for Intelligent Autonomous Systems, Ministry of Education(教育部智能自主系统前沿科学中心);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院)