arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.06108math.OCcs.NAmath.NA
收藏

用分层张量格式逼近有限时域控制问题的最优反馈控制器

Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats

Mathias Oster, Leon Sallandt, Reinhold Schneider

摘要:

控制系统的常微分方程(ODEs)是普遍存在的科学和工程。为了找到一个最优反馈控制器,价值函数和相关的基本方程,如贝尔曼方程和哈密尔顿-雅可比-贝尔曼(HJB)方程是必不可少的。由于这些方程的非线性和(可能)高维性,对它们的数值处理提出了巨大的挑战。本文考虑一个有限时域控制系统,它与Bellman方程相关联.在时间离散化之后,我们得到一系列的短时间范围的问题,我们称之为局部最优控制问题。为了解决局部最优控制问题,我们采用两种不同的方法,一种是众所周知的策略迭代,其中每个时间步都需要一个固定点迭代。另一种算法借鉴了模型预测控制(MPC)的思想,通过在短时间内用开环控制方法求解局部最优控制问题,用伴随方法代替定点迭代。对于高维系统,我们应用低秩分层张量积近似/基于树的张量格式,特别是张量列(TT张量)和多多项式,以及高维求积,例如Monte-Carlo。通过控制一个含不稳定反应项的扩散方程和一个Allen-Kahn方程,证明了误差关于时间离散的线性传播.

英文摘要:

Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the Hamilton-Jacobi-Bellman (HJB) equation are essential. The numerical treatment of these equations poses formidable challenges due to their non-linearity and their (possibly) high-dimensionality. In this paper we consider a finite horizon control system with associated Bellman equation. After a time-discretization, we obtain a sequence of short time horizon problems which we call local optimal control problems. For solving the local optimal control problems we apply two different methods, one being the well-known policy iteration, where a fixed-point iteration is required for every time step. The other algorithm borrows ideas from Model Predictive Control (MPC), by solving the local optimal control problem via open-loop control methods on a short time horizon, allowing us to replace the fixed-point iteration by an adjoint method. For high-dimensional systems we apply low rank hierarchical tensor product approximation/tree-based tensor formats, in particular tensor trains (TT tensors) and multi-polynomials, together with high-dimensional quadrature, e.g. Monte-Carlo. We prove a linear error propagation with respect to the time discretization and give numerical evidence by controlling a diffusion equation with unstable reaction term and an Allen-Kahn equation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑