arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.17628math.OC
收藏

随机控制中的凸算子理论方法

Convex operator-theoretic methods in stochastic control

Boris Houska

AI总结:

本文提出基于凸算子理论的随机最优控制方法,通过广义Bakry-Emery条件保证非线性系统全局指数可镇定性及遍历HJB方程解的存在性,并给出基于Galerkin投影的数值求解递推算法。

摘要:

本文研究利用算子理论方法求解非线性随机最优控制问题并达到全局最优性。这些方法利用了最优控制扩散过程与遍历Hilbert-Sobolev空间中非线性系统的Hamilton-Jacobi-Bellman(HJB)方程之间的凸对偶性。具体而言,引入了一个广义Bakry-Emery条件,在该条件下可以建立一大类非线性系统的全局指数可镇定性。证明了该条件足以保证无限时间范围上随机最优控制问题的遍历HJB方程解的存在性。此外,引入了一种新的有界线性算子动态规划递推方法,该方法可通过Galerkin投影数值求解HJB方程。

英文摘要:

This paper is about operator-theoretic methods for solving nonlinear stochastic optimal control problems to global optimality. These methods leverage on the convex duality between optimally controlled diffusion processes and Hamilton-Jacobi-Bellman (HJB) equations for nonlinear systems in an ergodic Hilbert-Sobolev space. In detail, a generalized Bakry-Emery condition is introduced under which one can establish the global exponential stabilizability of a large class of nonlinear systems. It is shown that this condition is sufficient to ensure the existence of solutions of the ergodic HJB for stochastic optimal control problems on infinite time horizons. Moreover, a novel dynamic programming recursion for bounded linear operators is introduced, which can be used to numerically solve HJB equations by a Galerkin projection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑