arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.03047math.OC
收藏

一种求解数据驱动反馈控制问题的有效数值算法

An efficient numerical algorithm for solving data driven feedback control problems

Richard Archibald, Feng Bao, Jiongmin Yong, Tao Zhou

摘要:

本文的目的是数值求解一类随机最优控制问题,其中状态过程由一个伊藤型随机微分方程控制,控制过程同时进入漂移和扩散,并且是部分可观测的.根据已有的观测资料确定了反馈形式的最优控制。我们把这种类型的控制问题称为数据驱动的反馈控制。我们引入的计算框架来解决这类问题的目的是找到最优控制的最佳估计作为给定观测信息的条件期望。为了使我们的方法在提供及时的反馈控制系统的数据是可行的,我们开发了一个有效的随机最优化算法来实现我们的计算框架。

英文摘要:

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an Itô type stochastic differential equation with control process entering both in the drift and the diffusion, and is observed partially. The optimal control of feedback form is determined based on the available observational data. We call this type of control problems the data driven feedback control. The computational framework that we introduce to solve such type of problems aims to find the best estimate for the optimal control as a conditional expectation given the observational information. To make our method feasible in providing timely feedback to the controlled system from data, we develop an efficient stochastic optimization algorithm to implement our computational framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑