arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1509.09041math.PR
收藏

关于连续时间下的策略改进算法

On the policy improvement algorithm in continuous time

Saul D. Jacka, Aleksandar Mijatović

摘要:

针对连续时间过程的随机控制问题,提出了一种策略改进算法(PIA)的一般方法。主要结果只假设控制躺在一个紧凑的度量空间,并给出一般的充分条件的PIA是明确的,并在连续时间收敛(即没有时间离散)。它出现的自然背景下的PIA在连续时间是弱随机控制。我们给出控制问题的例子,证明需要弱制定以及基于扩散类的问题,在连续时间的PIA是适用的。

英文摘要:

We develop a general approach to the Policy Improvement Algorithm (PIA) for stochastic control problems for continuous-time processes. The main results assume only that the controls lie in a compact metric space and give general sufficient conditions for the PIA to be well-defined and converge in continuous time (i.e. without time discretisation). It emerges that the natural context for the PIA in continuous time is weak stochastic control. We give examples of control problems demonstrating the need for the weak formulation as well as diffusion-based classes of problems where the PIA in continuous time is applicable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑