arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.06981math.PRmath.OC
收藏

求解由 Wiener 泛函驱动的非 Markov 随机控制问题

Solving non-Markovian Stochastic Control Problems driven by Wiener Functionals

Dorival Leão, Alberto Ohashi, Francys Andrews de Souza

AI总结:

本文针对由 Wiener 泛函驱动的非 Markov 和非半鞅随机控制问题,提出基于有限维逼近的数值方案,在弱条件下证明收敛性并给出漂移控制情形的收敛速率,应用于路径依赖 SDE 和粗糙随机波动率模型。

摘要:

本文提出了一种针对由 Brown 运动滤波驱动的随机控制问题的通用方法,涵盖由相互奇异测度控制的非 Markov 和非半鞅状态过程。本文的主要成果是发展了一种数值方案,通过有限维逼近过程计算与受控 Wiener 泛函相关的近最优控制。该方法不要求对值过程作泛函可微性假设,也不要求扩散分量满足椭圆性条件。在相当弱的条件下,针对不同类型的非 Markov 和非半鞅状态,建立了该方法的一般收敛性。当控制仅作用于受控系统的漂移分量时,给出了显式收敛速率。近闭环/开环最优控制由动态规划算法完全刻画,并根据可能存在的非 Markov 记忆强度进行分类。该理论被应用于基于路径依赖 SDE 和粗糙随机波动率模型的随机控制问题,其中漂移分量和可能退化的扩散分量均受到控制。还讨论了由分数 Brown 运动驱动、指数 $H\in (0,\frac{1}{2})$ 的非线性路径依赖 SDE 的漂移最优控制。最后,我们给出一个简单的数值例子来说明该方法。

英文摘要:

In this article, we present a general methodology for stochastic control problems driven by the Brownian motion filtration including non-Markovian and non-semimartingale state processes controlled by mutually singular measures. The main result of this paper is the development of a numerical scheme for computing near-optimal controls associated with controlled Wiener functionals via a finite-dimensional approximation procedure. The approach does not require functional differentiability assumptions on the value process and ellipticity conditions on the diffusion components. The general convergence of the method is established under rather weak conditions for distinct types of non-Markovian and non-semimartingale states. Explicit rates of convergence are provided in case the control acts only on the drift component of the controlled system. Near-closed/open-loop optimal controls are fully characterized by a dynamic programming algorithm and they are classified according to the strength of the possibly underlying non-Markovian memory. The theory is applied to stochastic control problems based on path-dependent SDEs and rough stochastic volatility models, where both drift and possibly degenerated diffusion components are controlled. Optimal control of drifts for nonlinear path-dependent SDEs driven by fractional Brownian motion with exponent $H\in (0,\frac{1}{2})$ is also discussed. Finally, we present a simple numerical example to illustrate the method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑