arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1404.1441math.OCcs.SYeess.SYmath.PRq-fin.RM
收藏

具有风险敏感性的均场类型控制的随机最大原理

A Stochastic Maximum Principle for Risk-Sensitive Mean-Field Type Control

KTH Royal Institute of Technology(皇家理工学院);KAUST(阿卜杜拉国王科技大学)

Boualem Djehiche, Hamidou Tembine, Raul Tempone

AI总结:

本文研究了具有风险敏感性能函数的均场类型控制问题,推导了适用于均场类型随机微分方程最优控制的随机最大原理,扩展了Lim和Zhou(2005)的无均场耦合风险敏感随机最大原理,适用于非马尔可夫动态且可能时间不一致的最优控制问题。

摘要:

本文研究了具有风险敏感性能函数的均场类型控制问题。我们建立了适用于均场类型随机微分方程(SDEs)最优控制的随机最大原理(SMP),其中漂移系数、扩散系数以及性能函数不仅依赖于状态和控制,还依赖于状态分布的均值。我们的结果扩展了Lim和Zhou(2005)推导的无均场耦合风险敏感SMP,该SMP用于反馈(或马尔可夫)类型最优控制,扩展到可能时间不一致的非马尔可夫动态最优控制问题。在我们的风险敏感SMP方法中,Lim和Zhou(2005)中对价值函数的光滑性假设不再需要。对于一般的动作空间,推导了Peng类型的SMP,指定了最优性的必要条件。两个例子用于说明所提出的风险敏感均场类型SMP在具有线性随机动态和指数二次成本函数下的应用。给出了均场自由和均场模型的显式解。

英文摘要:

In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of mean-field type, in which the drift and the diffusion coefficients as well as the performance functional depend not only on the state and the control but also on the mean of the distribution of the state. Our result extends the risk-sensitive SMP (without mean-field coupling) of Lim and Zhou (2005), derived for feedback (or Markov) type optimal controls, to optimal control problems for non-Markovian dynamics which may be time-inconsistent in the sense that the Bellman optimality principle does not hold. In our approach to the risk-sensitive SMP, the smoothness assumption on the value-function imposed in Lim and Zhou (2005) need not to be satisfied. For a general action space a Peng's type SMP is derived, specifying the necessary conditions for optimality. Two examples are carried out to illustrate the proposed risk-sensitive mean-field type SMP under linear stochastic dynamics with exponential quadratic cost function. Explicit solutions are given for both mean-field free and mean-field models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑