arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1502.04000math.OC
收藏

变阶段时间随机对策值的算子逼近

Operator approach to values of stochastic games with varying stage duration

Sylvain Sorin, Guillaume Vigeral

摘要:

研究了变阶段时长随机对策$h$的值、相应的Shapley算子$\bf{T}$和${\bf{T}}\_h$与$\dot f\_t = ({\bf{T}} - Id )f\_t$的解之间的联系.考虑一般的非扩张映射,我们建立了两种结果,在折扣或有限长的框架下,适用于类“精确”随机对策。首先,对于固定长度或折扣因子,当阶段持续时间变为0时,该值收敛。第二,当长度趋于无穷大或贴现因子趋于0时,价值的渐近行为不依赖于阶段持续时间。此外,这些性质意味着有限长度或折扣连续时间博弈(与连续时间联合控制马尔可夫过程相关)的值的存在,作为任何时间离散化的值的极限与消失网格。

英文摘要:

We study the links between the values of stochastic games with varying stage duration $h$, the corresponding Shapley operators $\bf{T}$ and ${\bf{T}}\_h$and the solution of $\dot f\_t = ({\bf{T}} - Id )f\_t$. Considering general non expansive maps we establish two kinds of results, under both the discounted or the finite length framework, that apply to the class of "exact" stochastic games. First, for a fixed length or discount factor, the value converges as the stage duration go to 0. Second, the asymptotic behavior of the value as the length goes to infinity, or as the discount factor goes to 0, does not depend on the stage duration. In addition, these properties imply the existence of the value of the finite length or discounted continuous time game (associated to a continuous time jointly controlled Markov process), as the limit of the value of any time discretization with vanishing mesh.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑