arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1612.00744math.OC
收藏

具有下界函数的折扣连续时间马氏决策过程的注记

Note on discounted continuous-time Markov decision processes with a lower bounding function

Xin Guo, Alexey Piunovskiy, Yi Zhang

摘要:

本文研究了具有下界函数的折扣连续时间马尔可夫决策过程。在该模型中,每个成本率的负部分由漂移函数(例如$w$)限制,而正部分允许任意无界。我们的重点是存在一个固定的最优政策的折扣CTMDP问题的更一般的类。约束和无约束的问题被认为是。我们的调查是基于一个有用的非齐次马尔可夫纯跳过程,尚未被广泛应用到CTMDPs的研究转换。这种技术在以前的文献中没有采用,但它以一种相当透明的方式澄清了施加条件的作用。因此,我们撤回并削弱了文献中常见的几个条件。

英文摘要:

In this paper, we consider the discounted continuous-time Markov decision process (CTMDP) with a lower bounding function. In this model, the negative part of each cost rate is bounded by the drift function, say $w$, whereas the positive part is allowed to be arbitrarily unbounded. Our focus is on the existence of a stationary optimal policy for the discounted CTMDP problems out of the more general class. Both constrained and unconstrained problems are considered. Our investigations are based on a useful transformation for nonhomogeneous Markov pure jump processes that has not yet been widely applied to the study of CTMDPs. This technique was not employed in previous literature, but it clarifies the roles of the imposed conditions in a rather transparent way. As a consequence, we withdraw and weaken several conditions commonly imposed in the literature.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑