arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1701.02546cs.LO
收藏

具有能源平价目标的MDP

MDPs with Energy-Parity Objectives

Richard Mayr, Sven Schewe, Patrick Totzke, Dominik Wojtczak

摘要:

能量平价目标将$ω$ -常规与奖励MDP的定量目标相结合。控制器需要在满足奇偶性目标的同时避免耗尽能量。我们驳斥了共同的信念,如果一个能量奇偶性的目标几乎肯定,那么这可以实现一些有限的记忆策略。我们提供了一个令人惊讶的简单的反例,只使用coBüchi条件。我们引入一类新的有界(能量)存储目标,当结合奇偶校验目标,保持有限的内存属性。在此基础上,我们表明,几乎肯定和有限肯定的能量奇偶性目标,以及几乎肯定和有限肯定的存储奇偶性目标,是在$\mathit{NP}\cap \mathit{coNP}$,可以解决在伪多项式时间的能量奇偶性MDP。

英文摘要:

Energy-parity objectives combine $ω$-regular with quantitative objectives of reward MDPs. The controller needs to avoid to run out of energy while satisfying a parity objective. We refute the common belief that, if an energy-parity objective holds almost-surely, then this can be realised by some finite memory strategy. We provide a surprisingly simple counterexample that only uses coBüchi conditions. We introduce the new class of bounded (energy) storage objectives that, when combined with parity objectives, preserve the finite memory property. Based on these, we show that almost-sure and limit-sure energy-parity objectives, as well as almost-sure and limit-sure storage parity objectives, are in $\mathit{NP}\cap \mathit{coNP}$ and can be solved in pseudo-polynomial time for energy-parity MDPs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑