arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2408.01212cs.GT
收藏

具有确定奇偶性与多可达性目标的马尔可夫决策过程

Markov Decision Processes with Sure Parity and Multiple Reachability Objectives

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler

AI总结:

本文研究马尔可夫决策过程中同时满足确定奇偶性目标与多个概率可达性阈值目标的策略求解问题,证明严格阈值和字典序最大化情形可归约为奇偶博弈,非严格阈值情形可在EXPTIME内求解,并给出各情形的策略复杂度与算法。

摘要:

本文考虑在马尔可夫决策过程中寻找满足确定性与阈值目标混合要求的策略的问题。我们关注一个单一的 $ω$-正则目标,表示为奇偶性条件,必须被确定地满足,同时还要以一定的概率阈值满足 $n$ 个朝向汇状态的可达性目标。我们考虑该问题的三种变体:(a) 所有可达性目标上的严格阈值和 (b) 非严格阈值,以及 (c) 按照字典序最大化阈值。我们证明 (a) 和 (c) 可以归约为求解奇偶博弈,而 (b) 可以在 $\sf{EXPTIME}$ 内求解。针对所有情况,我们给出了策略复杂度以及算法。

英文摘要:

This paper considers the problem of finding strategies that satisfy a mixture of sure and threshold objectives in Markov decision processes. We focus on a single $ω$-regular objective expressed as parity that must be surely met while satisfying $n$ reachability objectives towards sink states with some probability thresholds too. We consider three variants of the problem: (a) strict and (b) non-strict thresholds on all reachability objectives, and (c) maximizing the thresholds with respect to a lexicographic order. We show that (a) and (c) can be reduced to solving parity games, and (b) can be solved in $\sf{EXPTIME}$. Strategy complexities as well as algorithms are provided for all cases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑