arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.08348cs.GTcs.FL
收藏

并发随机可达对策的价值迭代和策略迭代的停止准则

Stopping Criteria for Value and Strategy Iteration on Concurrent Stochastic Reachability Games

Julia Eisentraut, Jan Křetínský, Alexej Rotar

摘要:

我们认为并发随机游戏的可达性和安全目标的图。这些博弈可以通过值迭代和策略迭代来求解,每个迭代都产生一个可达值的欠逼近序列和一个安全值的过逼近序列,并在极限内收敛到它。对于这两种方法,我们提供了第一个(随时)停止标准的算法。值迭代的停止准则基于提供过近似的收敛序列,然后允许估计到真值的距离。对于策略迭代,我们通过一个新的策略迭代算法下近似的安全值的可达性补充的策略迭代算法的错误。

英文摘要:

We consider concurrent stochastic games played on graphs with reachability and safety objectives. These games can be solved by value iteration as well as strategy iteration, each of them yielding a sequence of under-approximations of the reachability value and a sequence of over-approximation of the safety value, converging to it in the limit. For both approaches, we provide the first (anytime) algorithms with stopping criteria. The stopping criterion for value iteration is based on providing a convergent sequence of over-approximations, which then allows to estimate the distance to the true value. For strategy iteration, we bound the error by complementing the strategy iteration algorithm for reachability by a new strategy iteration algorithm under-approximating the safety-value.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑