arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2102.04922cs.GT
收藏

简单随机对策的一般策略改进方法

A Generic Strategy Improvement Method for Simple Stochastic Games

D. Auger, X. Badin de Montjoye, Y. Strozecki

摘要:

提出了一种求解简单随机博弈最优策略的通用策略迭代算法。我们证明了GSIA的正确性,并得到了一个一般的复杂性界,它包含和改进了几篇文章的结果。首先,我们去除了SSG停止的假设,这通常是通过博弈的多项式爆破获得的。其次,我们证明了一个紧界的分母的值与一个战略,并使用它来证明,所有的战略迭代算法实际上是固定参数听话的随机顶点的数量。所有已知的策略迭代算法都可以看作是GSIA的实例,它允许分析Condon从下收敛的复杂性,并提出一类推广Gimbert和Horn算法的算法。这些算法一般需要少于$r!$的迭代次数,并且比Ibsen-Jensen和Miltersen给出的二进制SSG的当前最佳确定性算法的迭代次数更少。

英文摘要:

We present a generic strategy iteration algorithm (GSIA) to find an optimal strategy of a simple stochastic game (SSG). We prove the correctness of GSIA, and derive a general complexity bound, which implies and improves on the results of several articles. First, we remove the assumption that the SSG is stopping, which is usually obtained by a polynomial blowup of the game. Second, we prove a tight bound on the denominator of the values associated to a strategy, and use it to prove that all strategy iteration algorithms are in fact fixed parameter tractable in the number of random vertices. All known strategy iteration algorithms can be seen as instances of GSIA, which allows to analyze the complexity of converge from below by Condon and to propose a class of algorithms generalising Gimbert and Horn's algorithm. These algorithms require less than $r!$ iterations in general and less iterations than the current best deterministic algorithm for binary SSGs given by Ibsen-Jensen and Miltersen.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑