arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11315cs.GT
收藏

计算博弈中学习的稳定极限环

Computing stable limit cycles of learning in games

Oliver Biggar, Christos Papadimitriou

AI总结:

本文研究了博弈中学习动态下稳定极限环的计算问题,提出了多项式时间稳定性测试方法,并给出了基于偏好图的稳定性条件。

摘要:

许多已广泛研究的学习动态,如 fictitious play 和 replicator 动态,在一般 N-玩家博弈中已知无法收敛。最简单的非收敛模式是周期性或周期性行为。此类循环是基本对象,已激发了该领域许多重要见解,从 Shapley(1964)的开创性工作开始。然而,一个核心问题仍未得到回答:哪些循环在博弈动态下是稳定的?在本文中,我们为两种最广泛研究的动态,即 fictitious play/best-response 动态和 replicator 动态,给出了完整且计算上的答案。我们证明(1)一个周期性的策略序列在其中一个动态下稳定当且仅当在另一个动态下稳定;(2)我们提供了一种多项式时间的谱稳定性测试,以确定给定的周期序列是否在任一动态下稳定。最后,我们给出一个完全的充分条件:每个在游戏偏好图中为sink equilibrium的循环都是稳定的,并且更进一步,它也是replicator动态的吸引子。这一结果扩展了Shapley(1964)和Jordan(1993)著名的定理,并扩展了最近将偏好图与replicator吸引子相关联的工作的前沿。

英文摘要:

Many well-studied learning dynamics, such as fictitious play and the replicator, are known to not converge in general $N$-player games. The simplest mode of non-convergence is cyclical or periodic behavior. Such cycles are fundamental objects, and have inspired a number of significant insights in the field, beginning with the pioneering work of Shapley (1964). However a central question remains unanswered: which cycles are stable under game dynamics? In this paper we give a complete and computational answer to this question for the two best-studied dynamics, fictitious play/best-response dynamics and the replicator dynamic. We show (1) that a periodic sequence of profiles is stable under one of these dynamics if and only it is stable under the other, and (2) we provide a polynomial-time spectral stability test to determine whether a given periodic sequence is stable under either dynamic. Finally, we give an entirely `structural' sufficient condition for stability: every cycle that is a sink equilibrium of the preference graph of the game is stable, and moreover it is an attractor of the replicator dynamic. This result generalizes the famous theorems of Shapley (1964) and Jordan (1993), and extends the frontier of recent work relating the preference graph to the replicator attractors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑