arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1901.08803math.OC
收藏

具有有限状态和行动空间的平均场对策的平稳均衡

Stationary Equilibria of Mean Field Games with Finite State and Action Space

Berenice Anne Neumann

摘要:

平均场博弈将动态博弈形式化,其中玩家具有连续的玩家和明确的交互,其中玩家可以具有异质状态。由于它们还产生相应的$N$玩家游戏的近似均衡,因此它们对社会经济应用非常感兴趣。然而,用于平均场博弈的大多数技术依赖于这样的假设,即对于每个总体分布,存在唯一的哈密顿优化器。对于有限的作用空间,这只适用于平凡模型。因此,迄今为止使用的技术不适用。我们提出了一个有限的状态和行动空间的模型,其中的动态是由一个时间非齐次马尔可夫链,可能取决于当前的总体分布。我们证明了在温和的假设下,混合策略的平稳平均场平衡的存在性,并提出了计算所有这些平衡的技术。更准确地说,我们的研究结果允许-给定的发电机是不可约的-一套固定的平均场均衡的特点是一个地图的所有不动点的转移率和奖励确定性策略的特点。此外,我们提出了几个部分结果的情况下,非不可约发电机,我们证明了所提出的技术上的两个例子。

英文摘要:

Mean field games formalize dynamic games with a continuum of players and explicit interaction where the players can have heterogeneous states. As they additionally yield approximate equilibria of corresponding $N$-player games, they are of great interest for socio-economic applications. However, most techniques used for mean field games rely on assumptions that imply that for each population distribution there is a unique optimizer of the Hamiltonian. For finite action spaces, this will only hold for trivial models. Thus, the techniques used so far are not applicable. We propose a model with finite state and action space, where the dynamics are given by a time-inhomogeneous Markov chain that might depend on the current population distribution. We show existence of stationary mean field equilibria in mixed strategies under mild assumptions and propose techniques to compute all these equilibria. More precisely, our results allow -- given that the generators are irreducible -- to characterize the set of stationary mean field equilibria as the set of all fixed points of a map completely characterized by the transition rates and rewards for deterministic strategies. Additionally, we propose several partial results for the case of non-irreducible generators and we demonstrate the presented techniques on two examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑