arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.14957q-bio.PEcs.GTcs.MAphysics.bio-phphysics.soc-ph
收藏

学习使多人随机博弈的合作适应成为可能

Learning enables adaptation in cooperation for multi-player stochastic games

Feng Huang, Ming Cao, Long Wang

摘要:

自然种群中个体间的相互作用往往发生在动态变化的环境中。理解环境变化在种群动力学中的作用一直是理论生态学和种群生物学的中心课题。然而,关键的问题是,在具有挑战性的社会困境中,个人(例如,“公地悲剧”),调整他们的行为以适应环境的波动尚未得到令人满意的解决。利用演化博弈论和随机博弈,我们开发了一个博弈理论框架,结合强化学习的自适应机制,研究合作行为是否可以在不断变化的群体交互环境中进化。当参与者的行动选择仅受过去增援的轻微影响时,我们构造了一个分析条件来确定合作是否会比背叛更受青睐。直觉上,这个条件揭示了为什么以及如何环境可以调解合作困境。在我们的模型架构下,我们还将这种学习机制与两种非学习决策规则进行了比较,我们发现,学习显著提高了弱社会困境中的合作倾向,而与此形成鲜明对比的是,阻碍了强社会困境中的合作。我们的研究结果表明,在复杂的社会生态困境,学习使个人适应不同的环境。

英文摘要:

Interactions among individuals in natural populations often occur in a dynamically changing environment. Understanding the role of environmental variation in population dynamics has long been a central topic in theoretical ecology and population biology. However, the key question of how individuals, in the middle of challenging social dilemmas (e.g., the "tragedy of the commons"), modulate their behaviors to adapt to the fluctuation of the environment has not yet been addressed satisfactorily. Utilizing evolutionary game theory and stochastic games, we develop a game-theoretical framework that incorporates the adaptive mechanism of reinforcement learning to investigate whether cooperative behaviors can evolve in the ever-changing group interaction environment. When the action choices of players are just slightly influenced by past reinforcements, we construct an analytical condition to determine whether cooperation can be favored over defection. Intuitively, this condition reveals why and how the environment can mediate cooperative dilemmas. Under our model architecture, we also compare this learning mechanism with two non-learning decision rules, and we find that learning significantly improves the propensity for cooperation in weak social dilemmas, and, in sharp contrast, hinders cooperation in strong social dilemmas. Our results suggest that in complex social-ecological dilemmas, learning enables the adaptation of individuals to varying environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑