arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.07537q-bio.PEcond-mat.dis-nnnlin.AO
收藏

在双模混合中合作的进化

Evolution of cooperation in a bimodal mixture of conditional cooperators

Shaanxi Normal University(陕西师范大学);Washington University in St. Louis(华盛顿大学圣路易斯分校);Soochow University(苏州大学);Ningxia University(宁夏大学)

Chenyang Zhao, Xinshi Feng, Guozhong Zheng, Weiran Cai, Jiqiang Zhang, Li Chen

AI总结:

研究提出软性条件合作机制,通过Q学习算法分析双模混合中合作的进化动态,揭示了不同行为模式下合作水平的相变特性。

摘要:

广泛的行为实验揭示了条件合作是一种普遍现象。以前的游戏理论研究大多依赖于硬性模型,其中合作仅在达到特定阈值时才会触发。然而,这种方法与观察到的人类行为的灵活性相矛盾,其中个体会根据周围环境动态调整策略。为了捕捉这种适应性,我们引入了一种软性的条件合作形式,通过整合强化学习中的Q学习算法。在这种形式中,玩家不仅会相互回报合作,还可能在高度合作的环境中背叛,或在较少合作的环境中合作以最大化奖励。为了探索硬性和软性条件合作者的影响,我们检查了他们在两种场景中的相互作用:结构混合(SM)和概率混合(PM),其中两种行为模式分别是固定的和概率性采用的。在SM中,硬性条件合作者在阈值较低时增强合作,但否则会阻碍合作。令人惊讶的是,在PM中,合作的普遍性随着概率的变化表现出两次一级相变,导致高、低和消失的合作水平。对Q表的分析提供了关于软性条件合作者的“心理转变”以及整体进化动态的见解。模型扩展确认了我们发现的稳健性。这些结果突显了来自条件合作者多样性所带来的新复杂性。

英文摘要:

Extensive behavioral experiments reveal that conditional cooperation is a prevalent phenomenon. Previous game-theoretical studies have predominantly relied on hard-manner models, where cooperation is triggered only upon reaching a specific threshold. However, this approach contrasts with the observed flexibility of human behaviors, where individuals adapt their strategies dynamically based on their surroundings. To capture this adaptability, we introduce a soft form of conditional cooperation by integrating the Q-learning algorithm from reinforcement learning. In this form, players not only reciprocate mutual cooperation but may also defect in highly cooperative environments or cooperate in less cooperative settings to maximize rewards. To explore the effects of hard and soft conditional cooperators, we examine their interactions in two scenarios: structural mixture (SM) and probabilistic mixture (PM), where the two behavioral modes are fixed and probabilistically adopted, respectively. In SM, hard conditional cooperators enhance cooperation when the threshold is low but hinder it otherwise. Surprisingly, in PM, the cooperation prevalence exhibits two first-order phase transitions as the probability is varied, leading to high, low, and vanishing levels of cooperation. Analysis of Q-tables offers insights into the "psychological shifts" of soft conditional cooperators and the overall evolutionary dynamics. Model extensions confirm the robustness of our findings. These results highlight the novel complexities arising from the diversity of conditional cooperators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑