使用深度强化学习促进公共池资源问题中的可持续人类行为
Using deep reinforcement learning to promote sustainable human behaviour on a common pool resource problem
AI总结:
研究在迭代多人信任博弈中利用深度强化学习设计资源分配机制,通过训练社会规划者发现再分配策略,有效促进人类对公共池资源的可持续贡献并增加总盈余。
摘要:
当有限资源分配给一群人时,会产生一种典型的社会困境,他们可以选择带息回报,或将收益据为己有。什么样的资源分配机制能鼓励维持公地的回报水平?在此,在一个迭代多人信任博弈中,我们使用深度强化学习(RL)设计了一种分配机制,该机制内生地促进人类参与者对公共池资源做出可持续贡献。我们首先训练神经网络使其表现得像人类玩家,创建了一个模拟经济,使我们能够研究不同机制如何影响接收与回报的动态。然后,我们使用RL训练一个社会规划者,以最大化玩家的总回报。社会规划者发现了一种再分配策略,该策略带来了大量盈余和包容性经济,玩家在其中获得了大致相等的收益。RL智能体通过根据可用资源调整其慷慨程度,并通过分配较少资源来暂时制裁叛逃者,从而基于无限制福利或条件合作的基线机制增加了人类盈余。检查AI策略使我们能够开发出一种可解释的机制,其表现相似且在玩家中更受欢迎。深度强化学习可用于发现促进可持续人类行为的机制。
英文摘要:
A canonical social dilemma arises when finite resources are allocated to a group of people, who can choose to either reciprocate with interest, or keep the proceeds for themselves. What resource allocation mechanisms will encourage levels of reciprocation that sustain the commons? Here, in an iterated multiplayer trust game, we use deep reinforcement learning (RL) to design an allocation mechanism that endogenously promotes sustainable contributions from human participants to a common pool resource. We first trained neural networks to behave like human players, creating a stimulated economy that allowed us to study how different mechanisms influenced the dynamics of receipt and reciprocation. We then used RL to train a social planner to maximise aggregate return to players. The social planner discovered a redistributive policy that led to a large surplus and an inclusive economy, in which players made roughly equal gains. The RL agent increased human surplus over baseline mechanisms based on unrestricted welfare or conditional cooperation, by conditioning its generosity on available resources and temporarily sanctioning defectors by allocating fewer resources to them. Examining the AI policy allowed us to develop an explainable mechanism that performed similarly and was more popular among players. Deep reinforcement learning can be used to discover mechanisms that promote sustainable human behaviour.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。