The Good Shepherd:一个用于机制设计的Oracle Agent
The Good Shepherd: An Oracle Agent for Mechanism Design
摘要:
从社交网络到交通路由,人工学习代理在现代机构中发挥着核心作用。因此,我们必须了解如何利用这些系统来促进与我们自己的价值观和愿望相一致的结果和行为。虽然多智能体学习近年来受到了相当大的关注,但人工智能体主要是在与固定的非学习合作伙伴进行交互时进行评估的。虽然这一评价方案有其优点,但它未能捕捉到必须处理适应性强和不断学习的组成部分的机构所面临的动态。在这里,我们解决这个限制,并构建代理(“机制”),表现良好时,评估其自适应合作伙伴(“参与者”)的学习轨迹。我们提出的算法由两个嵌套的学习循环组成:一个内部循环,参与者学习最好地响应固定的机制;和一个外部循环,机制代理根据经验更新其策略。我们报告了我们的机制代理与人工学习代理和人类作为合作伙伴配对时的性能。我们的研究结果表明,我们的机制能够引导参与者的战略走向有利的结果,现代机构有效地和自动地影响其选民的战略和行为的路径。
英文摘要:
From social networks to traffic routing, artificial learning agents are playing a central role in modern institutions. We must therefore understand how to leverage these systems to foster outcomes and behaviors that align with our own values and aspirations. While multiagent learning has received considerable attention in recent years, artificial agents have been primarily evaluated when interacting with fixed, non-learning co-players. While this evaluation scheme has merit, it fails to capture the dynamics faced by institutions that must deal with adaptive and continually learning constituents. Here we address this limitation, and construct agents ("mechanisms") that perform well when evaluated over the learning trajectory of their adaptive co-players ("participants"). The algorithm we propose consists of two nested learning loops: an inner loop where participants learn to best respond to fixed mechanisms; and an outer loop where the mechanism agent updates its policy based on experience. We report the performance of our mechanism agents when paired with both artificial learning agents and humans as co-players. Our results show that our mechanisms are able to shepherd the participants strategies towards favorable outcomes, indicating a path for modern institutions to effectively and automatically influence the strategies and behaviors of their constituents.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。