arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.02369cs.MA
收藏

自由意志主义与功利主义治理体系下沟通与教学演化的多智能体强化学习研究

A Multi-agent Reinforcement Learning Study of Evolution of Communication and Teaching under Libertarian and Utilitarian Governing Systems

Aslan S. Dizaji

AI总结:

本研究通过扩展多智能体强化学习环境AI-Economist,模拟三种不同治理体系,探究其对智能体沟通与教学演化的影响,发现集体主义环境更利于语言对齐涌现,且语言对齐演化与社会平等呈正相关。

摘要:

实验室实验已表明,沟通在解决社会困境中发挥着重要作用。本文通过扩展混合动机多智能体强化学习环境AI-Economist(人工智能经济学家),旨在回答以下描述性问题:哪种治理体系更能促进智能体之间沟通与教学的涌现与演化?为回答该问题,本文为AI-Economist新增了投票机制,以模拟从完全自由意志主义到完全功利主义、沿个体主义-集体主义轴分布的三种不同治理体系。此外,本文进一步扩展了AI-Economist,加入了存在错位可能的沟通机制——这是信号博弈的一种变体:若智能体能够用相同字母指代互补的物质资源,它们便可共同建造房屋。本文还对AI-Economist做了另一项扩展,加入了存在错位可能的教学机制,这同样是信号博弈的一种变体:将半数智能体设为教师,它们知晓如何利用互补物质资源建造房屋,但无法实际建造房屋;另一半为学生,它们不具备该信息,但如果教师对其进行教学,学生便能实际建造这些房屋。研究发现了强有力的证据,表明完全功利主义体系这类集体主义环境更有利于沟通与教学的涌现,更准确地说,是更有利于语言对齐的演化。此外,本文还发现了部分证据,表明在集体主义治理体系下,通过沟通和教学实现的语言对齐演化,会让个体更倾向于优势不平等厌恶。因此,语言对齐的演化与社会平等之间存在正相关关系。

英文摘要:

Laboratory experiments have shown that communication plays an important role in solving social dilemmas. Here, by extending the AI-Economist, a mixed motive multi-agent reinforcement learning environment, I intend to find an answer to the following descriptive question: which governing system does facilitate the emergence and evolution of communication and teaching among agents? To answer this question, the AI-Economist is extended by a voting mechanism to simulate three different governing systems across individualistic-collectivistic axis, from full-libertarian to Full-Utilitarian governing systems. Moreover, the AI-Economist is further extended to include communication with possible misalignment, a variant of signalling game, by letting agents to build houses together if they are able to name mutually complement material resources by the same letter. Moreover, another extension is made to the AI-Economist to include teaching with possible misalignment, again a variant of signalling game, by letting half the agents as teachers who know how to use mutually complement material resources to build houses but are not capable of building actual houses, and the other half as students who do not have this information but are able to actually build those houses if teachers teach them. I found a strong evidence that collectivistic environment such as Full-Utilitarian system is more favourable for the emergence of communication and teaching, or more precisely, evolution of language alignment. Moreover, I found some evidence that evolution of language alignment through communication and teaching under collectivistic governing systems makes individuals more advantageously inequity averse. As a result, there is a positive correlation between evolution of language alignment and equality in the society.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑