arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.16622cs.MAcs.NE
收藏

模仿与协作性沟通的出现

Mimicry and the Emergence of Cooperative Communication

Dylan Cope, Peter McBurney

AI总结:

本文研究通过模仿外部有用信号促进多智能体协作沟通的出现,形式化分析其优化效应,并在空间资源收集模拟中验证进化优化与强化学习均受益。

摘要:

在许多情境中,智能体之间的沟通是协作性多智能体系统的关键组成部分,然而,这种沟通可能难以学习或演化。在本文中,我们研究了一种促进沟通出现的简单方式。具体而言,我们探讨了当智能体能够模仿预先存在的、外部生成的有用信号时所产生的效果。其核心思想在于,这些信号激励听众发展出积极的响应,而这些响应随后也可以被模仿这些信号的说话者所调用。这项研究首先对该问题进行形式化,并证明这种形式的模仿会改变优化动态,并可能提供逃离非沟通性局部最优的机会。随后,我们通过一个模拟来实证探索该问题,在该模拟中,空间上分布的智能体必须通过沟通来收集资源。我们的结果表明,进化优化和强化学习都可能从这种干预中受益。

英文摘要:

In many situations, communication between agents is a critical component of cooperative multi-agent systems, however, it can be difficult to learn or evolve. In this paper, we investigate a simple way in which the emergence of communication may be facilitated. Namely, we explore the effects of when agents can mimic preexisting, externally generated useful signals. The key idea here is that these signals incentivise listeners to develop positive responses, that can then also be invoked by speakers mimicking those signals. This investigation starts with formalising this problem, and demonstrating that this form of mimicry changes optimisation dynamics and may provide the opportunity to escape non-communicative local optima. We then explore the problem empirically with a simulation in which spatially situated agents must communicate to collect resources. Our results show that both evolutionary optimisation and reinforcement learning may benefit from this intervention.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑