arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.13446cs.LGcs.MAcs.RO
收藏

ModGNN:基于模块化图神经网络结构的多智能体系统专家策略近似

ModGNN: Expert Policy Approximation in Multi-Agent Systems with a Modular Graph Neural Network Architecture

University of Cambridge(剑桥大学)

Ryan Kortvelesy, Amanda Prorok

摘要:

最近在多智能体领域的工作表明,图神经网络(GNNs)有希望学习复杂的协调策略。然而,大多数当前的方法使用图卷积网络(GCN)的较小变体,其将卷积应用于由多代理系统形成的通信图。在本文中,我们调查是否可以提高GCN的性能和推广。我们引入了ModGNN,这是一个分散的框架,可以作为GCN的推广,提供更多的灵活性。为了验证我们的假设,我们评估了ModGNN在多智能体群集问题中的几个基线的实现。我们进行消融分析,以表明我们的框架中最重要的组成部分是一个不存在于GCN。通过改变代理的数量,我们还证明了ModGNN的应用程序不可知的实现具有更好的泛化到新环境的能力。

英文摘要:

Recent work in the multi-agent domain has shown the promise of Graph Neural Networks (GNNs) to learn complex coordination strategies. However, most current approaches use minor variants of a Graph Convolutional Network (GCN), which applies a convolution to the communication graph formed by the multi-agent system. In this paper, we investigate whether the performance and generalization of GCNs can be improved upon. We introduce ModGNN, a decentralized framework which serves as a generalization of GCNs, providing more flexibility. To test our hypothesis, we evaluate an implementation of ModGNN against several baselines in the multi-agent flocking problem. We perform an ablation analysis to show that the most important component of our framework is one that does not exist in a GCN. By varying the number of agents, we also demonstrate that an application-agnostic implementation of ModGNN possesses an improved ability to generalize to new environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑