arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.07155cs.AIcs.CLcs.MAcs.NIcs.SI
收藏

扩展基于大语言模型的多智能体协作

Scaling Large Language Model-based Multi-Agent Collaboration

Tsinghua University(清华大学);Peng Cheng Laboratory(鹏城实验室)

Chen Qian, Zihao Xie, YiFei Wang, Wei Liu, Kunlun Zhu, Hanchen Xia, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, Zhiyuan Liu, Maosong Sun

AI总结:

本文提出基于有向无环图的 MacNet 多智能体协作框架,验证千余智能体协同可行,并发现性能随智能体数量呈逻辑斯蒂增长的协作缩放律。

摘要:

近期,大语言模型驱动的自主智能体取得的突破表明,多智能体协作往往能够通过集体推理超越每个个体。受神经缩放律(增加神经元可提升性能)启发,本研究探讨持续增加协作智能体是否能带来类似收益。在技术上,我们利用有向无环图将智能体组织成多智能体协作网络(MacNet),并在该网络上以拓扑方式编排其交互式推理,以自主解决任务。大量评估表明,该方法有效支持超过一千个智能体之间的协作,且不规则拓扑优于规则拓扑。我们还发现了一条协作缩放律:随着智能体规模扩大,整体性能呈逻辑斯蒂增长模式,并且协作涌现早于传统神经涌现。我们推测,这可能是因为扩展智能体会促进其在交互式反思与改进过程中的多维度考量,从而产生更全面的产物。代码可在 https://github.com/OpenBMB/ChatDev/tree/macnet 获取。

英文摘要:

Recent breakthroughs in large language model-driven autonomous agents have revealed that multi-agent collaboration often surpasses each individual through collective reasoning. Inspired by the neural scaling law--increasing neurons enhances performance, this study explores whether the continuous addition of collaborative agents can yield similar benefits. Technically, we utilize directed acyclic graphs to organize agents into a multi-agent collaboration network (MacNet), upon which their interactive reasoning is topologically orchestrated for autonomous task solving. Extensive evaluations reveal that it effectively supports collaboration among over a thousand agents, with irregular topologies outperforming regular ones. We also identify a collaborative scaling law--the overall performance follows a logistic growth pattern as agents scale, with collaborative emergence occurring earlier than traditional neural emergence. We speculate this may be because scaling agents catalyzes their multidimensional considerations during interactive reflection and refinement, thereby producing more comprehensive artifacts. The code is available at https://github.com/OpenBMB/ChatDev/tree/macnet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑