Multi-Agent Collaboration Mechanisms: A Survey of LLMs
School of Computer Science and Information Technology, University College Cork(科克大学学院计算机科学与信息技术学院);Department of Information Convergence Engineering, Pusan National University(釜山国立大学信息融合工程系);School of Computer Science and Statistics, Trinity College Dublin(都柏林圣三一学院计算机科学与统计学院)
Khanh-Tung Tran, Dung Dao, Minh-Duong Nguyen, Quoc-Viet Pham, Barry O'Sullivan, Hoang D. Nguyen
With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent Systems (MASs) enable groups of intelligent agents to coordinate and solve complex tasks collectively at scale, transitioning from isolated models to collaboration-centric approaches. This work provides an extensive survey of the collaborative aspect of MASs and introduces an extensible framework to guide future research. Our framework characterizes collaboration mechanisms based on key dimensions: actors (agents involved), types (e.g., cooperation, competition, or coopetition), structures (e.g., peer-to-peer, centralized, or distributed), strategies (e.g., role-based or model-based), and coordination protocols. Through a review of existing methodologies, our findings serve as a foundation for demystifying and advancing LLM-based MASs toward more intelligent and collaborative solutions for complex, real-world use cases. In addition, various applications of MASs across diverse domains, including 5G/6G networks, Industry 5.0, question answering, and social and cultural settings, are also investigated, demonstrating their wider adoption and broader impacts. Finally, we identify key lessons learned, open challenges, and potential research directions of MASs towards artificial collective intelligence.
A Scalable Multi-LLM Collaboration System with Retrieval-based Selection and Exploration-Exploitation-Driven Enhancement
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Fudan University(复旦大学);Shanghai Jiao Tong University(上海交通大学)
MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Making
Massachusetts Institute of Technology(麻省理工学院);Yonsei University College of Medicine(延世大学医学院);Google Research(谷歌研究院);Seoul National University Hospital(首尔大学医院)
A Knowledge-driven Adaptive Collaboration of LLMs for Enhancing Medical Decision-making
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(莫扎德·本·扎耶德人工智能大学);University of Electronic Science and Technology of China(电子科学与技术大学);Swiss Federal Institute of Technology Lausanne (EPFL)(苏黎世联邦理工学院)
Regularized Multi-LLMs Collaboration for Enhanced Score-based Causal Discovery
University of New South Wales(新南威尔士大学);School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);School of Computing, Macquarie University(麦考瑞大学计算学院);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织数据61)
Synergistic Weak-Strong Collaboration by Aligning Preferences
Microsoft Research(微软研究院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Nanyang Technological University(南洋理工大学)
Reasoning LLMs in the Medical Domain: A Literature Survey
Fraunhofer IAIS - Department of Media Engineering(弗劳恩霍夫研究所媒体工程部门);University of Bonn - Department of Computer Science(波恩大学计算机科学系);West-AI - Federal Ministry of Education and Research(西德人工智能 - 教育与研究部)
When LLMs Team Up: The Emergence of Collaborative Affective Computing
Department of Computing, Hong Kong Polytechnic University(香港理工大学计算机系);School of Data Science, Lingnan University(岭南大学数据科学学院);School of Computer Science and the Data Science Institute, University of Technology Sydney(悉尼大学计算机科学学院和数据科学研究所);Education University of Hong Kong(香港教育大学)
FirmCORe: A Benchmark for Structured Reasoning about Inter-Firm Collaboration Opportunities
Southwest University of Finance and Economics(西南财经大学);Nanyang Technological University(南洋理工大学);Beijing University of Post and Telecommunication(北京邮电大学)
An AI-Powered Research Assistant in the Lab: A Practical Guide for Text Analysis Through Iterative Collaboration with LLMs
Universidad Externado de Colombia(哥伦比亚外部大学);Universidad de los Andes(安第斯大学);University of Michigan(密歇根大学);Rice University(莱斯大学);University of Toronto(多伦多大学);University of Southampton(南安普顿大学)
RAM2C: A Liberal Arts Educational Chatbot based on Retrieval-augmented Multi-role Multi-expert Collaboration
Center for Brain Inspired Computing Research (CBICR), Tsinghua University(清华大学脑启发计算研究中心);Optical Memory National Engineering Research Center, Tsinghua University(清华大学光存储国家工程研究中心);Tsinghua University-China Electronics Technology HIK Group Co. Joint Research Center for Brain-inspired Computing(清华大学-中国电子 hik 集团联合脑启发计算研究中心);IDG/McGovern Institute for Brain Research, Tsinghua University(清华大学 IDG/麦戈文脑科学研究院);Tsinghua University(清华大学)
AIn't Nothing But a Survey? Using Large Language Models for Coding German Open-Ended Survey Responses on Survey Motivation
Social Data Science & AI Lab, LMU Munich(社会科学与人工智能实验室,慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);University of Maryland, College Park(马里兰大学学院公园分校);GESIS – Leibniz Institute for the Social Sciences(莱比锡社会科学研究机构)
From Visual Perception to Deep Empathy: An Automated Assessment Framework for House-Tree-Person Drawings Using Multimodal LLMs and Multi-Agent Collaboration
Tsinghua University(清华大学);Shenzhen University(深圳大学);University of Oxford(牛津大学);Shenzhen Institute of Education Sciences(深圳市教育科学研究院);Guangzhou University of Chinese Medicine(广州中医药大学);Harbin Institute of Technology(哈尔滨工业大学)
Hybrid Panels: Toward Human-AI Collaboration in Survey Research
GESIS - Leibniz Institute for the Social Sciences(莱布尼茨社会科学研究所(GESIS));Heidelberg University(海德堡大学);Heinrich Heine University of Düsseldorf(杜塞尔多夫海因里希·海涅大学);RWTH Aachen University(亚琛工业大学)