arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.13639cs.AIcs.MA
收藏

通过基于熵的理解评估和经验检索实现异构大语言模型多智能体系统的引导协作

Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrieval

Faculty of Data Science, City University of Macau(数据科学学院,澳门城市大学);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences)(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心,齐鲁工业大学(山东科学院));Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science(山东省计算能力互联网与服务计算重点实验室,山东省计算机科学基础研究中心)

Linlin Wang, Tianqing Zhu, Laiqiao Qin, Longxiang Gao, Wanlei Zhou

AI总结:

本文提出基于熵的理解评估和经验检索的引导协作框架,通过自适应引导和RAG机制提升异构多智能体系统的协作效果和稳定性。

摘要:

随着大型语言模型(LLMs)在推理、规划和复杂任务生成方面取得突破性进展,人工智能系统正从孤立的单智能体架构向具有协作智能的多智能体系统过渡。然而,在异构多智能体系统(HMAS)中,智能体之间的能力差异导致一致的认知问题,强弱模型难以有效贡献。我们定义协作为强弱系统。通过全面实验,我们揭示了强弱系统中一个反直觉现象:强弱协作可能弱于弱弱组合,表明认知不匹配是限制异构合作的关键瓶颈。为克服这些挑战,我们提出了一种基于熵的自适应引导框架,该框架动态地将引导与每个智能体的认知状态对齐。该框架通过多维熵度量量化弱智能体的理解能力——涵盖表达、不确定性、结构、连贯性和相关性,并自适应地调整引导强度在轻度、中度和高强度级别。此外,引入了检索增强生成(RAG)机制以保留成功的协作经验,使系统能够实现即时适应和长期学习。在三个基准数据集GSM8K、MBPP和CVRP上的广泛实验表明,我们的方法一致地提高了异构协作的有效性和稳定性。结果表明,自适应引导不仅缓解了认知不平衡,还建立了通往更加稳健、协作的多智能体智能的可扩展路径。

英文摘要:

With recent breakthroughs in large language models (LLMs) for reasoning, planning, and complex task generation, artificial intelligence systems are transitioning from isolated single-agent architectures to multi-agent systems with collaborative intelligence. However, in heterogeneous multi-agent systems (HMAS), capability differences among agents give rise to consistent cognitive problems, where strong and weak models fail to contribute effectively. We define the collaboration as a strong-weak system. Through comprehensive experiments, we disclose a counterintuitive phenomenon in the strong-weak system: a strong-weak collaboration may under-perform weak-weak combinations, revealing that cognitive mismatching are key bottlenecks limiting heterogeneous cooperation. To overcome these challenges, we propose an Entropy-Based Adaptive Guidance Framework that dynamically aligns the guidance with the cognitive state of each agent. The framework quantifies the understanding of weak agents through multi-dimensional entropy metrics - covering expression, uncertainty, structure, coherence, and relevance - and adaptively adjusts the intensity of the guidance at light, moderate and intensive levels. Furthermore, a Retrieval-Augmented Generation (RAG) mechanism is incorporated to retain successful collaboration experiences, enabling both immediate adaptation and long-term learning. Extensive experiments on three benchmark datasets, GSM8K, MBPP, and CVRP demonstrate that our approach consistently enhances the effectiveness and stability of heterogeneous collaboration. The results highlight that adaptive guidance not only mitigates cognitive imbalance but also establishes a scalable pathway toward more robust, cooperative multi-agent intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑