arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.01663cs.CLcs.AIcs.CC
收藏

CMAT:用于增强小型语言模型的多智能体协作调优框架

CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models

East China Jiaotong University(华东交通大学);University of Minnesota - Twin Cities(明尼苏达大学双城分校);Guangdong University of Technology(广东工业大学);University of Electronic Science and Technology of China(电子科技大学);University of Toronto(多伦多大学);East China Normal University(华东师范大学)

Xuechen Liang, Yangfan He, Meiling Tao, Yinghui Xia, Jianhui Wang, Tianyu Shi, Jun Wang, JingSong Yang

AI总结:

针对大型语言模型依赖人类输入引导对话的问题,本研究提出TinyAgent模型及协作式多智能体调优(CMAT)框架,通过环境反馈自适应更新权重增强智能体能力,TinyAgent-7B参数更少却性能媲美GPT-3.5。

摘要:

开源大型语言模型(LLMs)极大推动了自然语言处理领域的发展,在各类任务中展现出令人印象深刻的性能。尽管LLMs取得显著进步,其有效运行仍严重依赖人类输入来准确引导对话流程,而智能体调优是关键优化技术,涉及人类对模型的调整以更好响应此类引导。为解决这一依赖问题,我们的工作引入TinyAgent模型,其在精心构建的高质量数据集上训练。我们还提出协作式多智能体调优(CMAT)框架,这是一个创新系统,旨在通过基于环境反馈的自适应权重更新增强语言智能体能力。该框架促进多个智能体间的协作学习与实时适应,提升其上下文感知和长期记忆能力。本研究提出新的通信智能体框架,将多智能体系统与环境反馈机制整合,提供可扩展方法探索协作行为。值得注意的是,我们的TinyAgent-7B模型虽参数更少,性能却与GPT-3.5相当,标志着LLMs效率与有效性的大幅提升。

英文摘要:

Open large language models (LLMs) have significantly advanced the field of natural language processing, showcasing impressive performance across various tasks.Despite the significant advancements in LLMs, their effective operation still relies heavily on human input to accurately guide the dialogue flow, with agent tuning being a crucial optimization technique that involves human adjustments to the model for better response to such guidance.Addressing this dependency, our work introduces the TinyAgent model, trained on a meticulously curated high-quality dataset. We also present the Collaborative Multi-Agent Tuning (CMAT) framework, an innovative system designed to augment language agent capabilities through adaptive weight updates based on environmental feedback. This framework fosters collaborative learning and real-time adaptation among multiple intelligent agents, enhancing their context-awareness and long-term memory. In this research, we propose a new communication agent framework that integrates multi-agent systems with environmental feedback mechanisms, offering a scalable method to explore cooperative behaviors. Notably, our TinyAgent-7B model exhibits performance on par with GPT-3.5, despite having fewer parameters, signifying a substantial improvement in the efficiency and effectiveness of LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑