arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.04748cs.AIcs.MA
收藏

当单智能体与技能取代多智能体系统以及何时会失败

When Single-Agent with Skills Replace Multi-Agent Systems and When They Fail

Trusted and Efficient AI (TEA) Lab(可信高效人工智能实验室);University of British Columbia(不列颠哥伦比亚大学);Vector Institute(向量研究所);CIFAR AI Chair(CIFAR人工智能 chair)

Xiaoxiao Li

AI总结:

研究探讨单智能体通过技能库替代多智能体系统在复杂推理中的有效性及局限性,提出基于认知科学的技能选择有限容量理论,并通过层次路由验证其可行性。

摘要:

多智能体AI系统已证明在复杂推理中具有有效性。这些系统通过专门的智能体协作,通过显式通信进行交互,但会带来显著的计算开销。一个自然的问题出现了:能否通过一个选择技能库中技能的单智能体来实现类似的模块化优势?我们通过将技能视为内部化的智能体行为来探讨这个问题。从这个角度来看,多智能体系统可以被编译成等效的单智能体系统,用技能选择代替智能体间通信。我们的初步实验表明,这种方法可以显著减少token使用和延迟,同时在推理基准上保持竞争性准确性。然而,这种效率引发了一个更深层次的问题,即很少有人关注:随着技能库的增长,技能选择如何扩展?借鉴认知科学的原则,我们提出LLM技能选择具有类似于人类决策的有限容量。我们研究了技能选择的扩展行为,并观察到一种引人注目的模式。而不是逐渐下降,选择准确性在临界库大小之前保持稳定,然后急剧下降,表明类似于人类认知容量限制的相变。此外,我们发现语义混淆在相似技能之间,而不是库大小本身,在这种退化中起着关键作用。这种观点表明,长期以来帮助人类管理复杂选择的层次组织,可能同样有助于AI系统。我们对层次路由的初步结果支持这一假设。这项工作为LLM中基于语义的技能选择的基本限制提出了新的问题,并提供了一个认知基础的框架和实际指南,用于设计可扩展的基于技能的智能体。

英文摘要:

Multi-agent AI systems have proven effective for complex reasoning. These systems are compounded by specialized agents, which collaborate through explicit communication, but incur substantial computational overhead. A natural question arises: can we achieve similar modularity benefits with a single agent that selects from a library of skills? We explore this question by viewing skills as internalized agent behaviors. From this perspective, a multi-agent system can be compiled into an equivalent single-agent system, trading inter-agent communication for skill selection. Our preliminary experiments suggest this approach can substantially reduce token usage and latency while maintaining competitive accuracy on reasoning benchmarks. However, this efficiency raises a deeper question that has received little attention: how does skill selection scale as libraries grow? Drawing on principles from cognitive science, we propose that LLM skill selection exhibits bounded capacity analogous to human decision-making. We investigate the scaling behavior of skill selection and observe a striking pattern. Rather than degrading gradually, selection accuracy remains stable up to a critical library size, then drops sharply, indicating a phase transition reminiscent of capacity limits in human cognition. Furthermore, we find evidence that semantic confusability among similar skills, rather than library size alone, plays a central role in this degradation. This perspective suggests that hierarchical organization, which has long helped humans manage complex choices, may similarly benefit AI systems. Our initial results with hierarchical routing support this hypothesis. This work opens new questions about the fundamental limits of semantic-based skill selection in LLMs and offers a cognitive-grounded framework and practical guidelines for designing scalable skill-based agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑