当云端智能体遇到设备端智能体:混合多智能体系统的经验教训
When Cloud Agents Meet Device Agents: Lessons from Hybrid Multi-Agent Systems
AI总结:
本文系统研究混合多智能体系统(结合设备端小模型和云端大模型)的设计空间,分析不同设计选择对功耗、成本和性能帕累托前沿的影响,发现最优架构高度依赖任务且前沿计算并不总能带来更好性能。
摘要:
智能体AI推理的设计空间涵盖两个极端:前沿大语言模型(LLM),通常托管在云端,在广泛任务上提供强性能但成本高昂;以及更具成本效益的小语言模型(SLM),适合设备端推理。结合设备端和云端模型的混合多智能体系统(MAS)提供了一种有前景的中间地带,但它们也引入了一个复杂且理解不足的设计空间,其中任务准确性、货币成本和边缘能耗紧密耦合;在缺乏通用设计原则的情况下,混合组件虽然并非最普遍的选择,但通常通过针对特定领域的临时决策引入。在这项工作中,我们更系统地审视了这一设计空间。我们调整了两种代表性的MAS架构以支持混合推理,并研究了单个设计选择如何沿着功耗、成本和性能的帕累托前沿移动工作点。我们的发现描绘了混合MAS设计的细致图景:虽然SLM可以有效受益于LLM的协助,但最优架构高度依赖任务,且更大的前沿计算并不总能转化为更好的性能。
英文摘要:
The design space of agentic AI inference spans two extremes: frontier large language models (LLMs), typically hosted in the cloud and offering strong performance across a wide range of tasks at substantially high cost, and more cost-efficient small language models (SLMs), which are amenable to on-device inference. Hybrid multi-agent systems (MASs) combining on-device and cloud models offer a promising middle ground, but they also introduce a complex and poorly understood design space in which task accuracy, monetary cost, and edge energy consumption are tightly coupled; in the absence of general design principles, hybrid components, although not the most prevalent choice, are typically introduced through ad hoc decisions tailored to specific domains. In this work, we examine this design space more systematically. We adapt two representative MAS architectures to support hybrid inference and study how individual design choices shift the operating point along the Pareto frontier of power, cost, and performance. Our findings paint a nuanced picture of hybrid MAS design: while SLMs can effectively benefit from LLM assistance, the optimal architecture is highly task-dependent, and greater frontier-level compute does not consistently translate to better performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。