arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2508.03345cs.AI
收藏

边缘智能系统中的自适应AI智能体部署与迁移

Adaptive AI Agent Placement and Migration in Edge Intelligence Systems

Institute of Artificial Intelligence and Future Networks, Beijing Normal University, China(人工智能与未来网络研究院,北京师范大学,中国);Faculty of Arts and Sciences, Beijing Normal University, China(文理学院,北京师范大学,中国);Department of Computer Science and Engineering, Shanghai Jiao Tong University, China(计算机科学与工程系,上海交通大学,中国);College of Information Engineering, Zhejiang University of Technology, China(信息工程学院,浙江工业大学,中国)

Xingdan Wang, Jiayi He, Zhiqing Tang, Jianxiong Guo, Jiong Lou, Liping Qian, Tian Wang, Weijia Jia

AI总结:

针对边缘环境中部署AI智能体的延迟与资源挑战,提出基于蚁群算法和LLM优化的自适应放置与迁移框架,显著降低部署延迟和迁移成本。

摘要:

ChatGPT和Claude等大语言模型的兴起,催生了对能够实时处理任务的AI智能体的需求。然而,将数据密集型、多模态的边缘工作负载迁移到传统上用于智能体部署的云数据中心,会引入显著的延迟。在边缘部署AI智能体可以提高效率并减少延迟。然而,边缘环境由于资源有限且异构,带来了挑战。为移动用户维持服务质量需要智能体迁移,而AI智能体协调大语言模型、任务规划、记忆和外部工具的复杂性使这一过程变得复杂。本文提出了首个针对动态边缘环境中基于大语言模型的AI智能体的系统性部署与管理解决方案。我们提出了一种新颖的自适应框架,用于边缘智能系统中AI智能体的放置与迁移。我们的方法对资源约束和延迟/成本进行建模,利用蚁群算法和基于大语言模型的优化来实现高效决策。它自主放置智能体以优化资源利用和服务质量,并通过仅传输必要的状态实现轻量级智能体迁移。该解决方案在使用AgentScope的分布式系统上实现,并在全球分布的边缘服务器上进行了验证,显著降低了部署延迟和迁移成本。

英文摘要:

The rise of LLMs such as ChatGPT and Claude fuels the need for AI agents capable of real-time task handling. However, migrating data-intensive, multi-modal edge workloads to cloud data centers, traditionally used for agent deployment, introduces significant latency. Deploying AI agents at the edge improves efficiency and reduces latency. However, edge environments present challenges due to limited and heterogeneous resources. Maintaining QoS for mobile users necessitates agent migration, which is complicated by the complexity of AI agents coordinating LLMs, task planning, memory, and external tools. This paper presents the first systematic deployment and management solution for LLM-based AI agents in dynamic edge environments. We propose a novel adaptive framework for AI agent placement and migration in edge intelligence systems. Our approach models resource constraints and latency/cost, leveraging ant colony algorithms and LLM-based optimization for efficient decision-making. It autonomously places agents to optimize resource utilization and QoS and enables lightweight agent migration by transferring only essential state. Implemented on a distributed system using AgentScope and validated across globally distributed edge servers, our solution significantly reduces deployment latency and migration costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑