arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.00550cs.DC
收藏

面向弹性云资源扩展的协作式多智能体强化学习方法

Collaborative Multi-Agent Reinforcement Learning Approach for Elastic Cloud Resource Scaling

Bruce Fang, Danyi Gao

AI总结:

本文提出一种基于多智能体系统的弹性云资源扩展优化方法,采用集中训练与分散执行强化学习框架及轻量级状态预测模型,实现全局协调与未来负载趋势识别,实验证明其在资源利用率、SLA违规控制和调度延迟上优于现有方法。

摘要:

本文探讨了云计算环境中资源快速变化和任务负载高度不确定的挑战。提出了一种基于多智能体系统的弹性云资源扩展优化方法。该方法部署多个自主智能体并行感知资源状态并做出局部决策。在保持系统分布式特性的同时,引入协作价值函数实现全局协调。这提高了资源调度的响应速度并增强了整体系统性能。为增强系统预见性,设计了轻量级状态预测模型。它辅助智能体识别未来工作负载趋势并优化扩展动作的选择。对于策略训练,该方法采用集中训练与分散执行(CTDE)的强化学习框架。使智能体能够在信息不完整条件下有效学习并协调策略。本文还构建了典型云场景,包括多租户和突发流量,以评估所提方法。评估侧重于资源隔离、服务质量保证和鲁棒性。实验结果表明,所提多智能体扩展策略在资源利用率、SLA违规控制和调度延迟方面优于现有方法。结果展示了强适应性和智能调节能力。为解决复杂云平台中的弹性资源扩展问题提供了高效可靠的新途径。

英文摘要:

This paper addresses the challenges of rapid resource variation and highly uncertain task loads in cloud computing environments. It proposes an optimization method for elastic cloud resource scaling based on a multi-agent system. The method deploys multiple autonomous agents to perceive resource states in parallel and make local decisions. While maintaining the distributed nature of the system, it introduces a collaborative value function to achieve global coordination. This improves the responsiveness of resource scheduling and enhances overall system performance. To strengthen system foresight, a lightweight state prediction model is designed. It assists agents in identifying future workload trends and optimizes the selection of scaling actions. For policy training, the method adopts a centralized training and decentralized execution reinforcement learning framework. This enables agents to learn effectively and coordinate strategies under conditions of incomplete information. The paper also constructs typical cloud scenarios, including multi-tenancy and burst traffic, to evaluate the proposed method. The evaluation focuses on resource isolation, service quality assurance, and robustness. Experimental results show that the proposed multi-agent scaling strategy outperforms existing methods in resource utilization, SLA violation control, and scheduling latency. The results demonstrate strong adaptability and intelligent regulation. This provides an efficient and reliable new approach to solving the problem of elastic resource scaling in complex cloud platforms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑