双环控制在DCVerse中的应用:通过数字孪生推进AI在数据中心的可靠部署
Dual-Loop Control in DCVerse: Advancing Reliable Deployment of AI in Data Centers via Digital Twins
AI总结:
本文提出双环控制框架,通过数字孪生技术解决数据中心能源效率与故障风险平衡问题,实现更可靠的AI部署,实验显示能提升能效并满足服务等级协议要求。
摘要:
现代数据中心规模和复杂性增加,平衡能源效率与故障风险面临挑战。尽管深度强化学习(DRL)在智能控制中有潜力,但其在关键系统中的部署受限于数据稀缺和缺乏实时预评估机制。本文引入双环控制框架(DLCF),一种基于数字孪生的架构,旨在克服这些挑战。该框架包含三个核心组件:物理系统、数字孪生和多样化的DRL代理政策库。这些组件通过双环机制交互,包括实时数据采集、数据同化、DRL策略训练、预评估和专家验证。理论分析展示了DLCF如何提高样本效率、泛化能力、安全性和最优性。利用DLCF,我们实现了DCVerse平台,并通过真实数据中心冷却系统的案例研究验证了其有效性。评估显示,我们的方法在不违反SLA要求的情况下,相比传统控制策略实现了高达4.09%的节能。此外,该框架提高了策略可解释性并支持更可信的DRL部署。本工作为数据中心可靠的AI控制提供了基础,并指明了未来向系统级优化扩展的方向。
英文摘要:
The growing scale and complexity of modern data centers present major challenges in balancing energy efficiency with outage risk. Although Deep Reinforcement Learning (DRL) shows strong potential for intelligent control, its deployment in mission-critical systems is limited by data scarcity and the lack of real-time pre-evaluation mechanisms. This paper introduces the Dual-Loop Control Framework (DLCF), a digital twin-based architecture designed to overcome these challenges. The framework comprises three core entities: the physical system, a digital twin, and a policy reservoir of diverse DRL agents. These components interact through a dual-loop mechanism involving real-time data acquisition, data assimilation, DRL policy training, pre-evaluation, and expert verification. Theoretical analysis shows how DLCF can improve sample efficiency, generalization, safety, and optimality. Leveraging DLCF, we implemented the DCVerse platform and validated it through case studies on a real-world data center cooling system. The evaluation shows that our approach achieves up to 4.09% energy savings over conventional control strategies without violating SLA requirements. Additionally, the framework improves policy interpretability and supports more trustworthy DRL deployment. This work provides a foundation for reliable AI-based control in data centers and points toward future extensions for holistic, system-wide optimization.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。