面向密集部署开放RAN的可扩展机器学习方法用于节能
Scalable machine learning-based approaches for energy saving in densely deployed Open RAN
AI总结:
本文提出基于深度强化学习的节能方案,通过xApps和联邦DRL方法控制RUs的激活与睡眠模式,实现网络能耗降低和服务质量保障。
摘要:
密集部署的基站负责无线电接入网(RAN)中大部分能耗。尽管这些部署对于在繁忙时段提供所需数据速率至关重要,但通过将部分基站切换为睡眠模式并保持其他基站的覆盖和服务质量,网络可实现节能。受益于开放RAN在嵌入机器学习(ML)到网络操作中的灵活性,本文提出基于深度强化学习(DRL)的节能解决方案。首先,我们提出了三种不同的DRL方法,以xApps的形式控制最多6个无线电单元(RUs)的激活/睡眠模式,从近实时RAN智能控制器(RIC)。我们还提出了一种进一步可扩展的联邦DRL解决方案,其中聚合器作为rApp在非实时RIC中,本地代理作为xApps。我们的模拟结果展示了所提出方法的收敛性。我们还比较了联邦DRL在三种布局中的性能,覆盖6-24个RUs和500-1000m区域,包括复合多区域场景。结果表明,我们的联邦TD3算法在收敛速度、网络能耗节省和训练能耗方面分别达到43.75%、超过50%和37.4%的提升,同时保持服务质量并提高策略的鲁棒性。
英文摘要:
Densely deployed base stations are responsible for the majority of the energy consumed in Radio access network (RAN). While these deployments are crucial to deliver the required data rate in busy hours of the day, the network can save energy by switching some of them to sleep mode and maintain the coverage and quality of service with the other ones. Benefiting from the flexibility provided by the Open RAN in embedding machine learning (ML) in network operations, in this work we propose Deep Reinforcement Learning (DRL)-based energy saving solutions. Firstly we propose 3 different DRL-based methods in the form of xApps which control the Active/Sleep mode of up to 6 radio units (RUs) from Near Real time RAN Intelligent Controller (RIC). We also propose a further scalable federated DRL-based solution with an aggregator as an rApp in None Real time RIC and local agents as xApps. Our simulation results present the convergence of the proposed methods. We also compare the performance of our federated DRL across three layouts spanning 6--24 RUs and 500--1000\,m regions, including a composite multi-region scenario. The results show that our proposed federated TD3 algorithm achieves up to 43.75\% faster convergence, more than 50\% network energy saving and 37. 4\% lower training energy versus centralized baselines, while maintaining the quality of service and improving the robustness of the policy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。