arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.04607cs.NIcs.AI
收藏

用于RAN优化和控制的深度强化学习

Deep reinforcement learning for RAN optimization and control

Carnegie Mellon University(卡内基梅隆大学);AT&T Labs(美国电话电报公司实验室)

Yu Chen, Jie Chen, Ganesh Krishnamurthi, Huijing Yang, Huahui Wang, Wenjie Zhao

摘要:

由于无线电接入网络(RAN)中业务的高度可变性,固定网络配置不够灵活以实现最佳性能。我们的供应商提供了eNodeB的几种设置来优化RAN性能,例如媒体访问控制调度器、负载平衡等。但是eNodeB配置的详细机制通常非常复杂,并且没有公开,更不用说需要考虑的大的关键性能指标(KPI)空间。这使得构建模拟器、离线调优或基于规则的解决方案变得困难。我们的目标是构建一个智能控制器,无需对RAN进行强有力的假设或领域知识,并且可以在没有监督的情况下全天候运行。为了实现这一目标,我们首先在实验室环境中构建了一个闭环控制测试床RAN,其中一个eNodeB由最大的无线供应商之一和四部智能手机提供。接下来,我们构建了一个双Q网络代理,该网络代理使用来自RAN的关键性能指标的实时反馈进行训练。我们的工作证明了在真实RAN网络环境中应用深度强化学习来提高网络性能的有效性。

英文摘要:

Due to the high variability of the traffic in the radio access network (RAN), fixed network configurations are not flexible enough to achieve optimal performance. Our vendors provide several settings of the eNodeB to optimize the RAN performance, such as media access control scheduler, loading balance, etc. But the detailed mechanisms of the eNodeB configurations are usually very complicated and not disclosed, not to mention the large key performance indicators (KPIs) space needed to be considered. These make constructing a simulator, offline tuning, or rule-based solutions difficult. We aim to build an intelligent controller without strong assumption or domain knowledge about the RAN and can run 24/7 without supervision. To achieve this goal, we first build a closed-loop control testbed RAN in a lab environment with one eNodeB provided by one of the largest wireless vendors and four smartphones. Next, we build a double Q network agent trained with the live feedback of the key performance indicators from the RAN. Our work proved the effectiveness of applying deep reinforcement learning to improve network performance in a real RAN network environment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑