arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.09707eess.SP
收藏

使用深度强化学习的智能干扰管理xApp

Smart Interference Management xApp using Deep Reinforcement Learning

Mahdi Eskandari, Shipra Kapoor, Keith Briggs, Arman Shojaeifard, Huiling Zhu, Alain Mourad

摘要:

干扰仍然是蜂窝无线电接入网络(RAN)部署中的关键限制因素。有效的、数据驱动的、自适应的无线电资源管理(RRM)解决方案对于解决干扰至关重要,从而实现所需的性能水平,特别是在小区边缘。在未来的网络架构中,RAN智能控制器(RIC)运行近实时应用程序,称为xApps,被认为是一个潜在的组件,使RRM。本文基于深度强化学习(RL)xApp,提出了一种联合子带掩蔽和功率管理的智能干扰管理方法。子带资源掩蔽问题被公式化为马尔可夫决策过程(MDP),其可以采用深度RL来近似策略函数以及避免传统的基于表格的方法的极高的计算和存储成本来解决。开发的xApp在存储和计算方面都是可扩展的。仿真结果表明,所提出的方法相比分散基线的优势,在小区中心和小区边缘的用户速率,能量效率和计算效率之间的权衡。

英文摘要:

Interference continues to be a key limiting factor in cellular radio access network (RAN) deployments. Effective, data-driven, self-adapting radio resource management (RRM) solutions are essential for tackling interference, and thus achieving the desired performance levels particularly at the cell-edge. In future network architecture, RAN intelligent controller (RIC) running with near-real-time applications, called xApps, is considered as a potential component to enable RRM. In this paper, based on deep reinforcement learning (RL) xApp, a joint sub-band masking and power management is proposed for smart interference management. The sub-band resource masking problem is formulated as a Markov Decision Process (MDP) that can be solved employing deep RL to approximate the policy functions as well as to avoid extremely high computational and storage costs of conventional tabular-based approaches. The developed xApp is scalable in both storage and computation. Simulation results demonstrate advantages of the proposed approach over decentralized baselines in terms of the trade-off between cell-centre and cell-edge user rates, energy efficiency and computational efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑