arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.08796cs.LGcs.AIcs.SYeess.SY
收藏

基于模型的残差策略学习及其在天线控制中的应用

Model Based Residual Policy Learning with Applications to Antenna Control

KTH Royal Institute of Technology(瑞典皇家理工学院);Ericsson Research(爱立信研究院)

Viktor Eriksson Möllerstedt, Alessio Russo, Maxime Bouton

AI总结:

针对天线倾角控制问题,提出基于模型的残差策略学习方法MBRPL,通过基于模型的方法增强现有策略,显著提升了样本效率并减少了环境交互,为算法在实际网络中的部署迈出一步。

摘要:

不可微控制器和基于规则的策略被广泛用于控制真实系统,如电信网络和机器人。具体而言,移动网络基站天线的参数可以通过这些策略动态配置,以改善用户覆盖和服务质量。受天线倾角控制问题的启发,我们提出了一种实用的强化学习(RL)方法——基于模型的残差策略学习(MBRPL)。MBRPL通过基于模型的方法增强现有策略,与现有的RL方法相比,提高了样本效率并减少了与实际环境的交互次数。据我们所知,这是首篇研究天线控制中基于模型方法的论文。实验结果表明,该方法在提供强劲初始性能的同时,较以往的RL方法提升了样本效率,这向在实际网络中部署这些算法迈进了一步。

英文摘要:

Non-differentiable controllers and rule-based policies are widely used for controlling real systems such as telecommunication networks and robots. Specifically, parameters of mobile network base station antennas can be dynamically configured by these policies to improve users coverage and quality of service. Motivated by the antenna tilt control problem, we introduce Model-Based Residual Policy Learning (MBRPL), a practical reinforcement learning (RL) method. MBRPL enhances existing policies through a model-based approach, leading to improved sample efficiency and a decreased number of interactions with the actual environment when compared to off-the-shelf RL methods.To the best of our knowledge, this is the first paper that examines a model-based approach for antenna control. Experimental results reveal that our method delivers strong initial performance while improving sample efficiency over previous RL methods, which is one step towards deploying these algorithms in real networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑