arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.12899eess.SYcs.AIcs.LGcs.MAcs.SY
收藏

基于通用策略的多智能体强化学习天线倾角优化

Multi-Agent Reinforcement Learning with Common Policy for Antenna Tilt Optimization

Ericsson(爱立信)

Adriano Mendo, Jose Outes-Carnero, Yak Ng-Molina, Juan Ramiro-Moreno

AI总结:

本文提出一种共享通用策略的多智能体强化学习方法,通过预训练和增量调整优化无线网络小区参数(如远程天线倾角),显著提升了网络性能。

摘要:

本文提出了一种通过调整小区参数来优化无线网络的方法,这些参数既影响被优化小区的性能,也影响周边小区的性能。该方法使用多个强化学习智能体,它们共享一个通用策略,并考虑来自相邻小区的信息以确定状态和奖励。为了避免在学习初期损害网络性能,智能体在早期的离线学习阶段进行了预训练。在此阶段,利用静态网络模拟器的反馈并考虑多种场景,获得了一个初始策略。最后,智能体可以通过建议微小的增量变化来智能地调整测试网络的小区参数,缓慢引导网络达到最优配置。智能体利用在预训练阶段从模拟器中获得的经验提出最优变化,同时也能在每次变化后继续从当前网络读数中学习。结果表明,当应用于远程天线倾角优化时,所提方法显著提升了基于专家系统方法已提供的性能增益。当与一种状态和奖励未包含相邻小区信息的类似方法相比时,这种方法的显著增益确实得到了观察验证。

英文摘要:

This paper presents a method for optimizing wireless networks by adjusting cell parameters that affect both the performance of the cell being optimized and the surrounding cells. The method uses multiple reinforcement learning agents that share a common policy and take into account information from neighboring cells to determine the state and reward. In order to avoid impairing network performance during the initial stages of learning, agents are pre-trained in an earlier phase of offline learning. During this phase, an initial policy is obtained using feedback from a static network simulator and considering a wide variety of scenarios. Finally, agents can intelligently tune the cell parameters of a test network by suggesting small incremental changes, slowly guiding the network toward an optimal configuration. The agents propose optimal changes using the experience gained with the simulator in the pre-training phase, but they can also continue to learn from current network readings after each change. The results show how the proposed approach significantly improves the performance gains already provided by expert system-based methods when applied to remote antenna tilt optimization. The significant gains of this approach have truly been observed when compared with a similar method in which the state and reward do not incorporate information from neighboring cells.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑