arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.09550eess.SPcs.AIcs.LGcs.NI
收藏

基于强化学习的空中基站轨迹设计

Reinforcement Learning-Based Trajectory Design for the Aerial Base Stations

University of Toronto(多伦多大学)

Behzad Khamidehi, Elvino S. Sousa

摘要:

研究了多空中基站(ABS)通信网络的轨迹优化问题。目标是找到ABS的轨迹,使得每个ABS所服务的用户的总速率最大化。为了实现这一目标,除了最优轨迹设计之外,最优功率和子信道分配对于支持具有最高可能数据速率的用户也是非常重要的。为了解决这个复杂的问题,我们将其分为两个子问题:ABS轨迹优化子问题和联合功率和子信道分配子问题。然后,基于Q-学习方法,我们开发了一种分布式算法,有效地解决这些子问题,并不需要ABS和核心网络之间的显着信息量交换。仿真结果表明,虽然Q学习是一种无模型的强化学习技术,它具有显着的能力,训练ABS优化其轨迹的基础上收到的奖励信号,其中携带体面的信息,从网络的拓扑结构。

英文摘要:

In this paper, the trajectory optimization problem for a multi-aerial base station (ABS) communication network is investigated. The objective is to find the trajectory of the ABSs so that the sum-rate of the users served by each ABS is maximized. To reach this goal, along with the optimal trajectory design, optimal power and sub-channel allocation is also of great importance to support the users with the highest possible data rates. To solve this complicated problem, we divide it into two sub-problems: ABS trajectory optimization sub-problem, and joint power and sub-channel assignment sub-problem. Then, based on the Q-learning method, we develop a distributed algorithm which solves these sub-problems efficiently, and does not need significant amount of information exchange between the ABSs and the core network. Simulation results show that although Q-learning is a model-free reinforcement learning technique, it has a remarkable capability to train the ABSs to optimize their trajectories based on the received reward signals, which carry decent information from the topology of the network.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑