arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.08034cs.ITmath.IT
收藏

基于策略梯度深度强化学习的RSS UAV-BS三维移动性管理

RSS-Based UAV-BS 3-D Mobility Management via Policy Gradient Deep Reinforcement Learning

Mohammad Ghadir Khoshkholgh, Halim Yanikomeroglu

摘要:

我们解决了自主无人机安装基站(UAV-BS)的移动性管理,该基站向地面上的用户集群提供通信服务,而地理特征(例如,位置和边界)、用户的地理位置以及无线电环境的特性是未知的。UAVBS仅利用来自用户的接收信号强度(RSS),并相应地选择其(连续)3-D速度来建设性地导航,即,提高了传输的数据率。为了弥补模型的不足,我们采用了策略梯度深度强化学习。由于我们的方法不依赖于任何关于用户和无线电环境的特定信息,因此它是灵活的,并尊重隐私问题。我们的实验表明,尽管最低限度的可用信息的无人机-BS是能够区分高层建筑(往往是非视线为主)和郊区(主要是视线为主)的环境,这样,在前者(分别)。后者)倾向于减少(相应地,增加)它的高度和保持接近(分别)。远)到集群。我们进一步观察到,奖励函数的选择会影响代理的速度和能力,以坚持问题的限制,而不影响交付的数据率。

英文摘要:

We address the mobility management of an autonomous UAV-mounted base station (UAV-BS) that provides communication services to a cluster of users on the ground while the geographical characteristics (e.g., location and boundary) of the cluster, the geographical locations of the users, and the characteristics of the radio environment are unknown. UAVBS solely exploits the received signal strengths (RSS) from the users and accordingly chooses its (continuous) 3-D speed to constructively navigate, i.e., improving the transmitted data rate. To compensate for the lack of a model, we adopt policy gradient deep reinforcement learning. As our approach does not rely on any particular information about the users as well as the radio environment, it is flexible and respects the privacy concerns. Our experiments indicate that despite the minimum available information the UAV-BS is able to distinguish between high-rise (often non-line-of-sight dominant) and sub-urban (mainly line-of-sight dominant) environments such that in the former (resp. latter) it tends to reduce (resp. increase) its height and stays close (resp. far) to the cluster. We further observe that the choice of the reward function affects the speed and the ability of the agent to adhere to the problem constraints without affecting the delivered data rate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑