arXiv 2011.137442020-11-27cs.LGeess.SP

基于强化学习的单元互联无人机联合路径和能量优化

Reinforcement Learning-based Joint Path and Energy Optimization of Cellular-Connected Unmanned Aerial Vehicles

KTH Royal Institute of Technology（瑞典皇家理工学院）

Arash Hooshmand

备注：: 8 pages, 4 figures

摘要：

近年来，无人机（UAV）引起了人们极大的研究兴趣。特别是在物联网领域，具有互联网连接的无人机是主要需求之一。此外，能量约束，即电池限制，是一个瓶颈的无人机，可以限制其应用。我们正在努力解决和解决能源问题。因此，提出了一种用于蜂窝连接的UAV的路径规划方法，该方法将使UAV能够通过在配备有发电站（PS）的某些位置充电来在比其电池范围大得多的区域中规划其路径。除了能量约束之外，还存在禁飞区;例如，由于空对空（A2 A）和空对地（A2 G）干扰，或者由于缺乏必要的连通性，这在UAV的轨迹优化中施加了额外的约束。禁飞区确定了应该避免的不可行区域。我们使用了一个强化学习（RL）分层扩展典型的短程路径规划器，考虑电池充电和解决问题的无人机在长期任务。针对无人机在大范围内飞行的问题进行了仿真，Q-学习算法可以使无人机找到最优路径和补给策略。

英文摘要：

Unmanned Aerial Vehicles (UAVs) have attracted considerable research interest recently. Especially when it comes to the realm of Internet of Things, the UAVs with Internet connectivity are one of the main demands. Furthermore, the energy constraint i.e. battery limit is a bottle-neck of the UAVs that can limit their applications. We try to address and solve the energy problem. Therefore, a path planning method for a cellular-connected UAV is proposed that will enable the UAV to plan its path in an area much larger than its battery range by getting recharged in certain positions equipped with power stations (PSs). In addition to the energy constraint, there are also no-fly zones; for example, due to Air to Air (A2A) and Air to Ground (A2G) interference or for lack of necessary connectivity that impose extra constraints in the trajectory optimization of the UAV. No-fly zones determine the infeasible areas that should be avoided. We have used a reinforcement learning (RL) hierarchically to extend typical short-range path planners to consider battery recharge and solve the problem of UAVs in long missions. The problem is simulated for the UAV that flies over a large area, and Q-learning algorithm could enable the UAV to find the optimal path and recharge policy.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

摘要：

英文摘要：

相关论文