arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.09864cs.LGeess.SPmath.OC
收藏

基于强化学习的无人机物流配送路径优化

Reinforcement Learning to Optimize the Logistics Distribution Routes of Unmanned Aerial Vehicle

University of Southampton(南安普顿大学)

Linfei Feng

摘要:

无人机(UAV)在货物配送中的路径规划方法因其灵活性,适用于客户与配送节点之间“最后一公里”的多种情况而受到业界和学术界的极大关注。然而,这种复杂的情况仍然是传统的组合优化方法的一个问题。针对多禁飞区复杂环境下无人机的航迹规划问题,在现有强化学习(RL)方法的基础上,提出了一种改进方法。改进的方法利用了注意力机制,并且包括作为编码器的嵌入机制和三种不同宽度的束搜索(即,1、5、10)作为解码器。策略梯度被用来训练强化学习模型,以获得推理过程中的最优策略。结果表明,该模型在这类复杂情况下的应用是可行和有效的。将该模型与优化求解器OR-tools得到的结果进行比较,提高了配电系统的可靠性,对无人机的广泛应用具有指导意义。

英文摘要:

Path planning methods for the unmanned aerial vehicle (UAV) in goods delivery have drawn great attention from industry and academics because of its flexibility which is suitable for many situations in the "Last Kilometer" between customer and delivery nodes. However, the complicated situation is still a problem for traditional combinatorial optimization methods. Based on the state-of-the-art Reinforcement Learning (RL), this paper proposed an improved method to achieve path planning for UAVs in complex surroundings: multiple no-fly zones. The improved approach leverages the attention mechanism and includes the embedding mechanism as the encoder and three different widths of beam search (i.e.,~1, 5, and 10) as the decoders. Policy gradients are utilized to train the RL model for obtaining the optimal strategies during inference. The results show the feasibility and efficiency of the model applying in this kind of complicated situation. Comparing the model with the results obtained by the optimization solver OR-tools, it improves the reliability of the distribution system and has a guiding significance for the broad application of UAVs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑