arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.18236cs.RO
收藏

基于强化学习与粒子滤波的多AGV路径规划方法

Multi-AGV Path Planning Method via Reinforcement Learning and Particle Filters

Wuhan University of Technology(武汉理工大学)

Shao Shuo

AI总结:

提出PF-DDQN方法,结合粒子滤波与强化学习优化网络权重,解决多AGV路径规划中收敛慢、效率低问题,仿真显示路径规划优越性提升92.62%,训练时间减少76.88%。

摘要:

得益于其强大的学习与搜索稳定性,强化学习(RL)算法在自动导引车(AGV)路径规划中获得了日益显著的关注并被广泛应用。然而,研究发现基于RL的规划算法存在由环境不稳定性和系统结构显著波动引起的神经网络权重方差较大的问题,这些挑战表现为收敛速度慢和学习效率低。为解决此问题,本文提出了一种新颖的多AGV路径规划方法,名为粒子滤波-双深度Q网络(PF-DDQN),该方法利用粒子滤波(PF)和RL算法。首先,所提方法将网络的不精确权重值作为状态值来构建状态空间方程。随后,通过神经网络与PF的迭代融合过程优化DDQN模型,以获取最优的真实权重值,从而提高所提方法的优化效率。最后,通过不同的数值仿真验证了所提方法的性能。仿真结果表明,所提方法在路径规划优越性和训练时间指标上分别比传统DDQN算法高出92.62%和76.88%。因此,所提方法可被视为多AGV路径规划领域的一个重要替代方案。

英文摘要:

Thanks to its robust learning and search stabilities,the reinforcement learning (RL) algorithm has garnered increasingly significant attention and been exten-sively applied in Automated Guided Vehicle (AGV) path planning. However, RL-based planning algorithms have been discovered to suffer from the substantial variance of neural networks caused by environmental instability and significant fluctua-tions in system structure. These challenges manifest in slow convergence speed and low learning efficiency. To tackle this issue, this paper presents a novel multi-AGV path planning method named Particle Filters - Double Deep Q-Network (PF-DDQN)via leveraging Particle Filters (PF) and RL algorithm. Firstly, the proposed method leverages the imprecise weight values of the network as state values to formulate thestate space equation.Subsequently, the DDQN model is optimized to acquire the optimal true weight values through the iterative fusion process of neural networksand PF in order to enhance the optimization efficiency of the proposedmethod. Lastly, the performance of the proposed method is validated by different numerical simulations. The simulation results demonstrate that the proposed methoddominates the traditional DDQN algorithm in terms of path planning superiority andtraining time indicator by 92.62% and 76.88%, respectively. Therefore, the proposedmethod could be considered as a vital alternative in the field of multi-AGV path planning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑