arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.02539cs.ROcs.AIcs.LGstat.ML
收藏

基于强化学习的自主机器人导航研究

Research on Autonomous Robots Navigation based on Reinforcement Learning

Syracuse University(雪城大学);Bentley University(本特利大学);Cranfield University(克兰菲尔德大学);University of California, Berkeley(加州大学伯克利分校)

Zixiang Wang, Hao Yan, Yining Wang, Zhengjia Xu, Zhuoyue Wang, Zhizhong Wu

AI总结:

本研究针对自主机器人导航问题,采用DQN和PPO两种强化学习模型优化路径规划与决策,经多组仿真实验验证,该方法可提升机器人在未知复杂环境中的导航能力、自适应与自学习能力,具备有效性与鲁棒性。

摘要:

强化学习通过与环境的持续交互,依据实时反馈的奖励信号不断优化决策,展现出强大的自适应与自学习能力,近年来已成为实现机器人自主导航的核心方法之一。本研究提出了一种基于强化学习的自主机器人导航方法,采用Deep Q Network(深度Q网络,DQN)和Proximal Policy Optimization(近端策略优化,PPO)模型,通过机器人与环境的持续交互及实时反馈的奖励信号,优化路径规划与决策过程。Deep Q Network将Q值函数与深度神经网络相结合,能够处理高维状态空间,从而实现复杂环境下的路径规划;Proximal Policy Optimization是一种基于策略梯度的方法,通过优化策略函数使机器人更高效地探索和利用环境信息。这些方法不仅提升了机器人在未知环境中的导航能力,还增强了其自适应与自学习能力。通过多次训练与仿真实验,我们验证了上述模型在多种复杂场景下的有效性与鲁棒性。

英文摘要:

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it has become one of the key methods to achieve autonomous navigation of robots. In this work, an autonomous robot navigation method based on reinforcement learning is introduced. We use the Deep Q Network (DQN) and Proximal Policy Optimization (PPO) models to optimize the path planning and decision-making process through the continuous interaction between the robot and the environment, and the reward signals with real-time feedback. By combining the Q-value function with the deep neural network, deep Q network can handle high-dimensional state space, so as to realize path planning in complex environments. Proximal policy optimization is a strategy gradient-based method, which enables robots to explore and utilize environmental information more efficiently by optimizing policy functions. These methods not only improve the robot's navigation ability in the unknown environment, but also enhance its adaptive and self-learning capabilities. Through multiple training and simulation experiments, we have verified the effectiveness and robustness of these models in various complex scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑