arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.13265cs.ROcs.LG
收藏

集成深度强化学习和在线规划的机器人群体导航

Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planning

Robotics Research Center, College of Intelligence Science and Technology, National University of Defense Technology(国防科技大学智能科学学院机器人研究中心)

Zhiqian Zhou, Pengming Zhu, Zhiwen Zeng, Junhao Xiao, Huimin Lu, Zongtan Zhou

摘要:

移动机器人在人群中沿时间效率高、无碰撞的路径导航仍然是一个开放和具有挑战性的问题。主要的挑战来自于复杂和精密的交互机制,这要求机器人理解人群并执行主动和前瞻性的行为。深度强化学习是解决这个问题的一个很有前途的方法。然而,大多数以前的学习方法产生了巨大的计算负担。为了解决这些问题,我们提出了一种基于图的深度强化学习方法SG-DQN,该方法(i)引入社会注意力机制来提取人群机器人状态的有效图形表示;(ii)使用学习的决斗深度Q网络(DQN)直接评估原始状态的粗略q值;然后(iii)通过对可能的未来轨迹进行在线规划来细化粗略q值。实验结果表明,该模型可以帮助机器人更好地理解人群,并在人群导航任务中取得了高于0.99的成功率。与以前的国家的最先进的算法相比,我们的算法实现了同等的,如果不是更好的,性能,而需要不到一半的计算成本。

英文摘要:

It is still an open and challenging problem for mobile robots navigating along time-efficient and collision-free paths in a crowd. The main challenge comes from the complex and sophisticated interaction mechanism, which requires the robot to understand the crowd and perform proactive and foresighted behaviors. Deep reinforcement learning is a promising solution to this problem. However, most previous learning methods incur a tremendous computational burden. To address these problems, we propose a graph-based deep reinforcement learning method, SG-DQN, that (i) introduces a social attention mechanism to extract an efficient graph representation for the crowd-robot state; (ii) directly evaluates the coarse q-values of the raw state with a learned dueling deep Q network(DQN); and then (iii) refines the coarse q-values via online planning on possible future trajectories. The experimental results indicate that our model can help the robot better understand the crowd and achieve a high success rate of more than 0.99 in the crowd navigation task. Compared against previous state-of-the-art algorithms, our algorithm achieves an equivalent, if not better, performance while requiring less than half of the computational cost.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑