arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.11808cs.RO
收藏

基于深度强化学习的未知环境导航自动探索

Deep Reinforcement Learning based Automatic Exploration for Navigation in Unknown Environment

Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)

Haoran Li, Qichao Zhang, Dongbin Zhao

摘要:

本文研究了未知环境下机器人的自动探索问题,这是机器人系统应用于社会任务的关键。通过堆叠决策规则来解决这个问题是不可能覆盖各种环境和传感器属性的。基于学习的控制方法适用于这些场景。然而,这些方法都受到学习效率低,从模拟到现实的可移植性差。在本文中,我们构建了一个通用的探索框架,通过分解的决策,规划和映射模块的探索过程,这增加了机器人系统的模块化。在此基础上,提出了一种基于深度强化学习的决策算法,该算法利用深度神经网络从局部地图中学习探索策略。实验结果表明,该算法具有较好的学习效率和对未知环境的适应性。此外,我们在物理机器人上进行了实验,结果表明,学习的策略可以很好地从模拟转移到真实的机器人。

英文摘要:

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to cover various environments and sensor properties. Learning based control methods are adaptive for these scenarios. However, these methods are damaged by low learning efficiency and awkward transferability from simulation to reality. In this paper, we construct a general exploration framework via decomposing the exploration process into the decision, planning, and mapping modules, which increases the modularity of the robotic system. Based on this framework, we propose a deep reinforcement learning based decision algorithm which uses a deep neural network to learning exploration strategy from the partial map. The results show that this proposed algorithm has better learning efficiency and adaptability for unknown environments. In addition, we conduct the experiments on the physical robot, and the results suggest that the learned policy can be well transfered from simulation to the real robot.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑