arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.11575cs.RO
收藏

ARiADNE:一种使用基于注意力的深度网络进行探索的强化学习方法

ARiADNE: A Reinforcement learning approach using Attention-based Deep Networks for Exploration

National University of Singapore(新加坡国立大学)

Yuhong Cao, Tianxiang Hou, Yizhuo Wang, Xian Yi, Guillaume Sartoretti

摘要:

在自主机器人探索任务中,移动机器人需要尽可能快地主动探索和绘制未知环境。由于环境在探索过程中被揭示,机器人需要经常在线重新规划其路径,因为机载传感器会获取新信息并用于更新其部分地图。虽然最先进的探索规划者是基于前沿和采样的,但受到深度强化学习(DRL)最近发展的鼓舞,我们提出了ARiADNE,一种基于注意力的神经方法,用于获得实时,非近视的自主探索路径规划。ARiADNE能够在多个空间尺度上学习智能体部分地图区域之间的依赖关系,并隐式预测与探索这些区域相关的潜在收益。这允许智能体对移动动作进行排序,以平衡已知区域中的地图的开发/细化与新区域的探索之间的自然权衡。我们通过实验证明,我们的方法在数百个简化的2D室内场景中完成探索的平均轨迹长度方面优于学习和非学习最先进的基线。我们进一步验证我们的方法在高保真机器人操作系统(ROS)的模拟,在那里我们考虑一个真正的传感器模型和一个现实的低级别的运动控制器,对部署在真正的机器人。

英文摘要:

In autonomous robot exploration tasks, a mobile robot needs to actively explore and map an unknown environment as fast as possible. Since the environment is being revealed during exploration, the robot needs to frequently re-plan its path online, as new information is acquired by onboard sensors and used to update its partial map. While state-of-the-art exploration planners are frontier- and sampling-based, encouraged by the recent development in deep reinforcement learning (DRL), we propose ARiADNE, an attention-based neural approach to obtain real-time, non-myopic path planning for autonomous exploration. ARiADNE is able to learn dependencies at multiple spatial scales between areas of the agent's partial map, and implicitly predict potential gains associated with exploring those areas. This allows the agent to sequence movement actions that balance the natural trade-off between exploitation/refinement of the map in known areas and exploration of new areas. We experimentally demonstrate that our method outperforms both learning and non-learning state-of-the-art baselines in terms of average trajectory length to complete exploration in hundreds of simplified 2D indoor scenarios. We further validate our approach in high-fidelity Robot Operating System (ROS) simulations, where we consider a real sensor model and a realistic low-level motion controller, toward deployment on real robots.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑