通过解耦搜索与寻路实现高效物体导航策略学习
Efficient Strategy Learning by Decoupling Searching and Pathfinding for Object Navigation
AI总结:
本文针对物体导航提出两阶段奖励机制TSRM解耦搜索与寻路,并引入深度增强预训练方法DE-MAE提升空间感知,在AI2-Thor和RoboTHOR上超越SOTA方法。
摘要:
受人类导航行为的启发——先搜索探索未知区域以发现目标,再寻路朝已发现的目标移动——近期研究设计了并行子模块,在搜索和寻路阶段实现不同功能,但忽略了两个阶段之间奖励信号的差异。因此,这些模型往往无法被充分训练,或在训练场景上过拟合。限制智能体学习两阶段策略的另一个瓶颈是空间感知能力,因为相关研究使用了通用视觉编码器,未考虑导航场景的深度信息。为释放模型在策略学习上的潜力,我们针对物体导航提出了两阶段奖励机制(TSRM),在一个回合中解耦搜索和寻路行为,使智能体能够在搜索阶段探索更大区域,并在寻路阶段寻求最优路径。此外,我们提出了一种预训练方法——深度增强掩码自编码器(DE-MAE),使智能体能够在搜索阶段更准确地判断已探索和未探索区域,在寻路阶段更准确地定位目标物体并规划路径。我们还提出了一个新指标——按搜索路径长度加权的搜索成功率(SSSPL),用于评估智能体的搜索能力和探索效率。最后,我们在AI2-Thor和RoboTHOR上对方法进行了广泛评估,证明其在成功率和导航效率上均能超越当前最先进(SOTA)方法。
英文摘要:
Inspired by human-like behaviors for navigation: first searching to explore unknown areas before discovering the target, and then the pathfinding of moving towards the discovered target, recent studies design parallel submodules to achieve different functions in the searching and pathfinding stages, while ignoring the differences in reward signals between the two stages. As a result, these models often cannot be fully trained or are overfitting on training scenes. Another bottleneck that restricts agents from learning two-stage strategies is spatial perception ability, since the studies used generic visual encoders without considering the depth information of navigation scenes. To release the potential of the model on strategy learning, we propose the Two-Stage Reward Mechanism (TSRM) for object navigation that decouples the searching and pathfinding behaviours in an episode, enabling the agent to explore larger area in searching stage and seek the optimal path in pathfinding stage. Also, we propose a pretraining method Depth Enhanced Masked Autoencoders (DE-MAE) that enables agent to determine explored and unexplored areas during the searching stage, locate target object and plan paths during the pathfinding stage more accurately. In addition, we propose a new metric of Searching Success weighted by Searching Path Length (SSSPL) that assesses agent's searching ability and exploring efficiency. Finally, we evaluated our method on AI2-Thor and RoboTHOR extensively and demonstrated it can outperform the state-of-the-art (SOTA) methods in both the success rate and the navigation efficiency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。