arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.21037cs.RO
收藏

探索零样本物体目标导航中基于基础模型的前沿选择的可靠性

Exploring the Reliability of Foundation Model-Based Frontier Selection in Zero-Shot Object Goal Navigation

NYUAD Center for Artificial Intelligence and Robotics (CAIR)(纽约大学阿布扎比分校人工智能与机器人中心);New York University Abu Dhabi(纽约大学阿布扎比分校);New York University(纽约大学)

Shuaihang Yuan, Halil Utku Unlu, Hao Huang, Congcong Wen, Anthony Tzes, Yi Fang

AI总结:

针对零样本物体目标导航中基础模型前沿选择不可靠的问题,提出DEFA与CDM组成的多专家共识框架,在RoboTHOR和HM3D上取得最先进性能。

摘要:

本文提出了一种用于零样本物体目标导航(ZS-OGN)中可靠前沿选择的新方法,通过基础模型增强机器人导航系统,以提升室内环境中的常识推理能力。我们的方法引入了多专家决策框架,以解决基于基础模型的系统中常见的荒谬或不相关推理问题。该方法包含两个关键组件:多样化专家前沿分析(DEFA)和共识决策(CDM)。DEFA使用三个专家模型:家具布置、房间类型分析和视觉场景推理,而CDM聚合它们的输出,优先采用一致或多数共识以获得更可靠的决策。我们的方法在RoboTHOR和HM3D数据集上展示了最先进性能,擅长导航至未训练的物体或目标,并优于多种基线,展现了其对动态真实世界条件的适应性和卓越的泛化能力。

英文摘要:

In this paper, we present a novel method for reliable frontier selection in Zero-Shot Object Goal Navigation (ZS-OGN), enhancing robotic navigation systems with foundation models to improve commonsense reasoning in indoor environments. Our approach introduces a multi-expert decision framework to address the nonsensical or irrelevant reasoning often seen in foundation model-based systems. The method comprises two key components: Diversified Expert Frontier Analysis (DEFA) and Consensus Decision Making (CDM). DEFA utilizes three expert models: furniture arrangement, room type analysis, and visual scene reasoning, while CDM aggregates their outputs, prioritizing unanimous or majority consensus for more reliable decisions. Demonstrating state-of-the-art performance on the RoboTHOR and HM3D datasets, our method excels at navigating towards untrained objects or goals and outperforms various baselines, showcasing its adaptability to dynamic real-world conditions and superior generalization capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑