arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.24118cs.ROcs.AI

LagMemo: 语言3D高斯点云记忆用于多模态开放词汇多目标视觉导航

LagMemo: Language 3D Gaussian Splatting Memory for Multi-modal Open-vocabulary Multi-goal Visual Navigation

Key Laboratory of Machine Perceptions (MOE), School of Intelligence Science and Technology, Peking University(机器感知重点实验室(教委)、智能科学与技术学院、北京大学)

Haotian Zhou, Xiaole Wang, He Li, Zhuo Qi, Jinrun Yin, Haiyu Kong, Jianghuan Xu, Huijing Zhao

AI总结:

LagMemo通过语言3D高斯点云记忆实现多模态开放词汇多目标视觉导航,有效提升多目标定位性能

摘要:

利用视觉信息导航到指定目标是智能机器人的一项基本能力。为应对多模态、开放词汇目标查询和多目标视觉导航的实践需求,我们提出了LagMemo,一种利用语言3D高斯点云记忆的导航系统。在一次探索过程中,LagMemo构建了一个具有强空间-语义关联的统一3D语言记忆。随着任务目标的输入,系统能够高效查询记忆,预测候选目标位置,并整合基于局部感知的验证机制以动态匹配和验证目标。为了公平和严谨的评估,我们从GOAT-Bench中提炼出高质量的核心分割数据集GOAT-Core。实验结果表明,LagMemo的记忆模块实现了有效的多模态开放词汇定位,并在多目标视觉导航中显著优于现有最先进方法。项目页面:https://weekgoodday.github.io/lagmemo

英文摘要:

Navigating to a designated goal using visual information is a fundamental capability for intelligent robots. To address the practical demands of multi-modal, open-vocabulary goal queries and multi-goal visual navigation, we propose LagMemo, a navigation system that leverages a language 3D Gaussian Splatting memory. During a one-time exploration, LagMemo constructs a unified 3D language memory with robust spatial-semantic correlations. With incoming task goals, the system efficiently queries the memory, predicts candidate goal locations, and integrates a local perception-based verification mechanism to dynamically match and validate goals. For fair and rigorous evaluation, we curate GOAT-Core, a high-quality core split distilled from GOAT-Bench. Experimental results show that LagMemo's memory module enables effective multi-modal open-vocabulary localization, and significantly outperforms state-of-the-art methods in multi-goal visual navigation. Project page: https://weekgoodday.github.io/lagmemo

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑