arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01930cs.ROcs.CV
收藏

LIEREx: 语言-图像嵌入用于机器人探索

LIEREx: Language-Image Embeddings for Robotic Exploration

Felix Igelbrink, Lennart Niecksch, Marian Renz, Martin Günther, Martin Atzmueller

AI总结:

LIEREx通过整合视觉-语言基础模型与3D语义场景图,实现机器人在部分未知环境中的目标导向探索。

摘要:

语义地图使机器人能够对其周围环境进行推理,以完成导航已知环境、寻找特定物体和探索未映射区域等任务。传统映射方法提供准确的几何表示,但往往受限于预设计的符号词汇表。依赖固定物体类别的方法使其难以处理设计时未定义的分布外知识。最近的视觉-语言基础模型进展,如CLIP,使开放集映射成为可能,其中对象被编码为高维嵌入而不是固定标签。在LIEREx中,我们将这些VLFMs与已建立的3D语义场景图相结合,以使自主代理在部分未知环境中通过目标导向的探索进行操作。

英文摘要:

Semantic maps allow a robot to reason about its surroundings to fulfill tasks such as navigating known environments, finding specific objects, and exploring unmapped areas. Traditional mapping approaches provide accurate geometric representations but are often constrained by pre-designed symbolic vocabularies. The reliance on fixed object classes makes it impractical to handle out-of-distribution knowledge not defined at design time. Recent advances in Vision-Language Foundation Models, such as CLIP, enable open-set mapping, where objects are encoded as high-dimensional embeddings rather than fixed labels. In LIEREx, we integrate these VLFMs with established 3D Semantic Scene Graphs to enable target-directed exploration by an autonomous agent in partially unknown environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑