arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.27558cs.ROcs.AIcs.LG

迈向准确的长时序机器人操作:通过场景图将语言转化为基于基础模型的动作

Toward Accurate Long-Horizon Robotic Manipulation: Language-to-Action with Foundation Models via Scene Graphs

Department of Electrical and Computer Engineering, King Abdullah University of Science and Technology (KAUST)(电气与计算机工程系,国王 Abdullah 科学与技术大学)

Sushil Samuel Dinesh, Shinkyu Park

AI总结:

本文提出一种基于预训练基础模型且无需领域特定训练的机器人操作框架,通过动态维护场景图提供空间感知,结合多模态感知与通用推理模型实现稳健任务排序,在桌面实验中验证了其构建操作系统的潜力。

摘要:

本文提出了一个框架,利用预训练基础模型进行机器人操作,无需领域特定训练。该框架集成了现成模型,将基础模型的多模态感知与能够稳健进行任务排序的通用推理模型相结合。框架内动态维护的场景图提供了空间感知能力,并实现对环境的一致推理。通过一系列桌面机器人操作实验对该框架进行了评估,结果突显了其直接基于现成基础模型构建机器人操作系统的潜力。

英文摘要:

This paper presents a framework that leverages pre-trained foundation models for robotic manipulation without domain-specific training. The framework integrates off-the-shelf models, combining multimodal perception from foundation models with a general-purpose reasoning model capable of robust task sequencing. Scene graphs, dynamically maintained within the framework, provide spatial awareness and enable consistent reasoning about the environment. The framework is evaluated through a series of tabletop robotic manipulation experiments, and the results highlight its potential for building robotic manipulation systems directly on top of off-the-shelf foundation models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑