arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2509.00310cs.ROcs.AI

TReF-6:从单次演示推断任务相关坐标系以实现一次性技能泛化

TReF-6: Inferring Task-Relevant Frames from a Single Demonstration for One-Shot Skill Generalization

Yale University(耶鲁大学)

Yuxuan Ding, Shuangge Wang, Tesca Fitzgerald

AI总结:

本文提出 TReF-6,从单条轨迹几何推断 6DoF 任务相关坐标系并结合 DMP、视觉—语言模型与 Grounded-SAM,实现跨场景、保持任务意图的一次性机器人操作技能泛化。

摘要:

机器人往往难以从单次演示中进行泛化,原因在于缺乏可迁移且可解释的空间表征。在本研究中,我们提出 TReF-6,这是一种从单条轨迹推断简化、抽象的 6DoF(六自由度)任务相关坐标系(Task-Relevant Frame)的方法。我们的方法完全基于轨迹几何识别一个影响点,用以定义局部坐标系的原点;该坐标系可作为参数化动态运动基元(Dynamic Movement Primitive,DMP)的参考。该影响点捕捉任务的空间结构,将标准 DMP 公式扩展到超越“起点—目标”模仿的范围。推断出的坐标系通过视觉—语言模型获得语义基础,并由 Grounded-SAM 在新场景中完成定位,从而实现功能一致的技能泛化。我们在仿真中验证了 TReF-6,并证明其对轨迹噪声具有鲁棒性。我们进一步在真实世界操作任务上部署了端到端流程,结果表明 TReF-6 支持一次性模仿学习,可在多样物体配置下保持任务意图。

英文摘要:

Robots often struggle to generalize from a single demonstration due to the lack of a transferable and interpretable spatial representation. In this work, we introduce TReF-6, a method that infers a simplified, abstracted 6DoF Task-Relevant Frame from a single trajectory. Our approach identifies an influence point purely from the trajectory geometry to define the origin for a local frame, which serves as a reference for parameterizing a Dynamic Movement Primitive (DMP). This influence point captures the task's spatial structure, extending the standard DMP formulation beyond start-goal imitation. The inferred frame is semantically grounded via a vision-language model and localized in novel scenes by Grounded-SAM, enabling functionally consistent skill generalization. We validate TReF-6 in simulation and demonstrate robustness to trajectory noise. We further deploy an end-to-end pipeline on real-world manipulation tasks, showing that TReF-6 supports one-shot imitation learning that preserves task intent across diverse object configurations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑