arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.14874cs.RO
收藏

通过语义锚定的功能映射实现跨物体实例的 affordance 转移

Affordance Transfer Across Object Instances via Semantically Anchored Functional Map

Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所);School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Australian Centre for Robotics, The University of Sydney(悉尼大学机器人中心);College of Connected Computing, Vanderbilt University(范德比大学连接计算学院)

Xiaoxiang Dong, Weiming Zhi

AI总结:

本文提出语义锚定的功能映射方法,通过单个视觉示范实现跨不同几何物体的 affordance 转移,提升机器人感知与行动的实用性。

摘要:

传统的学习从示范(LfD)通常需要繁琐的物理示范收集,这可能耗时且难以扩展。最近的进展表明,机器人可以通过提取交互提示从人类视频中学习,而无需直接参与机器人。然而,一个根本性挑战仍然存在:如何在不同物体实例之间泛化演示的交互,这些实例具有相似的功能但几何差异显著。在本工作中,我们提出了语义锚定的功能映射(SemFM),一种框架,用于从单个视觉示范中跨物体转移 affordance。从图像重建的粗略网格开始,我们的方法识别物体间的语义对应功能区域,选择互斥的语义锚点,并通过功能映射在表面上传播这些约束,以获得密集且语义一致的对应关系。这使演示的交互区域能够以轻量且可解释的方式在几何多样的物体之间进行转移。在合成物体类别和真实世界机器人操作任务中的实验表明,我们的方法能够以适度的计算成本实现准确的 affordance 转移,使其非常适合实际的机器人感知到行动管道。

英文摘要:

Traditional learning from demonstration (LfD) generally demands a cumbersome collection of physical demonstrations, which can be time-consuming and challenging to scale. Recent advances show that robots can instead learn from human videos by extracting interaction cues without direct robot involvement. However, a fundamental challenge remains: how to generalize demonstrated interactions across different object instances that share similar functionality but vary significantly in geometry. In this work, we propose \emph{Semantic Anchored Functional Maps} (SemFM), a framework for transferring affordances across objects from a single visual demonstration. Starting from a coarse mesh reconstructed from an image, our method identifies semantically corresponding functional regions between objects, selects mutually exclusive semantic anchors, and propagates these constraints over the surface using a functional map to obtain a dense, semantically consistent correspondence. This enables demonstrated interaction regions to be transferred across geometrically diverse objects in a lightweight and interpretable manner. Experiments on synthetic object categories and real-world robotic manipulation tasks show that our approach enables accurate affordance transfer with modest computational cost, making it well-suited for practical robotic perception-to-action pipelines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑