arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.15087cs.CVcs.RO
收藏

O2O-Afford:无注释的大规模对象-对象可供性学习

O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learning

Stanford University(斯坦福大学);UCSD(加州大学圣地亚哥分校)

Kaichun Mo, Yuzhe Qin, Fanbo Xiang, Hao Su, Leonidas Guibas

摘要:

与建模、感知和理解代理对象(例如,人-物体、手-物体、机器人-物体)交互的研究在计算机视觉和机器人学中非常重要,但是很少有过去的工作研究物体-物体交互的任务,物体-物体交互在机器人操作和规划任务中也起着重要的作用。在我们的日常生活中,有一个丰富的空间的对象-对象交互的场景,如放置在一个凌乱的桌面上的对象,适合一个抽屉内的对象,使用工具推一个对象等,在本文中,我们提出了一个统一的启示学习框架,学习对象-对象交互的各种任务。通过使用物理模拟(SAPIEN)和数千个具有丰富几何多样性的ShapeNet模型构建四个对象-对象交互任务环境,我们能够进行大规模的对象-对象启示学习,而无需人工注释或演示。在技术贡献的核心,我们提出了一个对象核点卷积网络来推理两个对象之间的详细交互。在大规模合成数据和真实数据上的实验证明了该方法的有效性。有关代码、数据、视频和更多资料,请参阅项目网页:https://cs.stanford.edu/~kaichun/o2oafford

英文摘要:

Contrary to the vast literature in modeling, perceiving, and understanding agent-object (e.g., human-object, hand-object, robot-object) interaction in computer vision and robotics, very few past works have studied the task of object-object interaction, which also plays an important role in robotic manipulation and planning tasks. There is a rich space of object-object interaction scenarios in our daily life, such as placing an object on a messy tabletop, fitting an object inside a drawer, pushing an object using a tool, etc. In this paper, we propose a unified affordance learning framework to learn object-object interaction for various tasks. By constructing four object-object interaction task environments using physical simulation (SAPIEN) and thousands of ShapeNet models with rich geometric diversity, we are able to conduct large-scale object-object affordance learning without the need for human annotations or demonstrations. At the core of technical contribution, we propose an object-kernel point convolution network to reason about detailed interaction between two objects. Experiments on large-scale synthetic data and real-world data prove the effectiveness of the proposed approach. Please refer to the project webpage for code, data, video, and more materials: https://cs.stanford.edu/~kaichun/o2oafford

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑