arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.12062cs.ROcs.CV
收藏

新对象语义位置的稳定性预测

Predicting Stable Configurations for Semantic Placement of Novel Objects

NVIDIA Corporation(英伟达公司);Paul G. Allen School of Computer Science & Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院);School of Computing, University of Utah(犹他大学计算学院)

Chris Paxton, Chris Xie, Tucker Hermans, Dieter Fox

摘要:

人类环境包含以各种布置配置的许多对象。我们的目标是使机器人能够根据在新环境中学习到的语义关系来放置以前看不见的对象。我们将这个问题分为两部分:(1)为对象找到物理上有效的位置;(2)确定这些姿势是否满足学习到的高级语义关系。我们从头开始构建我们的模型和训练,以便与我们提出的未知对象语义放置规划算法紧密集成。我们纯粹在模拟中训练我们的模型,不需要在现实世界中使用的微调。我们的方法,使运动规划语义重排的场景中的未知对象具有不同的几何形状,只有RGB-D传感。我们通过一组模拟消融的实验表明,单独使用一个关系分类器是不够的可靠的规划。我们进一步证明了我们的计划器的能力,通过一组现实世界的实验,各种对象生成和执行不同的操作计划。

英文摘要:

Human environments contain numerous objects configured in a variety of arrangements. Our goal is to enable robots to repose previously unseen objects according to learned semantic relationships in novel environments. We break this problem down into two parts: (1) finding physically valid locations for the objects and (2) determining if those poses satisfy learned, high-level semantic relationships. We build our models and training from the ground up to be tightly integrated with our proposed planning algorithm for semantic placement of unknown objects. We train our models purely in simulation, with no fine-tuning needed for use in the real world. Our approach enables motion planning for semantic rearrangement of unknown objects in scenes with varying geometry from only RGB-D sensing. Our experiments through a set of simulated ablations demonstrate that using a relational classifier alone is not sufficient for reliable planning. We further demonstrate the ability of our planner to generate and execute diverse manipulation plans through a set of real-world experiments with a variety of objects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑