arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.00059cs.CVcs.RO
收藏

iCaps:迭代类别级对象姿态和形状估计

iCaps: Iterative Category-level Object Pose and Shape Estimation

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Carnegie Mellon University(卡内基梅隆大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of Washington(华盛顿大学);NVIDIA(英伟达)

Xinke Deng, Junyi Geng, Timothy Bretl, Yu Xiang, Dieter Fox

摘要:

本文提出了一种类别级的6D对象姿态和形状估计方法iCaps,该方法允许跟踪类别中未见过对象的6D姿态并估计其3D形状。我们使用深度图像作为输入开发了一个类别级自动编码器网络,其中来自自动编码器的特征嵌入对类别中对象的姿态进行编码。自动编码器可以在粒子滤波框架中使用,以估计和跟踪类别中的对象的6D姿态。通过利用基于符号距离函数的隐式形状表示,我们构建了一个LatentNet来估计3D形状的潜在表示,给出了对象的估计姿态。然后,所估计的姿态和形状可以用于以迭代的方式彼此更新。我们的类别级6D对象姿态和形状估计管道仅需要2D检测和分割进行初始化。我们在公开的数据集上评估了我们的方法,并证明了其有效性。特别是,我们的方法在形状估计上达到了很高的精度。

英文摘要:

This paper proposes a category-level 6D object pose and shape estimation approach iCaps, which allows tracking 6D poses of unseen objects in a category and estimating their 3D shapes. We develop a category-level auto-encoder network using depth images as input, where feature embeddings from the auto-encoder encode poses of objects in a category. The auto-encoder can be used in a particle filter framework to estimate and track 6D poses of objects in a category. By exploiting an implicit shape representation based on signed distance functions, we build a LatentNet to estimate a latent representation of the 3D shape given the estimated pose of an object. Then the estimated pose and shape can be used to update each other in an iterative way. Our category-level 6D object pose and shape estimation pipeline only requires 2D detection and segmentation for initialization. We evaluate our approach on a publicly available dataset and demonstrate its effectiveness. In particular, our method achieves comparably high accuracy on shape estimation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑