arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1812.02541cs.CV
收藏

分割驱动的6D目标位姿估计

Segmentation-driven 6D Object Pose Estimation

EPFL(洛桑联邦理工学院)

Yinlin Hu, Joachim Hugonot, Pascal Fua, Mathieu Salzmann

摘要:

估计刚性对象的6D姿态的最新趋势是训练深度网络,以直接从图像回归姿态或预测3D关键点的2D位置,可以使用Pestrian算法从3D关键点获得姿态。在这两种情况下,对象被视为一个全球实体,并计算一个单一的姿态估计。因此,所得到的技术可能容易受到大的遮挡。在本文中,我们引入了一个分割驱动的6D姿态估计框架,其中对象的每个可见部分以2D关键点位置的形式贡献局部姿态预测。然后,我们使用预测的置信度来将这些姿态候选者组合成一组强大的3D到2D对应关系,从中可以获得可靠的姿态估计。我们在具有挑战性的Occluded-LINEMOD和YCB-Video数据集上的表现优于最先进的技术,这证明我们的方法可以很好地处理多个纹理不良的对象相互遮挡。此外,它依赖于一个足够简单的架构来实现实时性能。

英文摘要:

The most recent trend in estimating the 6D pose of rigid objects has been to train deep networks to either directly regress the pose from the image or to predict the 2D locations of 3D keypoints, from which the pose can be obtained using a PnP algorithm. In both cases, the object is treated as a global entity, and a single pose estimate is computed. As a consequence, the resulting techniques can be vulnerable to large occlusions. In this paper, we introduce a segmentation-driven 6D pose estimation framework where each visible part of the objects contributes a local pose prediction in the form of 2D keypoint locations. We then use a predicted measure of confidence to combine these pose candidates into a robust set of 3D-to-2D correspondences, from which a reliable pose estimate can be obtained. We outperform the state-of-the-art on the challenging Occluded-LINEMOD and YCB-Video datasets, which is evidence that our approach deals well with multiple poorly-textured objects occluding each other. Furthermore, it relies on a simple enough architecture to achieve real-time performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑