arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.12902cs.CV
收藏

TexPose:用于自监督6D物体姿态估计的神经纹理学习

TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose Estimation

Technical University of Munich(慕尼黑工业大学);Google Inc.(谷歌公司)

Hanzhi Chen, Fabian Manhardt, Nassir Navab, Benjamin Busam

摘要:

在本文中,我们介绍了神经纹理学习的6D物体姿态估计从合成数据和一些未标记的真实图像。我们的主要贡献是一个新的学习计划,消除了以前的作品的缺点,即强烈依赖于共同模态或额外的细化。这些在以前是提供用于收敛的训练信号所必需的。我们制定这样的计划作为两个子优化问题的纹理学习和姿势学习。我们分别学习从真实图像集合中预测物体的真实纹理,并从像素完美的合成数据中学习姿态估计。结合这两种能力,然后允许合成真实感新颖的视图,以监督具有准确几何形状的姿态估计器。为了减轻在纹理学习阶段存在的姿态噪声和分割缺陷,我们提出了一个基于表面的对抗训练损失以及来自合成数据的纹理正则化。我们证明,所提出的方法显着优于最近的国家的最先进的方法,没有地面实况姿态注释,并展示了大量的泛化改进对看不见的场景。值得注意的是,我们的计划大大提高了所采用的姿态估计,即使初始化时的性能差得多。

英文摘要:

In this paper, we introduce neural texture learning for 6D object pose estimation from synthetic data and a few unlabelled real images. Our major contribution is a novel learning scheme which removes the drawbacks of previous works, namely the strong dependency on co-modalities or additional refinement. These have been previously necessary to provide training signals for convergence. We formulate such a scheme as two sub-optimisation problems on texture learning and pose learning. We separately learn to predict realistic texture of objects from real image collections and learn pose estimation from pixel-perfect synthetic data. Combining these two capabilities allows then to synthesise photorealistic novel views to supervise the pose estimator with accurate geometry. To alleviate pose noise and segmentation imperfection present during the texture learning phase, we propose a surfel-based adversarial training loss together with texture regularisation from synthetic data. We demonstrate that the proposed approach significantly outperforms the recent state-of-the-art methods without ground-truth pose annotations and demonstrates substantial generalisation improvements towards unseen scenes. Remarkably, our scheme improves the adopted pose estimators substantially even when initialised with much inferior performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑