arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.09213cs.CV
收藏

回到功能:从像素到姿态学习鲁棒的相机定位

Back to the Feature: Learning Robust Camera Localization from Pixels to Pose

ETH Zurich(苏黎世联邦理工学院);Chalmers University of Technology(查尔姆斯理工大学);Eigenvision;Ecole des Ponts(巴黎高科路桥学校);Microsoft(微软);Czech Technical University in Prague(捷克理工大学)

Paul-Edouard Sarlin, Ajaykumar Unagar, Måns Larsson, Hugo Germain, Carl Toft, Viktor Larsson, Marc Pollefeys, Vincent Lepetit, Lars Hammarstrand, Fredrik Kahl, Torsten Sattler

摘要:

已知场景中的摄像机姿态估计是一个3D几何任务,最近由多种学习算法解决。许多回归精确的几何量,如姿势或3D点,从输入图像。这要么无法泛化到新视点,要么将模型参数绑定到特定场景。在本文中,我们回到功能:,我们认为深度网络应该专注于学习鲁棒和不变的视觉特征,而几何估计应该留给原则性算法。我们介绍PixLoc,这是一个场景不可知的神经网络,可以从图像和3D模型中估计准确的6-DoF姿势。我们的方法是基于多尺度深度特征的直接对齐,将相机定位作为度量学习。PixLoc通过从像素到姿势的端到端训练来学习强大的数据先验,并通过分离模型参数和场景几何形状来对新场景进行特殊的泛化。该系统可以在给定粗略姿态先验的大环境中进行定位,但也可以通过联合细化关键点和姿态来提高稀疏特征匹配的准确性。该代码将在https://github.com/cvg/pixloc上公开发布。

英文摘要:

Camera pose estimation in known scenes is a 3D geometry task recently tackled by multiple learning algorithms. Many regress precise geometric quantities, like poses or 3D points, from an input image. This either fails to generalize to new viewpoints or ties the model parameters to a specific scene. In this paper, we go Back to the Feature: we argue that deep networks should focus on learning robust and invariant visual features, while the geometric estimation should be left to principled algorithms. We introduce PixLoc, a scene-agnostic neural network that estimates an accurate 6-DoF pose from an image and a 3D model. Our approach is based on the direct alignment of multiscale deep features, casting camera localization as metric learning. PixLoc learns strong data priors by end-to-end training from pixels to pose and exhibits exceptional generalization to new scenes by separating model parameters and scene geometry. The system can localize in large environments given coarse pose priors but also improve the accuracy of sparse feature matching by jointly refining keypoints and poses with little overhead. The code will be publicly available at https://github.com/cvg/pixloc.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑