arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.11174cs.CVcs.RO
收藏

DiffPoseNet:直接可微相机姿态估计

DiffPoseNet: Direct Differentiable Camera Pose Estimation

University of Maryland, College Park(马里兰大学帕克分校)

Chethan M. Parameshwara, Gokul Hari, Cornelia Fermüller, Nitin J. Sanket, Yiannis Aloimonos

摘要:

当前用于相机姿态估计的深度神经网络方法依赖于用于3D运动估计的场景结构,但这降低了鲁棒性,从而使得跨数据集泛化困难。相反,从运动恢复运动恢复结构的经典方法利用光流来估计3D运动,然后计算深度。然而,它们的准确性强烈地依赖于光流的质量。为了避免这个问题,已经提出了直接方法,其将3D运动与深度估计分离,但是仅使用正常流形式的图像梯度来计算3D运动。在本文中,我们介绍了一个网络NFlowNet,正常的流量估计,这是用来执行强大的和直接的约束。特别地,正常流用于基于手征(深度正性)约束来估计相对相机姿态。我们通过将优化问题制定为可微的cheirality层来实现这一点,该层允许端到端学习相机姿势。我们对所提出的DiffPoseNet对噪声的敏感性及其在数据集上的泛化进行了广泛的定性和定量评估。我们将我们的方法与KITTI,TartanAir和TUM-RGBD数据集上现有的最先进方法进行比较。

英文摘要:

Current deep neural network approaches for camera pose estimation rely on scene structure for 3D motion estimation, but this decreases the robustness and thereby makes cross-dataset generalization difficult. In contrast, classical approaches to structure from motion estimate 3D motion utilizing optical flow and then compute depth. Their accuracy, however, depends strongly on the quality of the optical flow. To avoid this issue, direct methods have been proposed, which separate 3D motion from depth estimation but compute 3D motion using only image gradients in the form of normal flow. In this paper, we introduce a network NFlowNet, for normal flow estimation which is used to enforce robust and direct constraints. In particular, normal flow is used to estimate relative camera pose based on the cheirality (depth positivity) constraint. We achieve this by formulating the optimization problem as a differentiable cheirality layer, which allows for end-to-end learning of camera pose. We perform extensive qualitative and quantitative evaluation of the proposed DiffPoseNet's sensitivity to noise and its generalization across datasets. We compare our approach to existing state-of-the-art methods on KITTI, TartanAir, and TUM-RGBD datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑