arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1812.03368cs.CV
收藏

基于束平差、超分辨率和削波损失的单目深度估计的无监督学习

Unsupervised Learning of Monocular Depth Estimation with Bundle Adjustment, Super-Resolution and Clip Loss

Carnegie Mellon University(卡内基梅隆大学);Chinese Academy of Sciences(中国科学院)

Lipu Zhou, Jiamin Ye, Montiel Abello, Shengze Wang, Michael Kaess

摘要:

我们提出了一种新的无监督学习框架,单视图深度估计使用单目视频。众所周知,在三维视觉中,扩大基线可以提高深度估计精度,并且联合优化一组相机姿态和地标是必不可少的。在以前的单目无监督学习框架中,序列中只有部分光度和几何约束被用作监督信号。这可能导致短基线和过拟合。此外,以前的工作通常是从低分辨率的输入图像估计低分辨率的深度。然后对低分辨率深度进行插值以恢复原始分辨率。这种策略可能在对象边界上产生大的误差,因为背景和前景的深度被混合以产生高分辨率深度。本文提出了一种光束法平差框架和一种超分辨率网来解决上述两个问题。在光束法平差中,图像序列的深度和姿态被联合优化,这通过建立更远帧之间的关系来增加基线。超分辨率网络学习从低分辨率图像估计高分辨率深度。此外,我们引入了剪辑损失来处理移动对象和遮挡。在KITTI数据集上的实验结果表明,该算法的性能优于现有的基于单目序列的无监督方法,并且与基于立体序列的无监督方法相比,具有相当甚至更好的效果。

英文摘要:

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set of camera poses and landmarks is essential. In previous monocular unsupervised learning frameworks, only part of the photometric and geometric constraints within a sequence are used as supervisory signals. This may result in a short baseline and overfitting. Besides, previous works generally estimate a low resolution depth from a low resolution impute image. The low resolution depth is then interpolated to recover the original resolution. This strategy may generate large errors on object boundaries, as the depth of background and foreground are mixed to yield the high resolution depth. In this paper, we introduce a bundle adjustment framework and a super-resolution network to solve the above two problems. In bundle adjustment, depths and poses of an image sequence are jointly optimized, which increases the baseline by establishing the relationship between farther frames. The super resolution network learns to estimate a high resolution depth from a low resolution image. Additionally, we introduce the clip loss to deal with moving objects and occlusion. Experimental results on the KITTI dataset show that the proposed algorithm outperforms the state-of-the-art unsupervised methods using monocular sequences, and achieves comparable or even better result compared to unsupervised methods using stereo sequences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑