arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.09876cs.CV
收藏

基于隐线索的深度估计自监督联合学习框架

Self-Supervised Joint Learning Framework of Depth Estimation via Implicit Cues

Tianjin University(天津大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);The Chinese University of Hong Kong(香港中文大学)

Jianrong Wang, Ge Zhang, Zhenyu Wu, XueWei Li, Li Liu

摘要:

在自监督单目深度估计中,深度不连续性和运动目标伪影仍然是具有挑战性的问题。现有的自监督方法通常利用单个视图来训练深度估计网络。与静态视图相比,视频帧间丰富的动态特性有利于精确的深度估计,尤其是对于动态对象。在这项工作中,我们提出了一种新的自监督联合学习框架,用于使用来自单目和立体视频的连续帧进行深度估计。其主要思想是使用一个隐式的深度线索提取器,它利用动态和静态线索来生成有用的深度建议。这些线索可以预测可区分的运动轮廓和几何场景结构。此外,引入了一种新的高维注意力模块来提取清晰的全局变换,有效地抑制了高维空间中局部描述符的不确定性,使得学习框架的优化更加可靠。实验表明,该框架优于国家的最先进的(SOTA)KITTI和Make3D数据集。

英文摘要:

In self-supervised monocular depth estimation, the depth discontinuity and motion objects' artifacts are still challenging problems. Existing self-supervised methods usually utilize a single view to train the depth estimation network. Compared with static views, abundant dynamic properties between video frames are beneficial to refined depth estimation, especially for dynamic objects. In this work, we propose a novel self-supervised joint learning framework for depth estimation using consecutive frames from monocular and stereo videos. The main idea is using an implicit depth cue extractor which leverages dynamic and static cues to generate useful depth proposals. These cues can predict distinguishable motion contours and geometric scene structures. Furthermore, a new high-dimensional attention module is introduced to extract clear global transformation, which effectively suppresses uncertainty of local descriptors in high-dimensional space, resulting in a more reliable optimization in learning framework. Experiments demonstrate that the proposed framework outperforms the state-of-the-art(SOTA) on KITTI and Make3D datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑