arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.10758cs.CVcs.LG
收藏

FADNet:一种快速准确的视差估计网络

FADNet: A Fast and Accurate Network for Disparity Estimation

Hong Kong Baptist University(香港浸会大学)

Qiang Wang, Shaohuai Shi, Shizhen Zheng, Kaiyong Zhao, Xiaowen Chu

摘要:

深度神经网络(DNN)在计算机视觉领域取得了巨大成功。视差估计问题倾向于由DNN解决,DNN在立体匹配中实现比传统手工制作的基于特征的方法更好的预测精度。然而,一方面,所设计的DNN需要大量的存储器和计算资源来准确预测差异,特别是对于那些基于3D卷积的网络,这使得其难以在实时应用中部署。另一方面,现有的计算效率高的网络缺乏在大规模数据集中的表达能力,使得它们在许多情况下不能做出准确的预测。为此,我们提出了一种高效准确的深度网络用于视差估计,称为FADNet,具有三个主要特征:1)它利用高效的基于2D的相关层和堆叠块来保持快速计算; 2)它结合了残差结构,使更深的模型更容易学习; 3)它包含多尺度预测,以便利用多尺度权重调度训练技术来提高准确性。我们在两个流行的数据集Scene Flow和KITTI 2015上进行了实验,以证明FADNet的有效性。实验结果表明,FADNet达到了最先进的预测精度,并且运行速度比现有的3D模型快了一个数量级。FADNet的代码可在https://github.com/HKBU-HPML/FADNet上查阅。

英文摘要:

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy in stereo matching than traditional hand-crafted feature based methods. On one hand, however, the designed DNNs require significant memory and computation resources to accurately predict the disparity, especially for those 3D convolution based networks, which makes it difficult for deployment in real-time applications. On the other hand, existing computation-efficient networks lack expression capability in large-scale datasets so that they cannot make an accurate prediction in many scenarios. To this end, we propose an efficient and accurate deep network for disparity estimation named FADNet with three main features: 1) It exploits efficient 2D based correlation layers with stacked blocks to preserve fast computation; 2) It combines the residual structures to make the deeper model easier to learn; 3) It contains multi-scale predictions so as to exploit a multi-scale weight scheduling training technique to improve the accuracy. We conduct experiments to demonstrate the effectiveness of FADNet on two popular datasets, Scene Flow and KITTI 2015. Experimental results show that FADNet achieves state-of-the-art prediction accuracy, and runs at a significant order of magnitude faster speed than existing 3D models. The codes of FADNet are available at https://github.com/HKBU-HPML/FADNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑