arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.02853cs.CVcs.LG
收藏

深度学习时代的光流估计

Optical Flow Estimation in the Deep Learning Age

TU Darmstadt(达姆施塔特工业大学)

Junhwa Hur, Stefan Roth

摘要:

与计算机视觉的许多子领域类似,深度学习的最新进展也对光流的文献产生了重大影响。以前,文献一直占主导地位的经典的基于能量的模型,制定光流估计作为一个能量最小化问题。然而,由于卷积神经网络(CNN)相对于传统方法的实际益处在计算机视觉的许多领域中变得显而易见,因此它们在运动估计的上下文中也被越来越多地采用,以至于在精度方面的当前技术水平由CNN方法设定。我们首先回顾了这种转变以及从早期工作到目前状态的CNN光流估计的发展。此外,我们还讨论了他们的一些技术细节,并对其进行了比较,以概括哪些技术贡献导致了最显着的准确性改进。然后,我们概述了深度学习时代引入的各种光流方法,包括基于替代学习范式的方法(例如,无监督和半监督方法)以及扩展到多帧情况,这能够产生进一步的精度改进。

英文摘要:

Akin to many subareas of computer vision, the recent advances in deep learning have also significantly influenced the literature on optical flow. Previously, the literature had been dominated by classical energy-based models, which formulate optical flow estimation as an energy minimization problem. However, as the practical benefits of Convolutional Neural Networks (CNNs) over conventional methods have become apparent in numerous areas of computer vision and beyond, they have also seen increased adoption in the context of motion estimation to the point where the current state of the art in terms of accuracy is set by CNN approaches. We first review this transition as well as the developments from early work to the current state of CNNs for optical flow estimation. Alongside, we discuss some of their technical details and compare them to recapitulate which technical contribution led to the most significant accuracy improvements. Then we provide an overview of the various optical flow approaches introduced in the deep learning age, including those based on alternative learning paradigms (e.g., unsupervised and semi-supervised methods) as well as the extension to the multi-frame case, which is able to yield further accuracy improvements.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑