深度运动边界检测
Deep Motion Boundary Detection
摘要:
运动边界检测是一个关键而又具有挑战性的问题。现有方法集中于分析光流场的梯度和分布,或者使用手工制作的特征用于运动边界学习。在本文中,我们提出了第一个用于运动边界检测的专用端到端深度学习方法,我们称之为MoBoNet。我们引入了一种细化网络结构,它以源输入图像,初始向前和向后光流以及相应的扭曲误差作为输入,并产生高分辨率的运动边界。此外,我们表明,所获得的运动边界,通过我们设计的融合子网络,可以反过来引导光流去除伪影。所提出的MoBoNet是通用的并且与任何光流一起工作。我们的运动边界检测和精细的光流估计实现优于现有技术的结果。
英文摘要:
Motion boundary detection is a crucial yet challenging problem. Prior methods focus on analyzing the gradients and distributions of optical flow fields, or use hand-crafted features for motion boundary learning. In this paper, we propose the first dedicated end-to-end deep learning approach for motion boundary detection, which we term as MoBoNet. We introduce a refinement network structure which takes source input images, initial forward and backward optical flows as well as corresponding warping errors as inputs and produces high-resolution motion boundaries. Furthermore, we show that the obtained motion boundaries, through a fusion sub-network we design, can in turn guide the optical flows for removing the artifacts. The proposed MoBoNet is generic and works with any optical flows. Our motion boundary detection and the refined optical flow estimation achieve results superior to the state of the art.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。