arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1603.03590cs.CVcs.RO
收藏

基于稠密逆搜索的快速光流

Fast Optical Flow using Dense Inverse Search

ETH Zurich(苏黎世联邦理工学院);K.U. Leuven(鲁汶大学)

Till Kroeger, Radu Timofte, Dengxin Dai, Luc Van Gool

摘要:

目前光流提取的研究主要集中在准确性上,而忽略了时间复杂度。然而,在现实生活中的视觉应用,如跟踪,活动检测和识别,时间复杂度是关键。我们提出了一个解决方案,具有非常低的时间复杂度和竞争力的准确性的计算密集光流。它包括三个部分:1)逆搜索块对应; 2)通过沿多尺度的块聚集来创建密集位移场; 3)变分细化。在我们的密集反向搜索为基础的方法(DIS)的核心是有效的搜索的对应关系的启发,由贝克和马修斯在2001年提出的逆合成图像对齐。DIS在具有大位移的标准光流基准上具有竞争力。DIS在单个CPU核心上以300 Hz至600 Hz的频率运行,达到人类生物视觉系统的时间分辨率。在相同的精度范围内,它比最先进的方法快几个数量级,使DIS成为视觉应用的理想选择。

英文摘要:

Most recent works in optical flow extraction focus on the accuracy and neglect the time complexity. However, in real-life visual applications, such as tracking, activity detection and recognition, the time complexity is critical. We propose a solution with very low time complexity and competitive accuracy for the computation of dense optical flow. It consists of three parts: 1) inverse search for patch correspondences; 2) dense displacement field creation through patch aggregation along multiple scales; 3) variational refinement. At the core of our Dense Inverse Search-based method (DIS) is the efficient search of correspondences inspired by the inverse compositional image alignment proposed by Baker and Matthews in 2001. DIS is competitive on standard optical flow benchmarks with large displacements. DIS runs at 300Hz up to 600Hz on a single CPU core, reaching the temporal resolution of human's biological vision system. It is order(s) of magnitude faster than state-of-the-art methods in the same range of accuracy, making DIS ideal for visual applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑