重复估计
Repetition Estimation
摘要:
视觉重复在我们的世界中无处不在。它出现在人类活动(体育,烹饪),动物行为(蜜蜂的摇摆舞),自然现象(风中的树叶)和城市环境(闪光)中。从真实视频中估计视觉重复是具有挑战性的,因为周期性运动很少是完全静态和静止的。为了更好地处理逼真的视频,我们提升了现有工作中经常做出的静态和静止假设。我们的时空滤波方法,建立在周期运动理论,有效地处理各种各样的外观,不需要学习。从3D运动开始,我们通过将运动场分解成其基本分量来导出三种周期性运动类型。此外,三个时间运动连续性出现从外地的时间动态。对于3D运动的2D感知,我们考虑相对于运动的视点;以下是18例复发性运动感知。为了在所有情况下估计重复,我们的理论意味着构建差分运动映射的混合:梯度,发散和旋度。我们用小波滤波器对运动图进行时间卷积,以估计重复动态。我们的方法是能够空间段重复运动直接从密集计算的运动图的时间滤波器响应。为了实验验证我们的主张,我们使用我们的新数据集进行重复估计,更好地反映了非静态和非平稳重复运动的现实。在重复计数的任务上,与深度学习替代方案相比,我们获得了有利的结果。
英文摘要:
Visual repetition is ubiquitous in our world. It appears in human activity (sports, cooking), animal behavior (a bee's waggle dance), natural phenomena (leaves in the wind) and in urban environments (flashing lights). Estimating visual repetition from realistic video is challenging as periodic motion is rarely perfectly static and stationary. To better deal with realistic video, we elevate the static and stationary assumptions often made by existing work. Our spatiotemporal filtering approach, established on the theory of periodic motion, effectively handles a wide variety of appearances and requires no learning. Starting from motion in 3D we derive three periodic motion types by decomposition of the motion field into its fundamental components. In addition, three temporal motion continuities emerge from the field's temporal dynamics. For the 2D perception of 3D motion we consider the viewpoint relative to the motion; what follows are 18 cases of recurrent motion perception. To estimate repetition under all circumstances, our theory implies constructing a mixture of differential motion maps: gradient, divergence and curl. We temporally convolve the motion maps with wavelet filters to estimate repetitive dynamics. Our method is able to spatially segment repetitive motion directly from the temporal filter responses densely computed over the motion maps. For experimental verification of our claims, we use our novel dataset for repetition estimation, better-reflecting reality with non-static and non-stationary repetitive motion. On the task of repetition counting, we obtain favorable results compared to a deep learning alternative.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。