arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.12318cs.CV
收藏

增强时空交互学习的视频去重:一个更快更好的框架

Enhanced Spatio-Temporal Interaction Learning for Video Deraining: A Faster and Better Framework

College of Engineering and Computer Science, the Australian National University(澳大利亚国立大学工程与计算机学院);Tencent(腾讯);State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所信息安全国家重点实验室)

Kaihao Zhang, Dongxu Li, Wenhan Luo, Wenqi Ren, Wei Liu

摘要:

视频去伪是计算机视觉中的一项重要任务,因为不必要的降雨会阻碍视频的可见性,并降低大多数户外视觉系统的鲁棒性。尽管近年来视频去噪技术取得了巨大的成功,但仍存在两个主要的挑战:1)如何利用连续帧间的大量信息,在时空域上提取强有力的时空特征; 2)如何以高速的方法恢复高质量的去噪视频。在本文中,我们提出了一个新的端到端的视频deraining框架,名为增强时空交互网络(ESTINet),大大提高了当前最先进的视频deraining的质量和速度。ESTINet利用了深度残差网络和卷积长短期记忆的优势,能够以非常少的计算资源为代价捕捉连续帧之间的空间特征和时间相关性。在三个公共数据集上的实验表明,所提出的ESTINet可以实现比竞争对手更快的速度,同时保持比最先进的方法更好的性能。

英文摘要:

Video deraining is an important task in computer vision as the unwanted rain hampers the visibility of videos and deteriorates the robustness of most outdoor vision systems. Despite the significant success which has been achieved for video deraining recently, two major challenges remain: 1) how to exploit the vast information among continuous frames to extract powerful spatio-temporal features across both the spatial and temporal domains, and 2) how to restore high-quality derained videos with a high-speed approach. In this paper, we present a new end-to-end video deraining framework, named Enhanced Spatio-Temporal Interaction Network (ESTINet), which considerably boosts current state-of-the-art video deraining quality and speed. The ESTINet takes the advantage of deep residual networks and convolutional long short-term memory, which can capture the spatial features and temporal correlations among continuing frames at the cost of very little computational source. Extensive experiments on three public datasets show that the proposed ESTINet can achieve faster speed than the competitors, while maintaining better performance than the state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑