arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.00893cs.CV
收藏

降质图像超分辨率的选通融合网络

Gated Fusion Network for Degraded Image Super Resolution

Xi’an Jiaotong University(西安交通大学);Hikvision Research America(海康威视美国研究院);University of California, Merced(加州大学默塞德分校)

Xinyi Zhang, Hang Dong, Zhe Hu, Wei-Sheng Lai, Fei Wang, Ming-Hsuan Yang

摘要:

单帧图像的超分辨率旨在提高图像的空间质量,是计算机视觉的一项基本任务。在这项工作中,我们解决的任务,单帧超分辨率与图像退化的存在,例如,模糊、薄雾或雨条纹。由于帧捕获和形成过程的限制,图像退化是不可避免的,并且超分辨率方法会加剧伪影。为了解决这个问题,我们提出了一个双分支卷积神经网络,分别提取基本特征和恢复特征。基本特征包含输入图像的局部和全局信息。另一方面,恢复的特征集中在退化区域,并用于去除退化。然后通过递归门模块融合这些特征以获得超分辨率的尖锐特征。通过将特征提取步骤分解为两个任务无关的流,双分支模型可以通过避免学习混合退化一体化来促进训练过程,从而增强最终的高分辨率预测结果。我们评估所提出的方法在三个退化的情况下。在这些场景下的实验表明,该方法在基准数据集上的性能比现有的方法更有效。

英文摘要:

Single image super resolution aims to enhance image quality with respect to spatial content, which is a fundamental task in computer vision. In this work, we address the task of single frame super resolution with the presence of image degradation, e.g., blur, haze, or rain streaks. Due to the limitations of frame capturing and formation processes, image degradation is inevitable, and the artifacts would be exacerbated by super resolution methods. To address this problem, we propose a dual-branch convolutional neural network to extract base features and recovered features separately. The base features contain local and global information of the input image. On the other hand, the recovered features focus on the degraded regions and are used to remove the degradation. Those features are then fused through a recursive gate module to obtain sharp features for super resolution. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process by avoiding learning the mixed degradation all-in-one and thus enhance the final high-resolution prediction results. We evaluate the proposed method in three degradation scenarios. Experiments on these scenarios demonstrate that the proposed method performs more efficiently and favorably against the state-of-the-art approaches on benchmark datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑