arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.00187eess.IVcs.CV
收藏

图像复原的图像制导方法

Image Restoration using Feature-guidance

Maitreya Suin, Kuldeep Purohit, A. N. Rajagopalan

摘要:

图像恢复是从降级版本恢复干净图像的任务。在大多数情况下,退化是空间变化的,它需要恢复网络来定位和恢复受影响的区域。在本文中,我们提出了一种新的方法,适用于处理图像的具体和空间变化的性质的退化图像的影响,实际发生的文物,如模糊,雨条纹。我们将恢复任务分解为退化定位和退化区域引导恢复两个阶段,与直接学习退化图像和干净图像之间的映射的现有方法不同。我们的前提是使用退化掩模预测的辅助任务来指导恢复过程。我们证明了这个辅助任务训练的模型包含重要的区域知识,可以利用这些知识来指导恢复网络的训练,使用注意的知识蒸馏技术。此外,我们提出了掩模引导的卷积和全局上下文聚合模块,专注于恢复退化区域。所提出的方法的有效性证明了实现显着改善强基线。

英文摘要:

Image restoration is the task of recovering a clean image from a degraded version. In most cases, the degradation is spatially varying, and it requires the restoration network to both localize and restore the affected regions. In this paper, we present a new approach suitable for handling the image-specific and spatially-varying nature of degradation in images affected by practically occurring artifacts such as blur, rain-streaks. We decompose the restoration task into two stages of degradation localization and degraded region-guided restoration, unlike existing methods which directly learn a mapping between the degraded and clean images. Our premise is to use the auxiliary task of degradation mask prediction to guide the restoration process. We demonstrate that the model trained for this auxiliary task contains vital region knowledge, which can be exploited to guide the restoration network's training using attentive knowledge distillation technique. Further, we propose mask-guided convolution and global context aggregation module that focuses solely on restoring the degraded regions. The proposed approach's effectiveness is demonstrated by achieving significant improvement over strong baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑