arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.01070cs.CVcs.AI
收藏

盲超分辨率中特定退化的鉴别滤波器

Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution

Applied Research Center (ARC), Tencent PCG(腾讯平台与内容事业群应用研究中心);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学)

Liangbin Xie, Xintao Wang, Chao Dong, Zhongang Qi, Ying Shan

摘要:

最近的盲超分辨率(SR)方法通常由两个分支组成,一个用于退化预测,另一个用于条件恢复。然而,我们的实验表明,一个分支网络可以实现相当的性能,两个分支计划。然后我们想知道:单分支网络如何自动学习区分降级?为了找到答案,我们提出了一种新的诊断工具--基于积分梯度的过滤属性方法(FAIG)。与以前的积分梯度方法不同,我们的FAIG旨在找到最具鉴别力的滤波器,而不是输入像素/特征,用于盲SR网络中的降级去除。与发现的过滤器,我们进一步开发了一个简单而有效的方法来预测输入图像的退化。基于FAIG,我们表明,在单分支盲SR网络中,1)我们能够为每个特定的退化找到非常少量(1%)的判别滤波器; 2)所发现的滤波器的权重,位置和连接对于确定特定的网络函数都很重要。3)退化预测的任务可以通过这些判别式滤波器隐式地实现,而无需显式的监督学习。我们的研究结果不仅可以帮助我们更好地理解单分支盲SR网络中的网络行为,而且可以为设计更有效的结构和诊断盲SR网络提供指导。

英文摘要:

Recent blind super-resolution (SR) methods typically consist of two branches, one for degradation prediction and the other for conditional restoration. However, our experiments show that a one-branch network can achieve comparable performance to the two-branch scheme. Then we wonder: how can one-branch networks automatically learn to distinguish degradations? To find the answer, we propose a new diagnostic tool -- Filter Attribution method based on Integral Gradient (FAIG). Unlike previous integral gradient methods, our FAIG aims at finding the most discriminative filters instead of input pixels/features for degradation removal in blind SR networks. With the discovered filters, we further develop a simple yet effective method to predict the degradation of an input image. Based on FAIG, we show that, in one-branch blind SR networks, 1) we are able to find a very small number of (1%) discriminative filters for each specific degradation; 2) The weights, locations and connections of the discovered filters are all important to determine the specific network function. 3) The task of degradation prediction can be implicitly realized by these discriminative filters without explicit supervised learning. Our findings can not only help us better understand network behaviors inside one-branch blind SR networks, but also provide guidance on designing more efficient architectures and diagnosing networks for blind SR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑