arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.01057cs.CV
收藏

单图像超分辨率的全局可学习注意

Global Learnable Attention for Single Image Super-Resolution

Fuzhou University(福州大学);South China University of Technology(华南理工大学);University of Macau(澳门大学)

Jian-Nan Su, Min Gan, Guang-Yong Chen, Jia-Li Yin, C. L. Philip Chen

摘要:

自相似性对于单幅图像超分辨率(SISR)中非局部纹理的探索具有重要意义。研究者通常认为非局部纹理的重要性与它们的相似性分数呈正相关。在本文中,我们惊讶地发现,在修复严重损坏的查询纹理,一些非局部的低相似度的纹理,更接近目标可以提供更准确和更丰富的细节比高相似度的。在这些情况下,低相似性并不意味着低劣,但通常是由不同的尺度或方向引起的。利用这一发现,我们提出了一种全局可学习注意力(GLA),在训练过程中自适应地修改非局部纹理的相似性得分,而不是只使用固定的相似性得分函数,如点积。GLA算法能够挖掘出非局部纹理中相似度较低但细节更精确的细节,从而修复严重受损的纹理。此外,我们建议采用超位局部敏感哈希(SB-LSH)作为我们的GLA的预处理方法。与SB-LSH,我们的GLA的计算复杂性是减少从二次到渐近线性的图像大小。此外,建议的GLA可以集成到现有的深SISR模型作为一个有效的通用构建块。基于GLA,我们构建了一个深度可学习的相似性网络(DLSN),它对不同退化类型(例如模糊和噪声)的SISR任务实现了最先进的性能。我们的代码和预训练的DLSN已经上传到GitHub†进行验证。

英文摘要:

Self-similarity is valuable to the exploration of non-local textures in single image super-resolution (SISR). Researchers usually assume that the importance of non-local textures is positively related to their similarity scores. In this paper, we surprisingly found that when repairing severely damaged query textures, some non-local textures with low-similarity which are closer to the target can provide more accurate and richer details than the high-similarity ones. In these cases, low-similarity does not mean inferior but is usually caused by different scales or orientations. Utilizing this finding, we proposed a Global Learnable Attention (GLA) to adaptively modify similarity scores of non-local textures during training instead of only using a fixed similarity scoring function such as the dot product. The proposed GLA can explore non-local textures with low-similarity but more accurate details to repair severely damaged textures. Furthermore, we propose to adopt Super-Bit Locality-Sensitive Hashing (SB-LSH) as a preprocessing method for our GLA. With the SB-LSH, the computational complexity of our GLA is reduced from quadratic to asymptotic linear with respect to the image size. In addition, the proposed GLA can be integrated into existing deep SISR models as an efficient general building block. Based on the GLA, we constructed a Deep Learnable Similarity Network (DLSN), which achieves state-of-the-art performance for SISR tasks of different degradation types (e.g. blur and noise). Our code and a pre-trained DLSN have been uploaded to GitHub† for validation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑