arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.07566eess.IVcs.CVcs.LG
收藏

BAM:一种用于单图像超分辨率的平衡注意机制

BAM: A Balanced Attention Mechanism for Single Image Super Resolution

Association for the Advancement of Artificial Intelligence(人工智能促进协会)

Fanyi Wang, Haotian Hu, Cheng Shen

摘要:

从混叠区域中恢复纹理信息一直是单幅图像超分辨率(SISR)任务的主要挑战。这些区域往往淹没在噪声中,因此我们必须在抑制噪声的同时恢复纹理细节。为了解决这个问题,我们提出了一个平衡的注意力机制(BAM),它由平均池通道注意力模块(ACAM)和最大池空间注意力模块(MSAM)并行。ACAM的目的是抑制极端噪声在大规模的特征地图,而MSAM保留高频纹理细节。由于采用了并行结构,这两个模块在反向传播过程中不仅可以进行自优化,还可以进行相互优化,以获得降噪和高频纹理恢复的平衡,并行结构使得推理速度更快。为了验证BAM的有效性和鲁棒性,我们将其应用于10个SOTA SISR网络。实验结果表明,BAM能有效地提高网络性能,对于原有的注意机制,BAM的引入进一步减少了参数的数量,提高了推理速度。此外,我们提出了一个数据集,丰富的纹理在真实场景中,命名为realSR7走样区域。实验证明,BAM在混叠区域上取得了较好的超分辨率效果。

英文摘要:

Recovering texture information from the aliasing regions has always been a major challenge for Single Image Super Resolution (SISR) task. These regions are often submerged in noise so that we have to restore texture details while suppressing noise. To address this issue, we propose a Balanced Attention Mechanism (BAM), which consists of Avgpool Channel Attention Module (ACAM) and Maxpool Spatial Attention Module (MSAM) in parallel. ACAM is designed to suppress extreme noise in the large scale feature maps while MSAM preserves high-frequency texture details. Thanks to the parallel structure, these two modules not only conduct self-optimization, but also mutual optimization to obtain the balance of noise reduction and high-frequency texture restoration during the back propagation process, and the parallel structure makes the inference faster. To verify the effectiveness and robustness of BAM, we applied it to 10 SOTA SISR networks. The results demonstrate that BAM can efficiently improve the networks performance, and for those originally with attention mechanism, the substitution with BAM further reduces the amount of parameters and increases the inference speed. Moreover, we present a dataset with rich texture aliasing regions in real scenes, named realSR7. Experiments prove that BAM achieves better super-resolution results on the aliasing area.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑