arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.02796cs.CV
收藏

面向轻量级图像超分辨率的跨感受野聚焦推理网络

Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution

Nanjing University of Posts and Telecommunications(南京邮电大学);Soochow University(苏州大学);Shanghai University(上海大学);Nanjing University of Science and Technology(南京理工大学);Beijing University of Posts and Telecommunications(北京邮电大学)

Wenjie Li, Juncheng Li, Guangwei Gao, Jiantao Zhou, Jian Yang, Guo-Jun Qi

AI总结:

针对现有Transformer超分方法忽视动态上下文特征提取的问题,提出融合CNN与Transformer的轻量CFIN网络,通过跨尺度聚合和跨感受野引导Transformer实现高效重建,在性能与计算成本间取得良好平衡。

摘要:

近年来,基于Transformer的方法因具备全局特征提取能力,在单图像超分辨率(SISR)任务中展现出优异性能。然而,这类Transformer需要融合上下文信息以动态提取特征的能力却被忽视了。为解决这一问题,我们提出了轻量级的跨感受野聚焦推理网络(CFIN),它由级联的、融合了CNN与Transformer的CT模块构成。具体而言,在CT模块中,我们首先提出了基于CNN的跨尺度信息聚合模块(CIAM),使模型能更好地聚焦于潜在有用的信息,以提升Transformer阶段的效率。随后,我们设计了一种新颖的跨感受野引导Transformer(CFGT),借助能理解当前语义信息的调制卷积核,并利用不同自注意力机制内的信息交互,来选择重建所需的上下文信息。大量实验表明,我们提出的CFIN能够利用上下文信息有效重建图像,作为一种高效模型,它能在计算成本与模型性能之间取得良好平衡。源代码将发布于https://github.com/IVIPLab/CFIN。

英文摘要:

Recently, Transformer-based methods have shown impressive performance in single image super-resolution (SISR) tasks due to the ability of global feature extraction. However, the capabilities of Transformers that need to incorporate contextual information to extract features dynamically are neglected. To address this issue, we propose a lightweight Cross-receptive Focused Inference Network (CFIN) that consists of a cascade of CT Blocks mixed with CNN and Transformer. Specifically, in the CT block, we first propose a CNN-based Cross-Scale Information Aggregation Module (CIAM) to enable the model to better focus on potentially helpful information to improve the efficiency of the Transformer phase. Then, we design a novel Cross-receptive Field Guided Transformer (CFGT) to enable the selection of contextual information required for reconstruction by using a modulated convolutional kernel that understands the current semantic information and exploits the information interaction within different self-attention. Extensive experiments have shown that our proposed CFIN can effectively reconstruct images using contextual information, and it can strike a good balance between computational cost and model performance as an efficient model. Source codes will be available at https://github.com/IVIPLab/CFIN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑