Transformer-based deep models for single image super-resolution (SISR) have greatly improved the performance of lightweight SISR tasks in recent years. However, they often suffer from heavy computational burden and slow inference due to the complex calculation of multi-head self-attention (MSA), seriously hindering their practical application and deployment. In this work, we present an efficient SR model to mitigate the dilemma between model efficiency and SR performance, which is dubbed Entropy Attention and Receptive Field Augmentation network (EARFA), and composed of a novel entropy attention (EA) and a shifting large kernel attention (SLKA). From the perspective of information theory, EA increases the entropy of intermediate features conditioned on a Gaussian distribution, providing more informative input for subsequent reasoning. On the other hand, SLKA extends the receptive field of SR models with the assistance of channel shifting, which also favors to boost the diversity of hierarchical features. Since the implementation of EA and SLKA does not involve complex computations (such as extensive matrix multiplications), the proposed method can achieve faster nonlinear inference than Transformer-based SR models while maintaining better SR performance. Extensive experiments show that the proposed model can significantly reduce the delay of model inference while achieving the SR performance comparable with other advanced models.
Efficient Image Super-Resolution using Vast-Receptive-Field Attention
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shanghai AI Laboratory(上海人工智能实验室);The University of Sydney(悉尼大学)
Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution
Nanjing University of Posts and Telecommunications(南京邮电大学);Soochow University(苏州大学);Shanghai University(上海大学);Nanjing University of Science and Technology(南京理工大学);Beijing University of Posts and Telecommunications(北京邮电大学)
UCAN: Unified Convolutional Attention Network for Expansive Receptive Fields in Lightweight Super-Resolution
Ho Chi Minh City Open University(胡志明市开放大学);AI Tech Lab, Ho Chi Minh City University of Technology(胡志明市科技大学人工智能技术实验室);Code Mely AI Research Team(Code Mely 人工智能研究团队);Global College, Shanghai Jiao Tong University(上海交通大学全球学院);Ha Noi University of Science and Technology(河内科技大学);University of Manitoba(曼尼托巴大学)
Pixel-aware Deep Function-mixture Network for Spectral Super-Resolution
Institute of Artificial Intelligence, United Arab Emirates(阿拉伯联合酋长国人工智能研究所);School of Computer Science and Engineering, Northwestern Polytechnical University(西北工业大学计算机科学与工程学院);School of Computer Science, The University of Adelaide(阿德莱德大学计算机学院);School of Computer Science, The University of Adelaide, Australia(阿德莱德大学计算机学院)
Transformer-Progressive Mamba Network for Lightweight Image Super-Resolution
Bell Honors School, Nanjing University of Posts and Telecommunications(南京邮电大学贝尔荣誉学院);State Key Laboratory of Integrated Services Networks, Xidian University(西安电子科技大学集成服务网络国家重点实验室);Pattern Recognition and Intelligent System Laboratory, School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院模式识别与智能系统实验室);Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院智能感知与高维信息系统教育部重点实验室);Department of Electrical Engineering and the Institute of Communications Engineering, National Tsing Hua University(国立交通大学电子工程系与通信工程研究所)
Perspective+ Unet: Enhancing Segmentation with Bi-Path Fusion and Efficient Non-Local Attention for Superior Receptive Fields
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院)