Low level image restoration is an integral component of modern artificial intelligence (AI) driven camera pipelines. Most of these frameworks are based on deep neural networks which present a massive computational overhead on resource constrained platform like a mobile phone. In this paper, we propose several lightweight low-level modules which can be used to create a computationally low cost variant of a given baseline model. Recent works for efficient neural networks design have mainly focused on classification. However, low-level image processing falls under the image-to-image' translation genre which requires some additional computational modules not present in classification. This paper seeks to bridge this gap by designing generic efficient modules which can replace essential components used in contemporary deep learning based image restoration networks. We also present and analyse our results highlighting the drawbacks of applying depthwise separable convolutional kernel (a popular method for efficient classification network) for sub-pixel convolution based upsampling (a popular upsampling strategy for low-level vision applications). This shows that concepts from domain of classification cannot always be seamlessly integrated into image-to-image translation tasks. We extensively validate our findings on three popular tasks of image inpainting, denoising and super-resolution. Our results show that proposed networks consistently output visually similar reconstructions compared to full capacity baselines with significant reduction of parameters, memory footprint and execution speeds on contemporary mobile devices.
Lightweight Medical Image Restoration via Integrating Reliable Lesion-Semantic Driven Prior
University of Electronic Science and Technology of China(电子科技大学);City University of Hong Kong(香港城市大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Shenzhen Institute For Advanced Study, University of Electronic Science and Technology of China(电子科技大学深圳研究院)
Bracketing Image Restoration and Enhancement with High-Low Frequency Decomposition
Xi’an University of Architecture and Technology(西安建筑科技大学);Northwestern Polytechnical University(西北工业大学);University of Macau(澳门大学);Xi’an Institute of Optics and Precision Mechanics of CAS(中国科学院西安光学精密机械研究所)
Lightweight Data-Free Denoising for Detail-Preserving Biomedical Image Restoration
School of Computation, Information and Technology, Technical University of Munich(计算信息学院,慕尼黑技术大学);Helmholtz AI, Helmholtz Munich - German Research Center for Environmental Health(海德堡人工智能,海德堡-德国环境健康研究所以及研究中心);School of Biomedical Engineering and Imaging Sciences, King’s College London(生物医学工程与成像科学学院,伦敦国王学院)
UHDRes: Ultra-High-Definition Image Restoration via Dual-Domain Decoupled Spectral Modulation
College of Computer Science and Artificial Intelligence, Wenzhou University(计算机科学与人工智能学院,温州大学);State Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学);College of Engineering and Computer Science, Australian National University(工程与计算机科学学院,澳大利亚国立大学)
Attention-Guided Progressive Neural Texture Fusion for High Dynamic Range Image Restoration
Hong Kong Baptist University(香港浸会大学);Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究院);vivo Mobile Communication Co. Ltd(维沃移动通信有限公司);City University of Hong Kong(香港城市大学);Nanyang Technological University(南洋理工大学)
Learning Disentangled Feature Representation for Hybrid-distorted Image Restoration
CAS Key Laboratory of Technology in Geo-spatial Information Processing and Application System, University of Science and Technology of China(中国科学技术大学 中国科学院空间信息处理与应用系统技术重点实验室)
Concatenated Attention Neural Network for Image Restoration
University of Chinese Academy of Sciences(中国科学院大学);Research Center on Fictitious Economy and Data Science, Chinese Academy of Sciences(中国科学院虚拟经济与数据科学研究中心);Key Laboratory of Big Data Mining and Knowledge Management Chinese Academy of Sciences(中国科学院大数据挖掘与知识管理重点实验室)
Re-boosting Self-Collaboration Parallel Prompt GAN for Unsupervised Image Restoration
College of Electronics and Information Engineering, Sichuan University(电子信息工程学院,四川大学);University of California at Merced(加州大学默塞德分校);Department of Computer Science and Engineering, Hong Kong University of Science and Technology(香港理工大学计算机科学与工程系);Google DeepMind, USA
Blur-Attention: A boosting mechanism for non-uniform blurred image restoration
Beijing University of Technology(北京工业大学);Beijing Key Laboratory of Computational Intelligence and Intelligent System(计算智能与智能系统北京市重点实验室);The Hong Kong Polytechnic University(香港理工大学)
Wavelet-Enhanced Desnowing: A Novel Single Image Restoration Approach for Traffic Surveillance under Adverse Weather Conditions
Automatic Control Research Institute, China Nuclear Power Engineering Co., Ltd.(中国核电工程有限公司自动控制研究院);CNNC Engineering Research Center for Fuel Reprocessing(中核集团燃料后处理工程研究中心);Chinese Aeronautical Establishment, Aviation Industry Corporation of China, Ltd(中国航空工业集团有限公司中国航空研究院)
Compositional-Degradation UAV Image Restoration: Conditional Decoupled MoE Network and A Benchmark
Key Laboratory of Intelligent Computing & Signal Processing (Anhui University), Ministry of Education(教育部智能计算与信号处理重点实验室(安徽大学));Anhui Provincial Key Laboratory of Multimodal Cognitive Computation(安徽省多模态认知计算重点实验室);School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院)
Learning Adaptive Dynamical Features via Multi-$τ$ Liquid-Mamba for All-in-one Image Restoration
Department of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学与技术系);Department of Architecture and Design, Harbin Institute of Technology(哈尔滨工业大学建筑与设计系)
EDVR: Video Restoration with Enhanced Deformable Convolutional Networks
Nanyang Technological University(南洋理工大学);The Chinese University of Hong Kong(香港中文大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
Efficient Terrain Stochastic Differential Efficient Terrain Stochastic Differential Equations for Multipurpose Digital Elevation Model Restoration
School of Aeronautics and Astronautics, Shanghai Jiao Tong University(上海交通大学航空航天学院);Land Satellite Remote Sensing Application Center(陆地卫星遥感应用中心);Ministry of Natural Resources of the People’s Republic of China(中华人民共和国自然资源部);China-ASEAN Satellite Remote Sensing Applications(中国-东盟卫星遥感应用(中心))
A Progressive Image Restoration Network for High-order Degradation Imaging in Remote Sensing
School of Mathematics and Computational Science, Xiangtan University(湘潭大学数学与计算科学学院);Hunan Key Laboratory for Computation and Simulation in Science and Engineering(湖南省计算与模拟科学工程重点实验室);Key Laboratory for Intelligent Computing and Information Processing of the Ministry of Education(教育部智能计算与信息处理重点实验室);National Center for Applied Mathematics in Hunan(湖南省应用数学中心);Hunan International Scientific and Technological Innovation Cooperation Base of Computational Science(湖南省 computational science 国际科学和技术创新合作基地);College of Mathematical Medicine, Zhejiang Normal University(浙江师范大学数学医学院);School of Automation and Electronic Information, Xiangtan University(湘潭大学自动化与电子信息学院)
VQCNIR: Clearer Night Image Restoration with Vector-Quantized Codebook
South China University of Technology(华南理工大学);Pazhou Laboratory(琶洲实验室);The Hong Kong University of Science and Technology(香港科技大学);Fujian Normal University(福建师范大学)