From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution
Harbin Institute of Technology(哈尔滨工业大学);The Hong Kong Polytechnic University(香港理工大学);Nanyang Technological University(南洋理工大学);Alibaba Group(阿里巴巴集团);Peng Cheng Lab(鹏城实验室)
Xiaoming Li, Chaofeng Chen, Xianhui Lin, Wangmeng Zuo, Lei Zhang
How to design proper training pairs is critical for super-resolving real-world low-quality (LQ) images, which suffers from the difficulties in either acquiring paired ground-truth high-quality (HQ) images or synthesizing photo-realistic degraded LQ observations. Recent works mainly focus on modeling the degradation with handcrafted or estimated degradation parameters, which are however incapable to model complicated real-world degradation types, resulting in limited quality improvement. Notably, LQ face images, which may have the same degradation process as natural images, can be robustly restored with photo-realistic textures by exploiting their strong structural priors. This motivates us to use the real-world LQ face images and their restored HQ counterparts to model the complex real-world degradation (namely ReDegNet), and then transfer it to HQ natural images to synthesize their realistic LQ counterparts. By taking these paired HQ-LQ face images as inputs to explicitly predict the degradation-aware and content-independent representations, we could control the degraded image generation, and subsequently transfer these degradation representations from face to natural images to synthesize the degraded LQ natural images. Experiments show that our ReDegNet can well learn the real degradation process from face images. The restoration network trained with our synthetic pairs performs favorably against SOTAs. More importantly, our method provides a new way to handle the real-world complex scenarios by learning their degradation representations from the facial portions, which can be used to significantly improve the quality of non-facial areas. The source code is available at https://github.com/csxmli2016/ReDegNet.
Transitional Learning: Exploring the Transition States of Degradation for Blind Super-resolution
Beijing Normal University(北京师范大学);Xidian University(西安电子科技大学);Xinjiang Medical University(新疆医科大学);Chongqing University of Posts and Telecommunications(重庆邮电大学)
From General to Specific: Online Updating for Blind Super-Resolution
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel
The University of Hong Kong(香港大学);Xi’an Jiaotong University(西安交通大学);Baidu Research(百度研究院);The Hong Kong Polytechnic University(香港理工大学);Peng Cheng Laboratory(鹏城实验室)
基于模型的单图像盲超分辨率(SISR)研究近年来取得了巨大的成就,但大多没有充分考虑图像退化的影响。首先,他们总是假设图像噪声服从独立同分布(i.i.d.)高斯或拉普拉斯分布,这在很大程度上低估了真实噪声的复杂性。其次,以前常用的内核先验(例如,标准化、稀疏性)不足以有效地保证合理的内核解决方案,从而降低了后续SISR任务的性能。针对上述问题,本文提出了一种基于模型的概率框架下的盲SISR方法,从噪声和模糊核的角度对图像退化进行建模。具体来说,不是传统的i.i.d.噪声假设,基于块的非i.i.d.提出了一种噪声模型来处理复杂的实际噪声,期望增加模型的自由度来表示噪声。对于模糊核,我们新颖地构造了一个简洁而有效的核生成器,并将其作为显式核先验(EKP)插入到所提出的盲SISR方法中。为了解决所提出的模型,一个理论上接地Monte Carlo EM算法是专门设计的。综合实验表明,我们的方法优于当前国家的最先进的合成和真实数据集。源代码可在https://github.com/zsyOAOA/BSRDM上获得。
Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution
Applied Research Center (ARC), Tencent PCG(腾讯平台与内容事业群应用研究中心);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学)
A Closer Look at Blind Super-Resolution: Degradation Models, Baselines, and Performance Upper Bounds
The HongKong Polytechnic University(香港理工大学);Shenzhen Institute of Advanced Technology, CAS(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Shanghai AI Laboratory(上海人工智能实验室)
Content-decoupled Contrastive Learning-based Implicit Degradation Modeling for Blind Image Super-Resolution
School of Control and Computer Engineering, North China Electric Power University(华北电力大学控制与计算机工程学院);School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院)
LightBSR: Towards Lightweight Blind Super-Resolution via Discriminative Implicit Degradation Representation Learning
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,中国科学院自动化研究所);North China Electric Power University(华北电力大学);Beijing Jiaotong University(北京交通大学);YunQue AGI, Hangzhou, China(云阙AGI,杭州,中国)
The University of Hong Kong(香港大学);The University of Sydney(悉尼大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
Adaptive Blind Super-Resolution Network for Spatial-Specific and Spatial-Agnostic Degradations
VCIP, College of Computer Science, Nankai University, Tianjin, 300350, China(VCIP,计算机科学学院,南开大学,天津,300350,中国);School of Cyber Science and Technology, Shenzhen Campus, Sun Yat-sen University, Shenzhen 518107, P.R. China(网络安全科学与技术学院,深圳校区,中山大学,深圳 518107,中华人民共和国中国);College of Artificial Intelligence, Nankai University, Tianjin, 300350, China(人工智能学院,南开大学,天津,300350,中国);Laboratory of Science and Technology on Integrated Logistics Support, National University of Defense Technology, Changsha 410073, China(集成物流支持科学技术实验室,国防科技大学,长沙 410073,中国)
BIR-Adapter: A parameter-efficient diffusion adapter for blind image restoration
Chair of Media Technology, Munich Institute of Robotics and Machine Intelligence(媒体技术教授会,慕尼黑机器人与机器智能研究所);School of Computation, Information and Technology, Technical University of Munich(计算、信息与技术学院,慕尼黑技术大学)
Learning the Degradation Distribution for Blind Image Super-Resolution
University of Chinese Academy of Sciences (UCAS)(中国科学院大学);National Laboratory of Pattern Recognition (NLPR)(模式识别国家重点实验室);Center for Research on Intelligent Perception and Computing (CRIPAC)(智能感知与计算研究中心)
DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
Expanding Synthetic Real-World Degradations for Blind Video Super Resolution
K|Lens GmbH(K|Lens有限公司);Saarland Informatics Campus(萨尔兰信息学园区);IIT Jammu(印度理工学院查谟分校);MPI Informatics(马克斯·普朗克信息学研究所);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI))
Simultaneous Fidelity and Regularization Learning for Image Restoration
Tianjin University(天津大学);Hong Kong Polytechnic University(香港理工大学);Harbin Institute of Technology(哈尔滨工业大学);Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));University of California, Merced(加州大学默塞德分校)
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data
Applied Research Center (ARC), Tencent PCG(腾讯PCG应用研究中心);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Shanghai AI Laboratory(上海人工智能实验室)