arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.00752cs.CV
收藏

从人脸到自然图像:学习真实退化的盲图像超分辨率

From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution

Harbin Institute of Technology(哈尔滨工业大学);The Hong Kong Polytechnic University(香港理工大学);Nanyang Technological University(南洋理工大学);Alibaba Group(阿里巴巴集团);Peng Cheng Lab(鹏城实验室)

Xiaoming Li, Chaofeng Chen, Xianhui Lin, Wangmeng Zuo, Lei Zhang

摘要:

如何设计合适的训练对是超分辨率真实世界低质量(LQ)图像的关键,这在获取成对的地面真实高质量(HQ)图像或合成照片级真实感退化LQ观测值方面存在困难。最近的工作主要集中在建模的退化与手工或估计的退化参数,但无法模拟复杂的现实世界的退化类型,导致有限的质量改善。值得注意的是,LQ人脸图像,这可能有相同的退化过程,自然图像,可以鲁棒地恢复与照片般逼真的纹理,利用其强大的结构先验。这促使我们使用真实世界的LQ人脸图像及其恢复的HQ对应物来模拟复杂的真实世界退化(即ReDegNet),然后将其转移到HQ自然图像中以合成其逼真的LQ对应物。通过将这些成对的HQ-LQ人脸图像作为输入来显式地预测退化感知和内容无关的表示,我们可以控制退化图像的生成,并随后将这些退化表示从人脸转移到自然图像以合成退化的LQ自然图像。实验表明,我们的ReDegNet可以很好地学习真实的退化过程中的人脸图像。用我们的合成对训练的恢复网络对SOTA表现良好。更重要的是,我们的方法提供了一种新的方法来处理现实世界中的复杂场景,通过学习他们的退化表示从面部部分,这可以用来显着提高非面部区域的质量。源代码可在https://github.com/csxmli2016/ReDegNet上获得。

英文摘要:

How to design proper training pairs is critical for super-resolving real-world low-quality (LQ) images, which suffers from the difficulties in either acquiring paired ground-truth high-quality (HQ) images or synthesizing photo-realistic degraded LQ observations. Recent works mainly focus on modeling the degradation with handcrafted or estimated degradation parameters, which are however incapable to model complicated real-world degradation types, resulting in limited quality improvement. Notably, LQ face images, which may have the same degradation process as natural images, can be robustly restored with photo-realistic textures by exploiting their strong structural priors. This motivates us to use the real-world LQ face images and their restored HQ counterparts to model the complex real-world degradation (namely ReDegNet), and then transfer it to HQ natural images to synthesize their realistic LQ counterparts. By taking these paired HQ-LQ face images as inputs to explicitly predict the degradation-aware and content-independent representations, we could control the degraded image generation, and subsequently transfer these degradation representations from face to natural images to synthesize the degraded LQ natural images. Experiments show that our ReDegNet can well learn the real degradation process from face images. The restoration network trained with our synthetic pairs performs favorably against SOTAs. More importantly, our method provides a new way to handle the real-world complex scenarios by learning their degradation representations from the facial portions, which can be used to significantly improve the quality of non-facial areas. The source code is available at https://github.com/csxmli2016/ReDegNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑