利用双三次下采样图像学习真实世界图像超分辨率
Benefiting from Bicubically Down-Sampled Images for Learning Real-World Image Super-Resolution
摘要:
超分辨率(SR)传统上是基于成对的高分辨率图像(HR)和它们的低分辨率(LR)对应物,这些图像是通过双三次下采样人工获得的。然而,在现实世界的SR,有各种各样的现实图像退化和分析建模这些现实退化可以证明是相当困难的。在这项工作中,我们建议处理现实世界的SR分裂成两个相对更适定性的步骤,这个不适定的问题。首先,我们训练一个网络,通过使用真实LR/HR对和合成对,以监督的方式将真实LR图像转换到双三次下采样图像的空间。其次,我们采用一个在双三次下采样图像上训练的通用SR网络来超分辨变换后的LR图像。流水线的第一步通过将大量退化图像配准到常见的、很好理解的图像空间来解决问题。然后,第二步利用SR在双三次下采样图像上已经令人印象深刻的性能,避开了在具有许多不同图像退化的数据集上进行端到端训练的问题。我们证明了我们提出的方法的有效性,通过比较它与最近的方法在现实世界的SR,并表明我们提出的方法优于国家的最先进的作品在定性和定量的结果,以及广泛的用户研究的结果进行了几个真实的图像数据集。
英文摘要:
Super-resolution (SR) has traditionally been based on pairs of high-resolution images (HR) and their low-resolution (LR) counterparts obtained artificially with bicubic downsampling. However, in real-world SR, there is a large variety of realistic image degradations and analytically modeling these realistic degradations can prove quite difficult. In this work, we propose to handle real-world SR by splitting this ill-posed problem into two comparatively more well-posed steps. First, we train a network to transform real LR images to the space of bicubically downsampled images in a supervised manner, by using both real LR/HR pairs and synthetic pairs. Second, we take a generic SR network trained on bicubically downsampled images to super-resolve the transformed LR image. The first step of the pipeline addresses the problem by registering the large variety of degraded images to a common, well understood space of images. The second step then leverages the already impressive performance of SR on bicubically downsampled images, sidestepping the issues of end-to-end training on datasets with many different image degradations. We demonstrate the effectiveness of our proposed method by comparing it to recent methods in real-world SR and show that our proposed approach outperforms the state-of-the-art works in terms of both qualitative and quantitative results, as well as results of an extensive user study conducted on several real image datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。