arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1905.04696cs.CV
收藏

利用参考数据集实现超分辨率

Ensemble Super-Resolution with A Reference Dataset

Harbin Institute of Technology(哈尔滨工业大学);Peng Cheng Laboratory(鹏城实验室);National Institute of Informatics(国立信息学研究所);The University of Electro-Communications(电气通信大学);Wuhan University(武汉大学)

Junjun Jiang, Yi Yu, Zheng Wang, Suhua Tang, Ruimin Hu, Jiayi Ma

摘要:

近年来,通过发展先进的图像先验知识或设计更深的结构,各种图像超分辨率(SR)方法被提出并取得了非常有前途的性能。一个自然出现的问题是,这些方法是否可以重新制定成一个统一的框架,这个框架是否有助于SR重建?在本文中,我们提出了一个简单而有效的单图像SR方法集成学习的基础上,它可以产生一个更好的性能比可以从任何SR方法被集成(或称为组件超分辨器)。基于更好的分量超解析器在进行SR重构时应该具有更大的集成权重的假设,我们提出了一种最大后验概率(MAP)估计框架来推断最佳集成权重。特别地,我们引入了一个参考数据集,它是由高分辨率(HR)和低分辨率(LR)的图像对,以衡量超分辨率能力(先验知识)的不同组件的超分辨率。为了获得最佳的集成权重,我们建议将重建约束,这表明退化的HR图像应该等于LR观测值,以及集成权重的先验知识到MAP估计框架中。此外,所提出的优化问题可以通过解析解来解决。通过与四种最新的非深度学习方法、四种最新的基于深度学习的方法和一种基于集成学习的方法进行比较,研究了该方法的性能,并在三个公开数据集上证明了其有效性和优越性。

英文摘要:

By developing sophisticated image priors or designing deep(er) architectures, a variety of image Super-Resolution (SR) approaches have been proposed recently and achieved very promising performance. A natural question that arises is whether these methods can be reformulated into a unifying framework and whether this framework assists in SR reconstruction? In this paper, we present a simple but effective single image SR method based on ensemble learning, which can produce a better performance than that could be obtained from any of SR methods to be ensembled (or called component super-resolvers). Based on the assumption that better component super-resolver should have larger ensemble weight when performing SR reconstruction, we present a Maximum A Posteriori (MAP) estimation framework for the inference of optimal ensemble weights. Specially, we introduce a reference dataset, which is composed of High-Resolution (HR) and Low-Resolution (LR) image pairs, to measure the super-resolution abilities (prior knowledge) of different component super-resolvers. To obtain the optimal ensemble weights, we propose to incorporate the reconstruction constraint, which states that the degenerated HR image should be equal to the LR observation one, as well as the prior knowledge of ensemble weights into the MAP estimation framework. Moreover, the proposed optimization problem can be solved by an analytical solution. We study the performance of the proposed method by comparing with different competitive approaches, including four state-of-the-art non-deep learning based methods, four latest deep learning based methods and one ensemble learning based method, and prove its effectiveness and superiority on three public datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑