arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1809.06557cs.CVeess.IV
收藏

基于确定性-随机合成和局部统计校正的图像超分辨率

Image Super-Resolution via Deterministic-Stochastic Synthesis and Local Statistical Rectification

The University of Hong Kong(香港大学)

Weifeng Ge, Bingchen Gong, Yizhou Yu

摘要:

单图像超分辨率在过去二十年中一直是一个热门的研究课题,最近由于深度神经网络而受到新一轮的关注。在本文中,我们从不同的角度来探讨这个问题。对于下采样的低分辨率图像,我们将高分辨率图像建模为两个分量的组合,确定性分量和随机分量。确定性分量可以从下采样图像中的低频信号中恢复。另一方面,随机分量包含与低分辨率图像几乎没有相关性的信号。我们采用两种互补的方法来生成这两个组件。虽然生成对抗网络用于随机分量,但确定性分量重建被公式化为使用深度神经网络解决的回归问题。由于确定性分量具有更清晰的局部方向,因此我们设计了针对这些属性定制的新型损失函数来训练深度回归网络。这两种方法首先应用于整个输入图像,以产生两个不同的高分辨率图像。之后,使用另一个也执行局部统计校正的深度神经网络将这两个图像融合在一起,该深度神经网络试图使融合图像的局部统计与地面实况图像的相同局部统计相匹配。定量结果和用户研究表明,该方法优于现有的国家的最先进的算法具有明显的利润率。

英文摘要:

Single image superresolution has been a popular research topic in the last two decades and has recently received a new wave of interest due to deep neural networks. In this paper, we approach this problem from a different perspective. With respect to a downsampled low resolution image, we model a high resolution image as a combination of two components, a deterministic component and a stochastic component. The deterministic component can be recovered from the low-frequency signals in the downsampled image. The stochastic component, on the other hand, contains the signals that have little correlation with the low resolution image. We adopt two complementary methods for generating these two components. While generative adversarial networks are used for the stochastic component, deterministic component reconstruction is formulated as a regression problem solved using deep neural networks. Since the deterministic component exhibits clearer local orientations, we design novel loss functions tailored for such properties for training the deep regression network. These two methods are first applied to the entire input image to produce two distinct high-resolution images. Afterwards, these two images are fused together using another deep neural network that also performs local statistical rectification, which tries to make the local statistics of the fused image match the same local statistics of the groundtruth image. Quantitative results and a user study indicate that the proposed method outperforms existing state-of-the-art algorithms with a clear margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑