arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.06266cs.CV
收藏

基于快速放大技术的多帧图像超分辨率

Multi-frame image super-resolution with fast upscaling technique

Longguang Wang, Zaiping Lin, Xinpu Deng, Wei An

摘要:

多帧图像超分辨率(MISR)是将低分辨率图像序列中的信息融合成高分辨率图像序列的技术,近年来在许多领域得到了广泛的应用。与单帧图像超分辨率(SISR)不同的是,多帧图像间的亚像素级过渡引入了额外的信息,使得融合算子具有更重要的意义,从而缓解了MISR的不适定性。对于基于重建的方法,重建误差从LR空间到HR空间的不可避免的投影通常通过插值算子来解决,然而粗糙的插值可能不适合自然图像并产生令人讨厌的模糊伪影,特别是在融合算子之后。本文提出了一种端到端的快速上尺度技术来代替插值算子,在LR空间中分别为周期子位置设计上尺度滤波器,并将滤波结果混洗以获得HR空间中的最终重建误差。提出的快速上尺度技术不仅通过利用混洗操作来避免HR空间中的复杂操作,从而降低了上尺度操作的计算复杂性,而且还实现了具有更少模糊伪影的优异性能。大量的实验结果表明,所提出的技术的有效性和效率,同时,结合所提出的技术与双边全变差(BTV)正则化,MISR方法优于国家的最先进的方法。

英文摘要:

Multi-frame image super-resolution (MISR) aims to fuse information in low-resolution (LR) image sequence to compose a high-resolution (HR) one, which is applied extensively in many areas recently. Different with single image super-resolution (SISR), sub-pixel transitions between multiple frames introduce additional information, attaching more significance to fusion operator to alleviate the ill-posedness of MISR. For reconstruction-based approaches, the inevitable projection of reconstruction errors from LR space to HR space is commonly tackled by an interpolation operator, however crude interpolation may not fit the natural image and generate annoying blurring artifacts, especially after fusion operator. In this paper, we propose an end-to-end fast upscaling technique to replace the interpolation operator, design upscaling filters in LR space for periodic sub-locations respectively and shuffle the filter results to derive the final reconstruction errors in HR space. The proposed fast upscaling technique not only reduce the computational complexity of the upscaling operation by utilizing shuffling operation to avoid complex operation in HR space, but also realize superior performance with fewer blurring artifacts. Extensive experimental results demonstrate the effectiveness and efficiency of the proposed technique, whilst, combining the proposed technique with bilateral total variation (BTV) regu-larization, the MISR approach outperforms state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑