arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.10997cs.CV
收藏

深爆发超分辨率

Deep Burst Super-Resolution

ETH Zurich(苏黎世联邦理工学院)

Goutam Bhat, Martin Danelljan, Luc Van Gool, Radu Timofte

摘要:

虽然单图像超分辨率(SISR)近年来引起了人们的极大兴趣,但所提出的方法仅限于学习图像先验知识以添加高频细节。相比之下,多帧超分辨率(MFSR)提供了通过组合来自多个移位图像的信号信息来重建丰富细节的可能性。这一关键优势,以及突发摄影的日益普及,使MFSR成为现实世界应用的一个重要问题。我们提出了一种新的架构的突发超分辨率任务。我们的网络将多个嘈杂的RAW图像作为输入,并生成一个去噪的超分辨率RGB图像作为输出。这是通过使用逐像素光流明确地对准输入帧的深度嵌入来实现的。然后使用基于注意力的融合模块自适应地合并来自所有帧的信息。为了能够对真实世界的数据进行训练和评估,我们还引入了BurstSR数据集,该数据集由智能手机突发和高分辨率DSLR地面实况组成。我们进行全面的实验分析,证明所提出的架构的有效性。

英文摘要:

While single-image super-resolution (SISR) has attracted substantial interest in recent years, the proposed approaches are limited to learning image priors in order to add high frequency details. In contrast, multi-frame super-resolution (MFSR) offers the possibility of reconstructing rich details by combining signal information from multiple shifted images. This key advantage, along with the increasing popularity of burst photography, have made MFSR an important problem for real-world applications. We propose a novel architecture for the burst super-resolution task. Our network takes multiple noisy RAW images as input, and generates a denoised, super-resolved RGB image as output. This is achieved by explicitly aligning deep embeddings of the input frames using pixel-wise optical flow. The information from all frames are then adaptively merged using an attention-based fusion module. In order to enable training and evaluation on real-world data, we additionally introduce the BurstSR dataset, consisting of smartphone bursts and high-resolution DSLR ground-truth. We perform comprehensive experimental analysis, demonstrating the effectiveness of the proposed architecture.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑