基于基础帧选择的连拍图像超分辨率
Burst Image Super-Resolution with Base Frame Selection
AI总结:
本文针对非均匀曝光连拍图像超分辨率问题,提出帧选择网络(FSN),通过即插即用方式优化基础帧选择,提升合成与真实NEBI数据集上的重建质量。
摘要:
连拍图像超分辨率近年来一直是活跃的研究课题,因为它能够利用连拍中多帧之间的互补信息来获取高分辨率图像。在这项工作中,我们探索使用非均匀曝光的连拍来应对现实世界的实际场景,方法是引入一个新的基准数据集,称为非均匀曝光连拍图像(NEBI),该数据集包含不同曝光时间的连拍帧,以获取场景内更广泛的辐照度和运动特征。由于非均匀曝光的连拍表现出不同程度的退化,将连拍的信息融合到第一帧作为基础帧可能无法获得最佳的图像质量。为了解决这一限制,我们提出了一种用于非均匀场景的帧选择网络(FSN)。该网络以即插即用的方式无缝集成到现有的超分辨率方法中,且计算成本较低。对比分析揭示了非均匀设置在实际场景中的有效性,以及我们的FSN在合成/真实NEBI数据集上的表现。
英文摘要:
Burst image super-resolution has been a topic of active research in recent years due to its ability to obtain a high-resolution image by using complementary information between multiple frames in the burst. In this work, we explore using burst shots with non-uniform exposures to confront real-world practical scenarios by introducing a new benchmark dataset, dubbed Non-uniformly Exposed Burst Image (NEBI), that includes the burst frames at varying exposure times to obtain a broader range of irradiance and motion characteristics within a scene. As burst shots with non-uniform exposures exhibit varying levels of degradation, fusing information of the burst shots into the first frame as a base frame may not result in optimal image quality. To address this limitation, we propose a Frame Selection Network (FSN) for non-uniform scenarios. This network seamlessly integrates into existing super-resolution methods in a plug-and-play manner with low computational costs. The comparative analysis reveals the effectiveness of the nonuniform setting for the practical scenario and our FSN on synthetic-/real- NEBI datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。