非规则采样视频数据的递归频率选择重建
Recursive Frequency Selective Reconstruction of Non-Regularly Sampled Video Data
摘要:
可以使用非规则采样传感器来获取高分辨率图像,该非规则采样传感器由覆盖有非规则采样掩模的底层低分辨率传感器组成。然后在后处理期间获得重建的高分辨率图像。最近,已经表明,相邻帧之间的时间相关性可以被利用,以提高非规则采样的视频数据的重建质量。本文提出了一种新的递归多帧重建方法,以进一步提高重建质量。通过使用新的参考顺序,先前重构的帧可以用于随后的运动估计,并且新的加权函数允许合并投影到相同位置上的多个像素。使用新的递归多帧方法,相对于最先进的单帧重建方法,可以实现高达1.13 dB的视觉上明显的PSNR平均增益。与现有的多帧方法相比,0.31 dB的增益是可能的。SSIM结果显示与PSNR结果相同的行为。此外,可以避免现有多帧方法的预重建步骤,并且新算法通常能够实时处理。
英文摘要:
High resolution images can be acquired using a non-regular sampling sensor which consists of an underlying low resolution sensor that is covered with a non-regular sampling mask. The reconstructed high resolution image is then obtained during post-processing. Recently, it has been shown that the temporal correlation between neighboring frames can be exploited in order to enhance the reconstruction quality of non-regularly sampled video data. In this paper, a new recursive multi-frame reconstruction approach is proposed in order to further increase the reconstruction quality. By using a new reference order, previously reconstructed frames can be used for the subsequent motion estimation and a new weighting function allows for the incorporation of multiple pixels projected onto the same position. With the new recursive multi-frame approach, a visually noticeable average gain in PSNR of up to 1.13 dB with respect to a state-of-the-art single-frame reconstruction approach can be achieved. Compared to the existing multi-frame approach, a gain of 0.31 dB is possible. SSIM results show the same behavior as PSNR results. Additionally, the pre-reconstruction step of the existing multi-frame approach can be avoided and the new algorithm is, in general, capable of real-time processing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。