arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.06141cs.CV
收藏

视频超分辨率中的时空平衡问题

Is There Tradeoff between Spatial and Temporal in Video Super-Resolution?

University of Science and Technology of China(中国科学技术大学)

Haochen Zhang, Dong Liu, Zhiwei Xiong

摘要:

深度学习的最新进展导致基于卷积神经网络(CNN)的图像和视频超分辨率(SR)方法取得了巨大成功。对于视频SR,已经提出了先进的算法来利用低分辨率(LR)视频帧之间的时间相关性,和/或利用多个LR帧来超分辨帧。这些方法追求更高质量的超分辨率帧,其中质量通常以例如PSNR逐帧测量。然而,逐帧质量可能无法揭示帧之间的一致性。如果算法独立地应用于每个帧(这是大多数先前方法的情况),则算法可能导致时间不一致,这可以被观察为闪烁。这是一个自然的要求,以提高逐帧保真度和帧间的一致性,这被称为空间质量和时间质量,分别。那么我们可能会问,一个针对空间质量优化的方法是否也针对时间质量优化?我们能否联合优化这两个质量指标?

英文摘要:

Recent advances of deep learning lead to great success of image and video super-resolution (SR) methods that are based on convolutional neural networks (CNN). For video SR, advanced algorithms have been proposed to exploit the temporal correlation between low-resolution (LR) video frames, and/or to super-resolve a frame with multiple LR frames. These methods pursue higher quality of super-resolved frames, where the quality is usually measured frame by frame in e.g. PSNR. However, frame-wise quality may not reveal the consistency between frames. If an algorithm is applied to each frame independently (which is the case of most previous methods), the algorithm may cause temporal inconsistency, which can be observed as flickering. It is a natural requirement to improve both frame-wise fidelity and between-frame consistency, which are termed spatial quality and temporal quality, respectively. Then we may ask, is a method optimized for spatial quality also optimized for temporal quality? Can we optimize the two quality metrics jointly?

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑