arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.04430eess.IVcs.CV
收藏

模糊视频压缩:视觉增强与数据压缩之间的权衡

Blurry Video Compression: A Trade-off between Visual Enhancement and Data Compression

KAIST(韩国科学技术院);Harvard University(哈佛大学)

Dawit Mureja Argaw, Junsik Kim, In So Kweon

AI总结:

针对现有视频压缩方法在模糊视频上表现不佳的问题,该研究将视频压缩建模为极小-极大优化问题,提出有效框架与训练策略平衡视觉增强和数据压缩,在多个基准数据集上优于现有最先进方法。

摘要:

现有视频压缩(VC)方法主要致力于减少视频连续帧之间的空间和时间冗余,同时保留其质量。在这方面,以往的工作在特定设置(如即时(已知)曝光时间和快门速度)下采集的视频上取得了显著成果,这些设置通常会生成清晰视频。然而,当这些方法在不同时间先验条件下拍摄的视频上进行评估时(这类先验会导致运动模糊和低帧率等退化问题),它们无法维持内容质量。在本研究中,我们针对一般场景下的VC问题展开研究,该场景中给定的视频可能因预设的相机设置或场景动态变化而出现模糊。通过利用视觉增强与数据压缩之间的天然权衡关系,我们将VC建模为一个极小-极大优化问题,并提出了一种有效的框架和训练策略来解决该问题。在多个基准数据集上的大量实验结果证实,与多种最先进的VC方法相比,我们的方法具有有效性。

英文摘要:

Existing video compression (VC) methods primarily aim to reduce the spatial and temporal redundancies between consecutive frames in a video while preserving its quality. In this regard, previous works have achieved remarkable results on videos acquired under specific settings such as instant (known) exposure time and shutter speed which often result in sharp videos. However, when these methods are evaluated on videos captured under different temporal priors, which lead to degradations like motion blur and low frame rate, they fail to maintain the quality of the contents. In this work, we tackle the VC problem in a general scenario where a given video can be blurry due to predefined camera settings or dynamics in the scene. By exploiting the natural trade-off between visual enhancement and data compression, we formulate VC as a min-max optimization problem and propose an effective framework and training strategy to tackle the problem. Extensive experimental results on several benchmark datasets confirm the effectiveness of our method compared to several state-of-the-art VC approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑