arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2508.04485cs.CV
收藏

QuantVSR: 低比特后训练量化用于现实世界视频超分辨率

QuantVSR: Low-Bit Post-Training Quantization for Real-World Video Super-Resolution

Bowen Chai, Zheng Chen, Libo Zhu, Wenbo Li, Yong Guo, Yulun Zhang

AI总结:

QuantVSR通过时空复杂度感知机制和可学习偏置对齐模块,实现低比特后训练量化,提升现实世界视频超分辨率的性能与效率。

摘要:

扩散模型在现实世界视频超分辨率(VSR)中表现出色。然而,扩散模型的慢处理速度和高资源消耗阻碍了其实际应用和部署。量化提供了一种压缩VSR模型的潜在解决方案。然而,由于VSR模型的时间特性及其高保真度要求,对VSR模型进行量化具有挑战性。为了解决这些问题,我们提出了QuantVSR,一种用于现实世界VSR的低比特量化模型。我们提出了一种时空复杂度感知(STCA)机制,其中我们首先利用校准数据集对每个层测量空间和时间复杂度。基于这些统计信息,我们为低比特全精度(FP)辅助分支分配层特定的排名。随后,我们联合优化FP和低比特分支以实现同时优化。此外,我们提出了一种可学习偏置对齐(LBA)模块以减少偏置量化误差。在合成和现实世界数据集上的广泛实验表明,我们的方法在性能上与FP模型相当,并且显著优于最近的低比特量化方法。代码可在:https://github.com/bowenchai/QuantVSR。

英文摘要:

Diffusion models have shown superior performance in real-world video super-resolution (VSR). However, the slow processing speeds and heavy resource consumption of diffusion models hinder their practical application and deployment. Quantization offers a potential solution for compressing the VSR model. Nevertheless, quantizing VSR models is challenging due to their temporal characteristics and high fidelity requirements. To address these issues, we propose QuantVSR, a low-bit quantization model for real-world VSR. We propose a spatio-temporal complexity aware (STCA) mechanism, where we first utilize the calibration dataset to measure both spatial and temporal complexities for each layer. Based on these statistics, we allocate layer-specific ranks to the low-rank full-precision (FP) auxiliary branch. Subsequently, we jointly refine the FP and low-bit branches to achieve simultaneous optimization. In addition, we propose a learnable bias alignment (LBA) module to reduce the biased quantization errors. Extensive experiments on synthetic and real-world datasets demonstrate that our method obtains comparable performance with the FP model and significantly outperforms recent leading low-bit quantization methods. Code is available at: https://github.com/bowenchai/QuantVSR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑