arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1805.06121cs.MM
收藏

一种实用的帧内环路滤波器卷积神经网络

A practical convolutional neural network as loop filter for intra frame

Xiaodan Song, Jiabao Yao, Lulu Zhou, Li Wang, Xiaoyang Wu, Di Xie, Shiliang Pu

摘要:

环路滤波器用于视频译码中以移除伪影或改进性能。在部署卷积神经网络(CNN)来取代传统的环路滤波器方面的最新进展显示出很大的增益,但在实际应用中存在问题。首先,不同的模型被分别用于以不同的量化参数(QP)编码的帧。硬件很贵。其次,CNN中的浮点运算导致不同平台之间的编码和解码之间的不一致。第三,CNN模型中的冗余消耗了宝贵的计算资源。本文提出了一种CNN作为帧内的环路滤波器,并提出了解决上述问题的方案。它旨在设计一个低冗余的单一CNN模型,以适应不同质量的解码帧,并确保一致性。为了适应不同质量的重建,重建和QP都被作为输入。在训练之后,对获得的模型进行压缩以减少冗余。为了保证一致性,在测试CNN时采用动态固定点(DFP)。压缩模型中的参数首先被量化为DFP,然后用于CNN的推断。CNN中每个层的输出通过DFP操作计算。在JEM 7.0上的实验结果报告,当替换所有传统滤波器时,对于具有所有帧内配置的亮度和两个色度分量,BD速率节省3.14%、5.21%、6.28%。

英文摘要:

Loop filters are used in video coding to remove artifacts or improve performance. Recent advances in deploying convolutional neural network (CNN) to replace traditional loop filters show large gains but with problems for practical application. First, different model is used for frames encoded with different quantization parameter (QP), respectively. It is expensive for hardware. Second, float points operation in CNN leads to inconsistency between encoding and decoding across different platforms. Third, redundancy within CNN model consumes precious computational resources. This paper proposes a CNN as the loop filter for intra frames and proposes a scheme to solve the above problems. It aims to design a single CNN model with low redundancy to adapt to decoded frames with different qualities and ensure consistency. To adapt to reconstructions with different qualities, both reconstruction and QP are taken as inputs. After training, the obtained model is compressed to reduce redundancy. To ensure consistency, dynamic fixed points (DFP) are adopted in testing CNN. Parameters in the compressed model are first quantized to DFP and then used for inference of CNN. Outputs of each layer in CNN are computed by DFP operations. Experimental results on JEM 7.0 report 3.14%, 5.21%, 6.28% BD-rate savings for luma and two chroma components with all intra configuration when replacing all traditional filters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑