arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.08462cs.MM
收藏

基于空时残差网络的视频编码环路滤波器

Spatial-Temporal Residue Network Based In-Loop Filter for Video Coding

Chuanmin Jia, Shiqi Wang, Xinfeng Zhang, Shanshe Wang, Siwei Ma

摘要:

深度学习在图像/视频处理领域取得了巨大突破。本文提出了一种基于时空残差网络(STResNet)的环内滤波器来抑制视频编码中的块效应、振铃效应等视觉伪影。具体地说,在环路滤波器的处理过程中,通过同时考虑参考帧中的当前块和同位块来联合利用空间和时间信息。STResNet的架构仅由四个卷积层组成,这显示了对内存和编码复杂性的热情。此外,为了充分适应输入内容,提高性能的建议在环滤波器,编码树单元(CTU)的水平控制标志的率失真优化的意义上应用。大量的实验结果表明,我们的计划提供了高达5.1%的比特率减少相比,国家的最先进的视频编码标准。

英文摘要:

Deep learning has demonstrated tremendous break through in the area of image/video processing. In this paper, a spatial-temporal residue network (STResNet) based in-loop filter is proposed to suppress visual artifacts such as blocking, ringing in video coding. Specifically, the spatial and temporal information is jointly exploited by taking both current block and co-located block in reference frame into consideration during the processing of in-loop filter. The architecture of STResNet only consists of four convolution layers which shows hospitality to memory and coding complexity. Moreover, to fully adapt the input content and improve the performance of the proposed in-loop filter, coding tree unit (CTU) level control flag is applied in the sense of rate-distortion optimization. Extensive experimental results show that our scheme provides up to 5.1% bit-rate reduction compared to the state-of-the-art video coding standard.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑