arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.01735cs.CV
收藏

HEVC/H .265帧级比特分配的双临界强化学习框架

A Dual-Critic Reinforcement Learning Framework for Frame-level Bit Allocation in HEVC/H.265

National Chiao Tung University(国立交通大学);Alibaba Group(阿里巴巴集团)

Yung-Han Ho, Guo-Lun Jin, Yun Liang, Wen-Hsiao Peng, Xiaobo Li

摘要:

本文介绍了一种双批评强化学习(RL)框架来解决HEVC/H. 265中的帧级比特分配问题。其目标是最小化失真的一组图片(GOP)下的速率约束。以前的基于RL的方法通过最大化通常结合失真和速率奖励的单个奖励函数来解决这样的约束优化问题。然而,如何组合这些奖励的方式通常是自组织的,并且可能不能很好地推广到各种编码条件和视频序列。为了克服这个问题,我们采用深度确定性策略梯度(DDPG)强化学习算法与两个批评者一起使用,一个学习预测失真奖励,另一个学习预测率奖励。特别是,失真评论家的作品,以更新代理时,速率约束得到满足。相比之下,当代理超出比特预算时,速率批评者使速率约束成为优先级。在常用数据集上的实验结果表明,我们的方法在率失真性能方面明显优于x265和单批评基线中的比特分配方案,同时提供相当精确的码率控制。

英文摘要:

This paper introduces a dual-critic reinforcement learning (RL) framework to address the problem of frame-level bit allocation in HEVC/H.265. The objective is to minimize the distortion of a group of pictures (GOP) under a rate constraint. Previous RL-based methods tackle such a constrained optimization problem by maximizing a single reward function that often combines a distortion and a rate reward. However, the way how these rewards are combined is usually ad hoc and may not generalize well to various coding conditions and video sequences. To overcome this issue, we adapt the deep deterministic policy gradient (DDPG) reinforcement learning algorithm for use with two critics, with one learning to predict the distortion reward and the other the rate reward. In particular, the distortion critic works to update the agent when the rate constraint is satisfied. By contrast, the rate critic makes the rate constraint a priority when the agent goes over the bit budget. Experimental results on commonly used datasets show that our method outperforms the bit allocation scheme in x265 and the single-critic baseline by a significant margin in terms of rate-distortion performance while offering fairly precise rate control.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑