Mamba:将多维自适应码率控制引入WebRTC
Mamba: Bringing Multi-Dimensional ABR to WebRTC
AI总结:
针对WebRTC中网络码率决策与编码控制不协调导致QoE下降的问题,本文提出基于多智能体强化学习和课程学习的多维ABR算法Mamba,协同调整QP、分辨率和帧率,并在实验与真实环境中验证其有效性。
摘要:
当代实时视频通信系统(如WebRTC)采用自适应码率(ABR)算法来保障高质量和低延迟服务,例如根据瞬时网络带宽及时调整视频码率。然而,网络中的目标码率决策与编解码器中的码率控制通常缺乏协调,且简单地忽略不恰当分辨率和帧率设置的影响也会导致码率控制结果不佳,从而严重损害体验质量(QoE)。为应对这些挑战,本文提出Mamba,一种端到端的多维ABR算法,利用多智能体强化学习(MARL),在视频会议系统中基于观察到的状态(如网络状况和视频复杂度信息)自适应且协同地调整编码因素,包括量化参数(QP)、分辨率和帧率,以最大化用户的QoE。我们还引入课程学习来提高MARL的训练效率。实验室和真实环境下的评估结果均证明了Mamba的显著有效性。
英文摘要:
Contemporary real-time video communication systems, such as WebRTC, use an adaptive bitrate (ABR) algorithm to assure high-quality and low-delay services, e.g., promptly adjusting video bitrate according to the instantaneous network bandwidth. However, target bitrate decisions in the network and bitrate control in the codec are typically incoordinated and simply ignoring the effect of inappropriate resolution and frame rate settings also leads to compromised results in bitrate control, thus devastatingly deteriorating the quality of experience (QoE). To tackle these challenges, Mamba, an end-to-end multi-dimensional ABR algorithm is proposed, which utilizes multi-agent reinforcement learning (MARL) to maximize the user's QoE by adaptively and collaboratively adjusting encoding factors including the quantization parameters (QP), resolution, and frame rate based on observed states such as network conditions and video complexity information in a video conferencing system. We also introduce curriculum learning to improve the training efficiency of MARL. Both the in-lab and real-world evaluation results demonstrate the remarkable efficacy of Mamba.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。