arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.03426cs.NIcs.LGcs.MM
收藏

无线网络中多用户360度视频处理的多任务决策

Multi-Task Decision-Making for Multi-User 360 Video Processing over Wireless Networks

University of Kansas(堪萨斯大学);New Jersey Institute of Technology(新泽西理工学院)

Babak Badnava, Jacob Chakareski, Morteza Hashemi

AI总结:

本文针对无线多用户VR系统中360度视频处理,提出基于深度强化学习的多任务码率自适应与计算分配方法MTRC,在真实轨迹和数据集上验证其显著提升QoE、PSNR并降低重新缓冲时间和质量波动。

摘要:

我们研究无线多用户虚拟现实(VR)系统中360度视频处理的多任务决策问题,该系统包含一个边缘计算单元(ECU),用于向VR用户传输360度视频,并为视频帧的解码/渲染提供计算辅助。然而,这以增加数据量和所需带宽为代价。为了平衡这一权衡,我们构建了一个带约束的体验质量(QoE)最大化问题,其中重新缓冲时间和视频帧之间的质量波动受到用户和视频要求的限制。为了解决所构建的多用户QoE最大化问题,我们利用深度强化学习(DRL)进行多任务码率自适应和计算分配(MTRC)。所提出的MTRC方法不依赖任何关于环境的预定义假设,而是依靠视频播放统计信息(即过去的吞吐量、解码时间、传输时间等)、视频信息以及由此产生的性能来调整视频码率和计算分配。我们使用真实世界的无线网络轨迹和360度视频数据集训练MTRC,以获得平均QoE、峰值信噪比(PSNR)、重新缓冲时间和质量波动方面的评估结果。我们的结果表明,与最先进的码率自适应算法相比,MTRC提高了用户的QoE。具体而言,我们展示了PSNR提高5.97 dB至6.44 dB,重新缓冲时间改善1.66倍至4.23倍,质量波动改善4.21 dB至4.35 dB。

英文摘要:

We study a multi-task decision-making problem for 360 video processing in a wireless multi-user virtual reality (VR) system that includes an edge computing unit (ECU) to deliver 360 videos to VR users and offer computing assistance for decoding/rendering of video frames. However, this comes at the expense of increased data volume and required bandwidth. To balance this trade-off, we formulate a constrained quality of experience (QoE) maximization problem in which the rebuffering time and quality variation between video frames are bounded by user and video requirements. To solve the formulated multi-user QoE maximization, we leverage deep reinforcement learning (DRL) for multi-task rate adaptation and computation distribution (MTRC). The proposed MTRC approach does not rely on any predefined assumption about the environment and relies on video playback statistics (i.e., past throughput, decoding time, transmission time, etc.), video information, and the resulting performance to adjust the video bitrate and computation distribution. We train MTRC with real-world wireless network traces and 360 video datasets to obtain evaluation results in terms of the average QoE, peak signal-to-noise ratio (PSNR), rebuffering time, and quality variation. Our results indicate that the MTRC improves the users' QoE compared to state-of-the-art rate adaptation algorithm. Specifically, we show a 5.97 dB to 6.44 dB improvement in PSNR, a 1.66X to 4.23X improvement in rebuffering time, and a 4.21 dB to 4.35 dB improvement in quality variation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑