arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.14432cs.CVcs.MM
收藏

自适应3D高斯泼溅视频流传输

Adaptive 3D Gaussian Splatting Video Streaming

School of Electrical Engineering and Automation, Hefei University of Technology, and Engineering Technology Research Center of Industrial Automation Anhui Province, Hefei, Anhui 230009, China(合肥工业大学电气与自动化学院,安徽省工业自动化工程技术研究中心);The University of Electro-Communications, Tokyo, Japan(东京电讯大学);School of Computer Science and Technology, University of Science and Technology of China, Hefei, China(中国科学技术大学计算机科学与技术学院);Department of Electrical and Computer Engineering, Aarhus University, Aarhus, Denmark(哥本哈根大学电子与计算机工程系);Department of Computer Science and Electrical Engineering, University of Missouri–Kansas City, Kansas, USA(密苏里大学- Kansas 城市分校计算机科学与电气工程系);School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, China(合肥工业大学计算机科学与信息工程学院)

Han Gong, Qiyue Li, Zhi Liu, Hao Zhou, Peng Yuan Zhou, Zhu Li, Jie Li

AI总结:

本文针对3D高斯泼溅视频数据量大、压缩传输复杂的问题,提出基于高斯变形场与混合显著性分块的自适应流传输框架,在视频质量、压缩效果和传输速率上均优于现有方法。

摘要:

3D高斯泼溅(3DGS)的出现显著提升了体积视频表示的质量。与此同时,与传统体积视频相比,3DGS视频由于数据量大幅增加以及压缩和传输复杂性的显著提高,给流传输带来了重大挑战。为解决这些问题,我们提出了一种创新的3DGS体积视频流传输框架。具体而言,我们设计了一种基于高斯变形场的3DGS视频构建方法。通过对3DGS视频采用混合显著性分块和差异化质量建模,我们在确保高传输质量的同时,实现了高效的数据压缩和对带宽波动的适应。随后,我们构建了一个完整的3DGS视频流传输系统,并验证了其传输性能。通过实验评估,我们的方法在视频质量、压缩效果和传输速率等多个方面均表现出优于现有方法的性能。

英文摘要:

The advent of 3D Gaussian splatting (3DGS) has significantly enhanced the quality of volumetric video representation. Meanwhile, in contrast to conventional volumetric video, 3DGS video poses significant challenges for streaming due to its substantially larger data volume and the heightened complexity involved in compression and transmission. To address these issues, we introduce an innovative framework for 3DGS volumetric video streaming. Specifically, we design a 3DGS video construction method based on the Gaussian deformation field. By employing hybrid saliency tiling and differentiated quality modeling of 3DGS video, we achieve efficient data compression and adaptation to bandwidth fluctuations while ensuring high transmission quality. Then we build a complete 3DGS video streaming system and validate the transmission performance. Through experimental evaluation, our method demonstrated superiority over existing approaches in various aspects, including video quality, compression effectiveness, and transmission rate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑