School of Electrical Engineering and Automation, Hefei University of Technology, and Engineering Technology Research Center of Industrial Automation Anhui Province, Hefei, Anhui 230009, China(合肥工业大学电气与自动化学院,安徽省工业自动化工程技术研究中心);The University of Electro-Communications, Tokyo, Japan(东京电讯大学);School of Computer Science and Technology, University of Science and Technology of China, Hefei, China(中国科学技术大学计算机科学与技术学院);Department of Electrical and Computer Engineering, Aarhus University, Aarhus, Denmark(哥本哈根大学电子与计算机工程系);Department of Computer Science and Electrical Engineering, University of Missouri–Kansas City, Kansas, USA(密苏里大学- Kansas 城市分校计算机科学与电气工程系);School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, China(合肥工业大学计算机科学与信息工程学院)
Han Gong, Qiyue Li, Zhi Liu, Hao Zhou, Peng Yuan Zhou, Zhu Li, Jie Li
The advent of 3D Gaussian splatting (3DGS) has significantly enhanced the quality of volumetric video representation. Meanwhile, in contrast to conventional volumetric video, 3DGS video poses significant challenges for streaming due to its substantially larger data volume and the heightened complexity involved in compression and transmission. To address these issues, we introduce an innovative framework for 3DGS volumetric video streaming. Specifically, we design a 3DGS video construction method based on the Gaussian deformation field. By employing hybrid saliency tiling and differentiated quality modeling of 3DGS video, we achieve efficient data compression and adaptation to bandwidth fluctuations while ensuring high transmission quality. Then we build a complete 3DGS video streaming system and validate the transmission performance. Through experimental evaluation, our method demonstrated superiority over existing approaches in various aspects, including video quality, compression effectiveness, and transmission rate.
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发式智能感知与认知联合实验室,中国科学技术大学);University of Missouri, Kansas City(密苏里大学,堪萨斯城)
Adaptive 3D Gaussian Splatting Video Streaming: Visual Saliency-Aware Tiling and Meta-Learning-Based Bitrate Adaptation
School of Electrical Engineering and Automation, Hefei University of Technology(电子工程与自动化学院,合肥工业大学);Engineering Technology Research Center of Industrial Automation of Anhui Province(安徽省工业自动化工程技术研究中心);School of Computer Science and Information Engineering, Hefei University of Technology(计算机科学与信息工程学院,合肥工业大学);The University of Electro-Communications(电子通信大学)
AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction
Zhejiang University(浙江大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Tsinghua University(清华大学);The University of Hong Kong(香港大学);The Chinese University of Hong Kong(香港中文大学)
Scale-GS: Efficient Scalable Gaussian Splatting via Redundancy-filtering Training on Streaming Content
School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院);Key Laboratory of Social Computing and Cognitive Intelligence (Dalian University of Technology), Ministry of Education(社会科学与认知智能重点实验室(大连理工大学));Department of Automation, Tsinghua University(清华大学自动化系)
GSStream: 3D Gaussian Splatting based Volumetric Scene Streaming System
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院)
LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstruction
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Futurewei Technologies Inc(未来科技公司);School of Computer and Information Sciences, The University of Newcastle(计算机与信息科学学院,新castle大学)
CAGS: Color-Adaptive Volumetric Video Streaming with Dynamic 3D Gaussian Splatting
Simon Fraser University(西蒙弗雷泽大学);Jiangxing Intelligence Inc.(江行智能有限公司);McGill University(麦吉尔大学);Nankai University(南开大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Fuzhou University(福州大学);Southeast University(东南大学)
GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
The University of Hong Kong(香港大学);School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院);Futurewei Technologies Inc(华为主流技术公司)
GFix: Perceptually Enhanced Gaussian Splatting Video Compression
Visual Information Laboratory, University of Bristol(布里斯托大学视觉信息实验室);University of Bristol(布里斯托大学);School of Informatics, University of Edinburgh(爱丁堡大学信息学院);Visionular Inc.(Visionular公司)
Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Chongqing University(重庆大学);Air Force Engineering University(空军工程大学)
Progressively Deformable 2D Gaussian Splatting for Video Representation at Arbitrary Resolutions
Shanghai Jiao Tong University, Shanghai, China(上海交通大学);University of Missouri--Kansas City, Kansas City, MO, USA(密苏里大学-堪萨斯城分校);University of Canterbury, Christchurch, New Zealand(坎特伯雷大学)
Learning Explicit Continuous Motion Representation for Dynamic Gaussian Splatting from Monocular Videos
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education(教育部机器智能与先进计算重点实验室)