This paper presents GSCV++, a lightweight pipeline for 3D {G}aussian {S}platting (GS) sequences {C}ompression with standard {V}ideo codecs. To meet the requirements of low-complexity and hardware compatibility from the industry, GSCV++ jointly improves preprocessing, 3D-to-2D mapping, and practical video compression configuration of GS compression. First, for preprocessing, energy-adaptive inter-frame spherical harmonic (SH) alternative current (AC) dimensionality reduction (EA-SHDR) is proposed to produces a compact and stable temporal SH AC feature space. It can reduce the data volume of following mapping and practical compression, as well as less complexity while eliminating redundant information. Second, for 3D-to-2D mapping, prior-based Inter-MiniPLAS (P-MiniPLAS) is designed to generate smooth 2D feature maps through prior-based weighting factor inference and small scale remapping. Compared with vanilla Parallel Linear Assignment Sorting (PLAS) and Morton scan, P-MiniPLAS ensures the generated 2D maps are more suitable for the video codec while maintaining a low level of computational complexity. Third, for practical compression, content-aware generalized compression (CA-GC) is developed to use a non-uniform bit-depth split for coordinate map generation, and a coding unit size selection is introduced for efficient compression complexity control, which fully exploits the performance of video codecs without involving normative changes. Experiments demonstrate that GSCV++ reports over 20\% in intra- and 60\% in inter-prediction rate-distortion gains compared with state-of-the-art (SOTA) methods. GSCV++ also achieves faster 2D map generation, encoding, and decoding than other SOTA methods using the same type of video codecs. Ablation studies verify the effectiveness and robustness of the proposed modules and provide insights for subsequent research.
RDCompGS: Rate-Distortion Optimization for Compression of 3D Gaussian Splatting with Image Codecs
School of Electronics and Information, Northwestern Polytechnical University(西北工业大学电子与信息工程学院);Department of Computer Science, City University of Hong Kong(香港城市大学计算机系);School of Telecommunication Engineering, Xidian University(西安电子科技大学通信工程学院)
PLEDGE: Progressive Lossy Error-Bounded Compression of 3D Gaussian Splatting
Oregon State University(俄勒冈州立大学);The Ohio State University(俄亥俄州立大学);Argonne National Laboratory(阿贡国家实验室);The University of Texas Rio Grande Valley(德克萨斯大学里奥格兰德河谷分校)
GFix: Perceptually Enhanced Gaussian Splatting Video Compression
Visual Information Laboratory, University of Bristol(布里斯托大学视觉信息实验室);University of Bristol(布里斯托大学);School of Informatics, University of Edinburgh(爱丁堡大学信息学院);Visionular Inc.(Visionular公司)
ProGS: Towards Progressive Coding for 3D Gaussian Splatting
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院)
GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splatting
The Hong Kong University of Science and Technology(香港科技大学);SenseTime Research(商汤科技研究院);Beijing Institute of Technology(北京理工大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);The Chinese University of Hong Kong(香港中文大学);Shanghai Jiaotong University(上海交通大学)
MesonGS++: Post-training Compression of 3D Gaussian Splatting with Hyperparameter Searching
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);The Hong Kong University of Science and Technology(香港科技大学);Harbin Institute of Technology(哈尔滨工业大学);The Chinese University of Hong Kong(香港中文大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Shenzhen Technology University(深圳技术大学);Xiamen University(厦门大学);Simon Fraser University(西蒙弗雷泽大学);Jiangxing Intelligence Inc.(江兴智能有限公司)
MesonGS: Post-training Compression of 3D Gaussians via Efficient Attribute Transformation
MMLab, The Chinese University of Hong Kong(香港中文大学MMLab实验室);The University of Texas at Austin(德克萨斯大学奥斯汀分校);SIGS & TBSI, Tsinghua University(清华大学深圳国际研究生院与清华-伯克利深圳学院);Peng Cheng Laboratory(鹏城实验室)
TinySplat: Feedforward Approach for Generating Compact 3D Scene Representation
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室、计算机学院、北京大学);School of Electronic and Computer Engineering, Peking University(电子与计算机工程学院、北京大学);Wangxuan Institute of Computer Technology, State Key Laboratory of Multimedia Information Processing, Peking University(计算机技术王轩研究所、多媒体信息处理国家重点实验室、北京大学)