arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2611.05359cs.CV
收藏

GSCV++:基于标准视频编解码器的轻量级3D高斯溅射序列压缩

GSCV++: Lightweight 3D Gaussian Splatting Sequence Compression via Standard Video Codecs

Bytedance Inc.(字节跳动);Bytedance Inc., San Diego(字节跳动圣迭戈分部);Bytedance Inc., Beijing(字节跳动北京分部)

Qi Yang, Yingzhan Xu, Kai Zhang, Li Zhang

AI总结:

GSCV++是基于标准视频编解码器的轻量级3D高斯溅射序列压缩方法,通过改进预处理、3D到2D映射及压缩配置,实现率失真增益提升且速度更快。

摘要:

本文提出GSCV++,一种采用标准视频编解码器的轻量级3D高斯溅射(GS)序列压缩流水线。为满足工业界对低复杂度和硬件兼容性的要求,GSCV++联合改进了GS压缩的预处理、3D到2D映射以及实用视频压缩配置。首先,在预处理阶段,提出能量自适应帧间球谐函数(SH)交流(AC)降维(EA-SHDR),以生成紧凑且稳定的时域SH AC特征空间,可减少后续映射和实际压缩的数据量,同时降低复杂度并消除冗余信息。其次,在3D到2D映射阶段,设计基于先验的Inter-MiniPLAS(P-MiniPLAS),通过基于先验的权重因子推理和小尺度重映射生成平滑的2D特征图,与原始并行线性分配排序(PLAS)和莫顿扫描相比,P-MiniPLAS在保持低计算复杂度的同时,确保生成的2D图更适合视频编解码器。第三,在实际压缩阶段,开发内容感知广义压缩(CA-GC),用于坐标图生成的非均匀位深划分,并引入编码单元大小选择以高效控制压缩复杂度,该方法充分利用视频编解码器的性能而不涉及规范变更。实验表明,与最先进(SOTA)方法相比,GSCV++在帧内预测率失真增益超过20%,帧间预测率失真增益超过60%;在使用相同类型视频编解码器的情况下,GSCV++还实现了比其他SOTA方法更快的2D图生成、编码和解码。消融研究验证了所提出模块的有效性和鲁棒性,并为后续研究提供了见解。

英文摘要:

This paper presents GSCV++, a lightweight pipeline for 3D {G}aussian {S}platting (GS) sequences {C}ompression with standard {V}ideo codecs. To meet the requirements of low-complexity and hardware compatibility from the industry, GSCV++ jointly improves preprocessing, 3D-to-2D mapping, and practical video compression configuration of GS compression. First, for preprocessing, energy-adaptive inter-frame spherical harmonic (SH) alternative current (AC) dimensionality reduction (EA-SHDR) is proposed to produces a compact and stable temporal SH AC feature space. It can reduce the data volume of following mapping and practical compression, as well as less complexity while eliminating redundant information. Second, for 3D-to-2D mapping, prior-based Inter-MiniPLAS (P-MiniPLAS) is designed to generate smooth 2D feature maps through prior-based weighting factor inference and small scale remapping. Compared with vanilla Parallel Linear Assignment Sorting (PLAS) and Morton scan, P-MiniPLAS ensures the generated 2D maps are more suitable for the video codec while maintaining a low level of computational complexity. Third, for practical compression, content-aware generalized compression (CA-GC) is developed to use a non-uniform bit-depth split for coordinate map generation, and a coding unit size selection is introduced for efficient compression complexity control, which fully exploits the performance of video codecs without involving normative changes. Experiments demonstrate that GSCV++ reports over 20\% in intra- and 60\% in inter-prediction rate-distortion gains compared with state-of-the-art (SOTA) methods. GSCV++ also achieves faster 2D map generation, encoding, and decoding than other SOTA methods using the same type of video codecs. Ablation studies verify the effectiveness and robustness of the proposed modules and provide insights for subsequent research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑