arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2601.12814cs.CV

CSGaussian:渐进率失真压缩与分割用于3D高斯溅射

CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splatting

National Yang Ming Chiao Tung University;University of Brescia;National Taiwan University

Yu-Jen Tseng, Chia-Hao Kao, Jing-Zhong Chen, Alessandro Gnutti, Shao-Yuan Lo, Yen-Yu Lin, Wen-Hsiao Peng

AI总结:

CSGaussian提出一种统一框架,通过整合语义学习实现3D高斯溅射的率失真优化压缩与分割,提升场景编辑与操作能力。

摘要:

我们提出了首个统一的框架,用于优化率失真压缩和分割3D高斯溅射(3DGS)。虽然3DGS在实时渲染和语义场景理解中已证明有效,但先前的工作大多将这些任务独立处理,未探索其联合考虑。受近期率失真优化3DGS压缩的进展启发,本工作将语义学习整合到压缩流程中,以支持解码器端应用——如场景编辑和操作——这些应用超出了传统场景重建和视图合成的范围。我们的方案特征一个轻量级隐式神经表示的超先验,使颜色和语义属性的高效熵编码成为可能,同时避免了许多先前工作中昂贵的网格基超先验。为了促进压缩和分割,我们进一步开发了压缩引导的分割学习,包括量化感知训练以增强特征分离性,以及质量感知加权机制以抑制不可靠的高斯原始体。在LERF和3D-OVS数据集上的广泛实验表明,我们的方法显著降低了传输成本,同时保持高质量的渲染效果和强大的分割性能。

英文摘要:

We present the first unified framework for rate-distortion-optimized compression and segmentation of 3D Gaussian Splatting (3DGS). While 3DGS has proven effective for both real-time rendering and semantic scene understanding, prior works have largely treated these tasks independently, leaving their joint consideration unexplored. Inspired by recent advances in rate-distortion-optimized 3DGS compression, this work integrates semantic learning into the compression pipeline to support decoder-side applications--such as scene editing and manipulation--that extend beyond traditional scene reconstruction and view synthesis. Our scheme features a lightweight implicit neural representation-based hyperprior, enabling efficient entropy coding of both color and semantic attributes while avoiding costly grid-based hyperprior as seen in many prior works. To facilitate compression and segmentation, we further develop compression-guided segmentation learning, consisting of quantization-aware training to enhance feature separability and a quality-aware weighting mechanism to suppress unreliable Gaussian primitives. Extensive experiments on the LERF and 3D-OVS datasets demonstrate that our approach significantly reduces transmission cost while preserving high rendering quality and strong segmentation performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑