arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.20044cs.CV

OP2GS: 带双不透明度的物体感知3D高斯散射

OP2GS: Object-Aware 3D Gaussian Splatting with Dual-Opacity Primitives

Center for Machine Vision and Signal Analysis, University of Oulu, Finland(奥卢大学机器视觉与信号分析中心,芬兰);Aalto University, Finland(阿尔托大学,芬兰)

Guiyu Liu, Niklas Vaara, Janne Mustaniemi, Juho Kannala, Janne Heikkilä

AI总结:

OP2GS通过引入双不透明度机制,为每个原始体素添加显式实例身份和专用实例不透明度σ*,以解决3D高斯散射在物体层面身份缺失的问题,从而提升开放词汇场景理解的性能。

摘要:

3D高斯散射(3DGS)提供了一种显式且高效的场景表示,但其原始体素缺乏固有的物体层面身份,阻碍了下游任务如开放词汇场景理解。现有方法通常通过将高维特征嵌入提炼为高斯或通过启发式细化将2D掩码标签提升为3D来解决这一问题。然而,基于特征的方法会带来沉重的存储和解码开销,而基于提升的方法则容易受到标签污染:用于外观重建的高斯体往往在2D到3D投影时会获得错误的物体标签。我们提出了OP2GS,一种带物体感知的高斯表示,通过为每个原始体素添加显式实例身份和专用实例不透明度σ*用于物体掩码渲染。原始不透明度σ仍负责视觉重建,而σ*则模型该高斯是否应贡献于特定的物体掩码。这种双不透明度公式将视觉存在与实例占用解耦:错误标记的高斯体仍可用于图像渲染,但在物体掩码分支中会变得透明。为了学习这种表示,我们引入了随机物体损失,通过3DGS标准的透射率基可见性优化1D实例占用场。然后通过多视角聚合将语义描述符附加在物体层面,消除了每个高斯体的特征存储需求。与基于特征训练的方法相比,OP2GS在开放词汇性能方面具有竞争力,同时显著减少了计算开销。与无训练管道相比,它利用物理一致的占用学习来解决可见性歧义。

英文摘要:

3D Gaussian Splatting (3DGS) provides an explicit and efficient scene representation, but its primitives lack inherent object-level identity, hindering downstream tasks such as open-vocabulary scene understanding. Existing methods typically address this by either distilling high-dimensional feature embeddings into Gaussians or by lifting 2D mask labels into 3D via heuristic refinement. However, feature-based approaches incur heavy storage and decoding overhead, while lifting-based pipelines remain vulnerable to label contamination: Gaussians necessary for appearance reconstruction often receive incorrect object labels during 2D-to-3D projection. We propose OP2GS, an object-aware Gaussian representation that augments each primitive with an explicit instance identity and a dedicated instance opacity $σ^{*}$ for object-mask rendering. The original opacity $σ$ remains responsible for visual reconstruction, while $σ^{*}$ models whether a Gaussian should contribute to a particular object mask. This dual-opacity formulation decouples visual existence from instance occupancy: mislabeled Gaussians can remain available for image rendering while becoming transparent in the object-mask branch. To learn this representation, we introduce a random object loss that optimizes the 1D instance occupancy field using the standard transmittance-based visibility of 3DGS. Semantic descriptors are then attached at the object level through multi-view aggregation, eliminating per-Gaussian feature storage. Compared with feature-training approaches, OP2GS achieves competitive open-vocabulary performance while significantly reducing computational overhead. Compared with training-free pipelines, it leverages physically consistent occupancy learning to resolve visibility ambiguities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑