arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.09045cs.CV
收藏

面向3D高斯散射的场景无关物体感知表示学习

Scene-Agnostic Object-Centric Representation Learning for 3D Gaussian Splatting

Aalto University(阿尔托大学);University of Oulu(奥卢大学)

Tsuheng Hsu, Guiyu Liu, Juho Kannala, Janne Heikkilä

AI总结:

本文提出一种场景无关的物体感知监督方案,通过预训练的slot attention基Global Object Centric Learning模块,学习一致的物体代码本,提升3DGS的表示结构和泛化能力。

摘要:

近期基于3D场景理解的工作利用视觉基础模型(VFMs)生成的2D掩码来监督辐射场,实现实例级3D分割。然而,基础模型的监督信号并非本质上的物体感知,通常需要额外的掩码预/后处理或专门的训练和损失设计来解决多视角下的掩码身份冲突问题。学习到的3D场景身份具有场景依赖性,限制了跨场景的泛化能力。因此,我们提出一种数据集层面的物体感知监督方案,用于学习3D高斯散射(3DGS)中的物体表示。基于预训练的slot attention基Global Object Centric Learning(GOCL)模块,我们学习了一个场景无关的物体代码本,提供了在不同视角和场景中一致的、以身份为锚点的表示。通过将代码本与模块的无监督物体掩码相结合,可以直接监督3D高斯的标识特征,而无需额外的掩码预/后处理或显式的多视角对齐。学习到的场景无关代码本能够实现物体监督和识别,而无需每场景微调或重新训练。本文的方法因此将无监督的物体感知学习(OCL)引入3DGS,从而获得更结构化的表示,并在机器人交互、场景理解和跨场景泛化等下游任务中表现更优。

英文摘要:

Recent works on 3D scene understanding leverage 2D masks from visual foundation models (VFMs) to supervise radiance fields, enabling instance-level 3D segmentation. However, the supervision signals from foundation models are not fundamentally object-centric and often require additional mask pre/post-processing or specialized training and loss design to resolve mask identity conflicts across views. The learned identity of the 3D scene is scene-dependent, limiting generalizability across scenes. Therefore, we propose a dataset-level, object-centric supervision scheme to learn object representations in 3D Gaussian Splatting (3DGS). Building on a pre-trained slot attention-based Global Object Centric Learning (GOCL) module, we learn a scene-agnostic object codebook that provides consistent, identity-anchored representations across views and scenes. By coupling the codebook with the module's unsupervised object masks, we can directly supervise the identity features of 3D Gaussians without additional mask pre-/post-processing or explicit multi-view alignment. The learned scene-agnostic codebook enables object supervision and identification without per-scene fine-tuning or retraining. Our method thus introduces unsupervised object-centric learning (OCL) into 3DGS, yielding more structured representations and better generalization for downstream tasks such as robotic interaction, scene understanding, and cross-scene generalization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑