arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2504.13153cs.CV

基于Superpoint图的高斯溅射无训练分层场景理解

Training-Free Hierarchical Scene Understanding for Gaussian Splatting with Superpoint Graphs

Xiamen University(厦门大学)

Shaohui Dai, Yansong Qu, Zheyan Li, Xinyang Li, Shengchuan Zhang, Liujuan Cao

AI总结:

针对现有3D高斯溅射(3DGS)开放词汇理解方法的效率低、跨视图语义不一致问题,提出无训练框架,通过构建superpoint图实现分层场景理解,在保证分割性能的同时使语义场重建速度提升30倍以上。

摘要:

自然语言与3D几何之间的桥梁是实现灵活的语言驱动场景理解的关键步骤。尽管3D高斯溅射(3DGS)的最新进展实现了快速高质量的场景重建,研究也探索了将开放词汇理解融入3DGS的方法,但大多数现有方法需要对每视图2D语义特征图进行迭代优化,这不仅效率低下,还导致跨视图3D语义不一致。为此,我们提出一种无训练框架,直接从高斯基元构建superpoint图。该图将场景划分为空间紧凑且语义连贯的区域,形成视图一致的3D实体,为开放词汇理解提供结构化基础。基于该图结构,我们设计高效重投影策略,将2D语义特征提升到superpoint上,避免昂贵的多视图迭代训练。所得表示确保强3D语义连贯性,自然支持分层理解,在统一语义场中实现粗细粒度开放词汇感知。大量实验表明,我们的方法实现最先进的开放词汇分割性能,语义场重建速度快30倍以上。代码将在https://github.com/Atrovast/THGS发布。

英文摘要:

Bridging natural language and 3D geometry is a crucial step toward flexible, language-driven scene understanding. While recent advances in 3D Gaussian Splatting (3DGS) have enabled fast and high-quality scene reconstruction, research has also explored incorporating open-vocabulary understanding into 3DGS. However, most existing methods require iterative optimization over per-view 2D semantic feature maps, which not only results in inefficiencies but also leads to inconsistent 3D semantics across views. To address these limitations, we introduce a training-free framework that constructs a superpoint graph directly from Gaussian primitives. The superpoint graph partitions the scene into spatially compact and semantically coherent regions, forming view-consistent 3D entities and providing a structured foundation for open-vocabulary understanding. Based on the graph structure, we design an efficient reprojection strategy that lifts 2D semantic features onto the superpoints, avoiding costly multi-view iterative training. The resulting representation ensures strong 3D semantic coherence and naturally supports hierarchical understanding, enabling both coarse- and fine-grained open-vocabulary perception within a unified semantic field. Extensive experiments demonstrate that our method achieves state-of-the-art open-vocabulary segmentation performance, with semantic field reconstruction completed over $30\times$ faster. Our code will be available at https://github.com/Atrovast/THGS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑