arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.07170cs.CV

PUF:用于在线3D场景图生成的即插即用不确定性感知融合

PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generation

Leibniz Universität Hannover(汉诺威莱布尼茨大学);Istituto Italiano di Tecnologia(意大利技术研究院);University of Bath(巴斯大学)

Yi Yang, Myrna Castillo, Bodo Rosenhahn, Michael Ying Yang

AI总结:

研究在线3D场景图生成中不确定性问题,提出PUF框架,将节点关联概率化,用狄利克雷证据积累分配证据,可选先验补全边,在不同后端实例化有改进,实验表明该方法优于现有方法,确立不确定性感知融合范式。

摘要:

在线3D场景图生成通过将2D观测增量融合到全局3D图中来构建场景的持久结构化表示。现有在线方法将这种融合视为完全确定性的管道,忽略了观测、2D模型和3D表示这三个不确定性来源。我们提出了PUF:一个即插即用、不确定性感知且无需训练的融合框架。场景图节点关联被重新表述为语义和空间因素上的概率似然,取代了二元接受/拒绝门。狄利克雷证据积累根据关联似然将类别和关系证据分配到合理的候选对象上。一个可选的类别条件先验为稀疏或从未共同观测到的对象对完成边。我们用3D高斯和3D体素后端实例化PUF并观察到一致的改进,证明了其在不同表示上的泛化能力。在3DSSG和ReplicaSSG基准上的实验表明,我们的方法在保持实时延迟的同时显著优于现有方法。这些结果将不确定性感知融合确立为在线3D场景理解的一种有原则且有效的范式。源代码可在指定网址公开获取。

英文摘要:

Online 3D scene graph generation builds a persistent, structured representation of a scene by incrementally fusing 2D observations into a global 3D graph. Existing online methods treat this fusion as a fully deterministic pipeline, where we identify three sources of uncertainty that are overlooked: observation, 2D model, and 3D representation. We propose PUF: a Plug-and-play, Uncertainty-aware, and training-free Fusion framework. Scene graph node association is reformulated as a probabilistic likelihood over semantic and spatial factors, replacing binary accept/reject gates. Dirichlet evidence accumulation distributes class and relationship evidence across plausible candidates proportional to association likelihood. An optional class-conditional prior completes edges for sparsely or never co-observed object pairs. We instantiate PUF with both a 3D Gaussian and a 3D voxel backend and observe consistent improvements, demonstrating its ability to generalize across different representations. Experiments on the 3DSSG and ReplicaSSG benchmarks show that our method substantially outperforms existing approaches while maintaining real-time latency. These results establish uncertainty-aware fusion as a principled and effective paradigm for online 3D scene understanding. The source code is publicly available at https://github.com/yyyyangyi/PUF.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑