arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.19682cs.CV

具有自约束先验的3D高斯点云用于高保真的表面重建

3D Gaussian Splatting with Self-Constrained Priors for High Fidelity Surface Reconstruction

School of Software, Tsinghua University(清华大学软件学院);Department of Computer Science, Wayne State University(韦恩州立大学计算机科学系)

Takeshi Noda, Yu-Shen Liu, Zhizhong Han

AI总结:

本文提出自约束先验以约束3D高斯学习,提升深度渲染精度,通过融合当前3D高斯生成的深度图得到TSDF网格,生成带状约束以优化高斯分布,同时定期更新以提高准确性。

摘要:

渲染3D表面在辐射场建模中通过3DGS或NeRF得到革命性突破。尽管3DGS在渲染质量和速度上优于NeRF,但通过3DGS恢复高保真表面仍有改进空间。为此,我们提出自约束先验以约束3D高斯学习,旨在更准确地渲染深度。我们的自约束先验源自通过当前3D高斯渲染的深度图融合得到的TSDF网格。该先验测量估计表面周围的距离场,提供一个以表面为中心的带状区域,以对3D高斯施加更具体的约束,例如移除带外高斯、将高斯更靠近表面,并以几何感知的方式鼓励更大的或更小的不透明度。更重要的是,我们的先验可以通过最近的深度图像定期更新,这些图像通常更准确且完整。此外,先验还能逐步缩小带宽以收紧施加的约束。我们在广泛使用的基准上进行了评估,验证了我们的想法并报告了优于最新方法的优越性。

英文摘要:

Rendering 3D surfaces has been revolutionized within the modeling of radiance fields through either 3DGS or NeRF. Although 3DGS has shown advantages over NeRF in terms of rendering quality or speed, there is still room for improvement in recovering high fidelity surfaces through 3DGS. To resolve this issue, we propose a self-constrained prior to constrain the learning of 3D Gaussians, aiming for more accurate depth rendering. Our self-constrained prior is derived from a TSDF grid that is obtained by fusing the depth maps rendered with current 3D Gaussians. The prior measures a distance field around the estimated surface, offering a band centered at the surface for imposing more specific constraints on 3D Gaussians, such as removing Gaussians outside the band, moving Gaussians closer to the surface, and encouraging larger or smaller opacity in a geometry-aware manner. More importantly, our prior can be regularly updated by the most recent depth images which are usually more accurate and complete. In addition, the prior can also progressively narrow the band to tighten the imposed constraints. We justify our idea and report our superiority over the state-of-the-art methods in evaluations on widely used benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑