arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03327cs.GRcs.CV

Pi-GS:基于密集π³初始化的稀疏视角高斯点云渲染

Pi-GS: Sparse-View Gaussian Splatting with Dense π^3 Initialization

Graz University of Technology(格拉茨技术大学)

Manuel Hofer, Markus Steinberger, Thomas Köhler

AI总结:

Pi-GS通过密集π³初始化和正则化方案,提升了稀疏视角下3DGS的鲁棒性和精度。

摘要:

新颖的视图合成技术迅速发展,从神经辐射场发展到3D高斯点云渲染(3DGS),后者提供了实时渲染和快速训练,且不牺牲视觉保真度。然而,3DGS依赖于准确的相机姿态和高质量点云初始化,这在稀疏视角场景中难以获得。尽管传统结构从运动(SfM)管道在这些设置中往往失效,现有基于学习的点估计替代方法通常需要可靠的参考视角,并且对姿态或深度误差敏感。在本工作中,我们提出了一种利用π³的鲁棒方法,这是一种无参考点云估计网络。我们整合了来自π³的密集初始化,并设计了一种正则化方案以减轻几何不准确性。具体而言,我们采用不确定性引导的深度监督、法线一致性损失和深度变形。实验结果表明,我们的方法在 Tanks and Temples、LLFF、DTU 和 MipNeRF360 数据集上实现了最先进的性能。

英文摘要:

Novel view synthesis has evolved rapidly, advancing from Neural Radiance Fields to 3D Gaussian Splatting (3DGS), which offers real-time rendering and rapid training without compromising visual fidelity. However, 3DGS relies heavily on accurate camera poses and high-quality point cloud initialization, which are difficult to obtain in sparse-view scenarios. While traditional Structure from Motion (SfM) pipelines often fail in these settings, existing learning-based point estimation alternatives typically require reliable reference views and remain sensitive to pose or depth errors. In this work, we propose a robust method utilizing π^3, a reference-free point cloud estimation network. We integrate dense initialization from π^3 with a regularization scheme designed to mitigate geometric inaccuracies. Specifically, we employ uncertainty-guided depth supervision, normal consistency loss, and depth warping. Experimental results demonstrate that our approach achieves state-of-the-art performance on the Tanks and Temples, LLFF, DTU, and MipNeRF360 datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑