arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.07456cs.CV

基于渲染立体对的自进化深度监督3D高斯溅射

Self-Evolving Depth-Supervised 3D Gaussian Splatting from Rendered Stereo Pairs

Koç University(科奇大学);University of Bologna(博洛尼亚大学)

Sadra Safadoust, Fabio Tosi, Fatma Güney, Matteo Poggi

AI总结:

针对3D高斯溅射场景几何表征不准、深度渲染有伪影的问题,提出利用GS自渲染虚拟立体对、结合立体网络深度线索的自进化监督策略,在三个数据集上首次验证了其深度精度提升效果。

摘要:

3D高斯溅射(GS)在准确表征底层3D场景几何方面存在显著缺陷,导致渲染深度图时出现精度误差和漂浮伪影。本文针对该局限性,全面分析了在高斯基元优化过程中整合深度先验的方案,并提出了一种新颖的解决策略。该策略动态利用现成立体网络提供的深度线索,处理训练过程中由GS模型自身渲染的虚拟立体对,实现场景表征的持续自提升。我们在三个主流数据集上开展实验——这是首个评估此类模型深度精度的研究,实验结果验证了本文的研究结论。

英文摘要:

3D Gaussian Splatting (GS) significantly struggles to accurately represent the underlying 3D scene geometry, resulting in inaccuracies and floating artifacts when rendering depth maps. In this paper, we address this limitation, undertaking a comprehensive analysis of the integration of depth priors throughout the optimization process of Gaussian primitives, and present a novel strategy for this purpose. This latter dynamically exploits depth cues from a readily available stereo network, processing virtual stereo pairs rendered by the GS model itself during training and achieving consistent self-improvement of the scene representation. Experimental results on three popular datasets, breaking ground as the first to assess depth accuracy for these models, validate our findings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑