arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.10097cs.CV

Gesplat:基于几何引导的高斯泼溅的鲁棒无位姿三维重建

Gesplat: Robust Pose-Free 3D Reconstruction via Geometry-Guided Gaussian Splatting

Jiahui Lu, Haihong Xiao, Xueyan Zhao, Wenxiong Kang

AI总结:

Gesplat提出一种基于几何引导高斯泼溅的无位姿三维重建框架,利用VGGT初始化并集成混合表示、图引导细化与光流深度正则化,在稀疏视角下实现鲁棒重建。

摘要:

神经辐射场(NeRF)和三维高斯泼溅(3DGS)推动了三维重建和新视角合成的发展,但它们仍然严重依赖于准确的相机位姿和密集的视角覆盖。这些要求限制了它们在稀疏视角场景中的适用性,因为在这些场景中位姿估计变得不可靠且监督信息不足。为了克服这些挑战,我们引入了Gesplat,一个基于3DGS的框架,能够从无位姿的稀疏图像中实现鲁棒的新视角合成和几何一致的重建。与先前依赖COLMAP进行稀疏点云初始化的方法不同,我们利用VGGT基础模型来获得更可靠的初始位姿和密集点云。我们的方法整合了几项关键创新:1)一种混合高斯表示,通过视角间匹配一致性增强的双位置-形状优化;2)一种图引导的属性细化模块,以增强场景细节;3)基于光流的深度正则化,提高深度估计精度以实现更有效的监督。全面的定量和定性实验表明,与其他无位姿方法相比,我们的方法在前向场景和大型复杂数据集上均取得了更鲁棒的性能。

英文摘要:

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have advanced 3D reconstruction and novel view synthesis, but remain heavily dependent on accurate camera poses and dense viewpoint coverage. These requirements limit their applicability in sparse-view settings, where pose estimation becomes unreliable and supervision is insufficient. To overcome these challenges, we introduce Gesplat, a 3DGS-based framework that enables robust novel view synthesis and geometrically consistent reconstruction from unposed sparse images. Unlike prior works that rely on COLMAP for sparse point cloud initialization, we leverage the VGGT foundation model to obtain more reliable initial poses and dense point clouds. Our approach integrates several key innovations: 1) a hybrid Gaussian representation with dual position-shape optimization enhanced by inter-view matching consistency; 2) a graph-guided attribute refinement module to enhance scene details; and 3) flow-based depth regularization that improves depth estimation accuracy for more effective supervision. Comprehensive quantitative and qualitative experiments demonstrate that our approach achieves more robust performance on both forward-facing and large-scale complex datasets compared to other pose-free methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑