arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.04314cs.CV

S2Gaussian:稀疏视角超分辨率3D高斯泼溅

S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splatting

China University of Petroleum (East China)(中国石油大学(华东));College of Computer Science and Technology(计算机科学与技术学院);Qingdao Institute of Software(青岛软件学院);Harbin Institute of Technology(哈尔滨工业大学);Faculty of Computing(计算机学院)

Yecong Wan, Mingwen Shao, Yuanshuo Cheng, Wangmeng Zuo

AI总结:

针对稀疏低分辨率视角重建3D场景的难题,提出两阶段框架S2Gaussian,通过深度正则化、Gaussian Shuffle Split操作及定制化无模糊不一致性建模与鲁棒优化策略,实现了结构准确、细节忠实且几何一致的最先进3D重建。

摘要:

在本文中,我们雄心勃勃地瞄准一个现实且具挑战性的问题,即如何从同时面临视角不足和清晰度欠缺的稀疏低分辨率视角中重建高质量3D场景。现有方法仅处理稀疏视角或低分辨率观测中的一种,无法应对这种混合且复杂的场景。为此,我们提出了一种新颖的稀疏视角超分辨率3D高斯泼溅框架,称为S2Gaussian,它能仅用稀疏且低分辨率的视角重建结构准确、细节忠实的3D场景。S2Gaussian以两阶段方式运行。第一阶段,我们首先通过深度正则化优化低分辨率高斯表示,并通过定制的Gaussian Shuffle Split操作对其进行致密化,以初始化高分辨率高斯。第二阶段,我们利用由原始稀疏视角和低分辨率高斯渲染的伪视角生成的超分辨率图像来细化高分辨率高斯。其中,精心设计了定制化的无模糊不一致性建模方案和3D鲁棒优化策略,以缓解多视角不一致性并消除由不完美监督导致的错误更新。大量实验证明了其优越结果,特别是凭借更一致的几何结构和更精细的细节确立了新的最先进性能。

英文摘要:

In this paper, we aim ambitiously for a realistic yet challenging problem, namely, how to reconstruct high-quality 3D scenes from sparse low-resolution views that simultaneously suffer from deficient perspectives and clarity. Whereas existing methods only deal with either sparse views or low-resolution observations, they fail to handle such hybrid and complicated scenarios. To this end, we propose a novel Sparse-view Super-resolution 3D Gaussian Splatting framework, dubbed S2Gaussian, that can reconstruct structure-accurate and detail-faithful 3D scenes with only sparse and low-resolution views. The S2Gaussian operates in a two-stage fashion. In the first stage, we initially optimize a low-resolution Gaussian representation with depth regularization and densify it to initialize the high-resolution Gaussians through a tailored Gaussian Shuffle Split operation. In the second stage, we refine the high-resolution Gaussians with the super-resolved images generated from both original sparse views and pseudo-views rendered by the low-resolution Gaussians. In which a customized blur-free inconsistency modeling scheme and a 3D robust optimization strategy are elaborately designed to mitigate multi-view inconsistency and eliminate erroneous updates caused by imperfect supervision. Extensive experiments demonstrate superior results and in particular establishing new state-of-the-art performances with more consistent geometry and finer details.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑