arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.10316cs.CVcs.AI

基于物理散焦建模与多视图几何监督的深度一致性3D Gaussian Splatting

Depth-Consistent 3D Gaussian Splatting via Physical Defocus Modeling and Multi-View Geometric Supervision

Department of Future Technology, South China University of Technology(华南理工大学未来技术学院)

Yu Deng, Baozhu Zhao, Junyan Su, Xiaohan Zhang, Qi Liu

AI总结:

针对极端深度变化场景下3D Gaussian Splatting近远场深度不一致的问题,本文提出融合物理散焦建模景深监督与LoFTR多视图几何监督的框架,在Waymo数据集上PSNR较SOTA提升0.8dB。

摘要:

由于近场与远场区域的监督信号不一致,存在极端深度变化场景的三维重建仍具挑战性。现有方法无法同时解决远距离区域深度估计不准确和近距离区域结构退化的问题。本文提出一种融合景深监督与多视图一致性监督的新型计算框架,以改进3D Gaussian Splatting。该方法包含两个核心组件:(1)景深监督模块采用尺度恢复的单目深度估计器(如Metric3D)生成深度先验,利用散焦卷积合成物理准确的散焦图像,并通过新型景深损失强制几何一致性,从而提升远场与近场区域的深度保真度;(2)多视图一致性监督模块采用基于LoFTR的半稠密特征匹配最小化跨视图几何误差,并通过可靠匹配点的最小二乘优化强制深度一致性。通过统一散焦物理与多视图几何约束,该方法实现了更优的深度保真度,在Waymo Open Dataset上相比当前最优方法取得了0.8 dB的PSNR提升。该框架架起了物理成像原理与基于学习的深度正则化之间的桥梁,为城市环境中的复杂深度分层问题提供了可扩展解决方案。

英文摘要:

Three-dimensional reconstruction in scenes with extreme depth variations remains challenging due to inconsistent supervisory signals between near-field and far-field regions. Existing methods fail to simultaneously address inaccurate depth estimation in distant areas and structural degradation in close-range regions. This paper proposes a novel computational framework that integrates depth-of-field supervision and multi-view consistency supervision to advance 3D Gaussian Splatting. Our approach comprises two core components: (1) Depth-of-field Supervision employs a scale-recovered monocular depth estimator (e.g., Metric3D) to generate depth priors, leverages defocus convolution to synthesize physically accurate defocused images, and enforces geometric consistency through a novel depth-of-field loss, thereby enhancing depth fidelity in both far-field and near-field regions; (2) Multi-View Consistency Supervision employing LoFTR-based semi-dense feature matching to minimize cross-view geometric errors and enforce depth consistency via least squares optimization of reliable matched points. By unifying defocus physics with multi-view geometric constraints, our method achieves superior depth fidelity, demonstrating a 0.8 dB PSNR improvement over the state-of-the-art method on the Waymo Open Dataset. This framework bridges physical imaging principles and learning-based depth regularization, offering a scalable solution for complex depth stratification in urban environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑