arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.11508cs.CV

细察细节:利用局部深度与语义正则化增强稀疏视角3D高斯泼溅

See In Detail: Enhancing Sparse-view 3D Gaussian Splatting with Local Depth and Semantic Regularization

The Hong Kong Polytechnic University(香港理工大学)

Zongqi He, Zhe Xiao, Kin-Chung Chan, Yushen Zuo, Jun Xiao, Kin-Man Lam

AI总结:

针对稀疏视角3DGS渲染质量下降问题,提出结合DINO-ViT语义正则化与局部深度正则化的方法,在LLFF数据集上PSNR提升0.4dB,减少扭曲并增强细节。

摘要:

3D高斯泼溅(3DGS)在新视角合成中展现出卓越性能。然而,在稀疏输入视角下,其渲染质量会下降,导致内容扭曲和细节减少。这一局限阻碍了其实际应用。为解决此问题,我们提出一种稀疏视角3DGS方法。鉴于稀疏视角渲染固有的不适定性,引入先验信息至关重要。我们提出一种语义正则化技术,利用从预训练的DINO-ViT模型中提取的特征,以确保多视角语义一致性。此外,我们提出局部深度正则化,通过约束深度值来改善对未见视角的泛化能力。我们的方法优于最先进的新视角合成方法,在LLFF数据集上PSNR提升高达0.4dB,同时减少扭曲并增强视觉质量。

英文摘要:

3D Gaussian Splatting (3DGS) has shown remarkable performance in novel view synthesis. However, its rendering quality deteriorates with sparse inphut views, leading to distorted content and reduced details. This limitation hinders its practical application. To address this issue, we propose a sparse-view 3DGS method. Given the inherently ill-posed nature of sparse-view rendering, incorporating prior information is crucial. We propose a semantic regularization technique, using features extracted from the pretrained DINO-ViT model, to ensure multi-view semantic consistency. Additionally, we propose local depth regularization, which constrains depth values to improve generalization on unseen views. Our method outperforms state-of-the-art novel view synthesis approaches, achieving up to 0.4dB improvement in terms of PSNR on the LLFF dataset, with reduced distortion and enhanced visual quality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑