arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.00752cs.CVcs.GR
收藏

关于3D Gaussian Splatting的误差分析及一种最优投影策略

On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategy

Nanjing University(南京大学)

Letian Huang, Jiayang Bai, Jie Guo, Yuanqi Li, Yanwen Guo

AI总结:

本文分析了3D Gaussian Splatting中局部仿射近似导致的投影误差,基于一阶泰勒展开残差建立误差与高斯均值位置的相关性,并利用函数优化理论提出能适应多种相机模型的最优投影策略,有效减少伪影并提升真实感渲染质量。

摘要:

3D Gaussian Splatting在实时神经渲染中获得了广泛关注与应用。同时,人们也对该技术在点云存储、性能以及稀疏视角下的鲁棒性等方面的局限性提出了担忧,从而催生了各种改进方法。然而,对于splatting本身固有的局部仿射近似所引入的投影误差这一基本问题,以及这些误差对照片级真实感渲染质量的影响,一直明显缺乏关注。本文探讨了3D Gaussian Splatting的投影误差函数,从投影函数一阶泰勒展开的残差误差入手。分析建立了误差与高斯均值位置之间的相关性。随后,利用函数优化理论,本文分析了该函数的极小值,为Gaussian Splatting提供了一种最优投影策略,称为Optimal Gaussian Splatting,该策略能适应多种相机模型。实验验证进一步证实,这种投影方法减少了伪影,从而产生更具说服力的真实感渲染。

英文摘要:

3D Gaussian Splatting has garnered extensive attention and application in real-time neural rendering. Concurrently, concerns have been raised about the limitations of this technology in aspects such as point cloud storage, performance, and robustness in sparse viewpoints, leading to various improvements. However, there has been a notable lack of attention to the fundamental problem of projection errors introduced by the local affine approximation inherent in the splatting itself, and the consequential impact of these errors on the quality of photo-realistic rendering. This paper addresses the projection error function of 3D Gaussian Splatting, commencing with the residual error from the first-order Taylor expansion of the projection function. The analysis establishes a correlation between the error and the Gaussian mean position. Subsequently, leveraging function optimization theory, this paper analyzes the function's minima to provide an optimal projection strategy for Gaussian Splatting referred to Optimal Gaussian Splatting, which can accommodate a variety of camera models. Experimental validation further confirms that this projection methodology reduces artifacts, resulting in a more convincingly realistic rendering.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑