arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.12547cs.CV

评估高斯溅射中替代SFM点云初始化的方法

Evaluating Alternatives to SFM Point Cloud Initialization for Gaussian Splatting

Simon Fraser University(西蒙菲莎大学);University of British Columbia(不列颠哥伦比亚大学);University of Toronto(多伦多大学);Google DeepMind(谷歌DeepMind)

Yalda Foroutan, Daniel Rebain, Kwang Moo Yi, Andrea Tagliasacchi

AI总结:

针对高斯溅射依赖SFM点云初始化的问题,本文研究了多种初始化策略,并利用NeRF体积重建绕过SFM依赖,发现精心设计的随机初始化结合结构蒸馏可达到甚至超越SFM初始化的效果。

摘要:

3D高斯溅射因其高质量的结果和与硬件光栅化的兼容性,近来已被广泛接受为场景重建和新视角合成的通用且有效的方法。尽管有其优势,高斯溅射对运动恢复结构(SFM)算法提供的高质量点云初始化的依赖是一个需要克服的重大限制。为此,我们研究了高斯溅射的各种初始化策略,并深入探讨如何利用神经辐射场(NeRF)的体积重建来绕过对SFM数据的依赖。我们的研究结果表明,如果精心设计,随机初始化可以表现得更好,并且通过结合改进的初始化策略和从低成本NeRF模型中提取结构,可以实现与SFM初始化相当甚至有时更优的结果。源代码可在 https://theialab.github.io/nerf-3dgs 获取。

英文摘要:

3D Gaussian Splatting has recently been embraced as a versatile and effective method for scene reconstruction and novel view synthesis, owing to its high-quality results and compatibility with hardware rasterization. Despite its advantages, Gaussian Splatting's reliance on high-quality point cloud initialization by Structure-from-Motion (SFM) algorithms is a significant limitation to be overcome. To this end, we investigate various initialization strategies for Gaussian Splatting and delve into how volumetric reconstructions from Neural Radiance Fields (NeRF) can be utilized to bypass the dependency on SFM data. Our findings demonstrate that random initialization can perform much better if carefully designed and that by employing a combination of improved initialization strategies and structure distillation from low-cost NeRF models, it is possible to achieve equivalent results, or at times even superior, to those obtained from SFM initialization. Source code is available at https://theialab.github.io/nerf-3dgs .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑