arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.09277cs.CV
收藏

用更短的高斯列表加速3D高斯学习

Speeding Up the Learning of 3D Gaussians with Much Shorter Gaussian Lists

Machine Perception Lab, Wayne State University(机器感知实验室,韦恩州立大学)

Jiaqi Liu, Zhizhong Han

AI总结:

通过缩短高斯列表提升3D高斯学习效率,采用尺度重置和熵约束优化渲染效率。

摘要:

3D高斯溅射(3DGS)已成为从多视角图像学习辐射场的重要工具。尽管3DGS在渲染质量和效率上优于NeRF,但进一步提高学习3D高斯效率仍是一个研究挑战。为克服这一挑战,我们提出了新的训练策略和损失函数,以缩短每个高斯列表的大小,从而加快溅射过程。具体而言,我们通过定期重置高斯的尺度来缩小每个高斯的大小,鼓励较小的高斯覆盖更少的附近像素,从而缩短像素的高斯列表。此外,我们引入了对alpha混合过程的熵约束,以增强高斯权重沿每个射线的分布,这会驱动主导权重增大,同时使次要权重减小。结果,每个高斯更专注于其主导的像素,从而减少其对附近像素的影响,导致更短的高斯列表。最终,我们将方法整合到渲染分辨率调度器中,通过渐进式分辨率增加进一步提高效率。我们通过在广泛使用的基准上与最先进的方法进行比较来评估我们的方法。我们的结果表明,在不牺牲渲染质量的情况下,我们的方法在效率上有显著优势。

英文摘要:

3D Gaussian splatting (3DGS) has become a vital tool for learning a radiance field from multiple posed images. Although 3DGS shows great advantages over NeRF in terms of rendering quality and efficiency, it remains a research challenge to further improve the efficiency of learning 3D Gaussians. To overcome this challenge, we propose novel training strategies and losses to shorten each Gaussian list used to render a pixel, which speeds up the splatting by involving fewer Gaussians along a ray. Specifically, we shrink the size of each Gaussian by resetting their scales regularly, encouraging smaller Gaussians to cover fewer nearby pixels, which shortens the Gaussian lists of pixels. Additionally, we introduce an entropy constraint on the alpha blending procedure to sharpen the weight distribution of Gaussians along each ray, which drives dominant weights larger while making minor weights smaller. As a result, each Gaussian becomes more focused on the pixels where it is dominant, which reduces its impact on nearby pixels, leading to even shorter Gaussian lists. Eventually, we integrate our method into a rendering resolution scheduler which further improves efficiency through progressive resolution increase. We evaluate our method by comparing it with state-of-the-art methods on widely used benchmarks. Our results show significant advantages over others in efficiency without sacrificing rendering quality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑