arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.18682cs.CVcs.GR
收藏

基于硬件光栅化的射线式高斯溅射(Ray-Based Gaussian Splatting)

Hardware-Rasterized Ray-Based Gaussian Splatting

Meta Reality Labs(Meta现实实验室);Zürich(苏黎世)

Samuel Rota Bulò, Nemanja Bartolovic, Lorenzo Porzi, Peter Kontschieder

AI总结:

该研究提出一种硬件光栅化的射线式3D高斯溅射渲染方法,推导适配标准着色器的高效渲染量估算方式,解决MIP相关走样问题,在多基准场景实现高帧率与SOTA画质,可支持VR/MR等画质敏感应用。

摘要:

我们提出了一种新颖的硬件光栅化渲染方法,用于基于射线的3D高斯溅射(RayGS),在新视角合成任务中同时实现了快速渲染与高质量结果。我们的工作包含数学上严谨且几何上直观的推导,阐明了如何高效估算渲染RayGS模型所需的所有相关量,且推导过程围绕标准硬件光栅化着色器的架构展开。我们的方案是首个能以足够高帧率渲染RayGS模型的方法,可支持虚拟与混合现实等对画质敏感的应用。我们的第二项贡献是解决了训练与测试阶段渲染不同尺度时出现的MIP相关问题,实现了RayGS的无走样渲染。我们在多个基准场景中验证了该方法的显著性能提升,同时保留了RayGS当前最优的画面质量。

英文摘要:

We present a novel, hardware rasterized rendering approach for ray-based 3D Gaussian Splatting (RayGS), obtaining both fast and high-quality results for novel view synthesis. Our work contains a mathematically rigorous and geometrically intuitive derivation about how to efficiently estimate all relevant quantities for rendering RayGS models, structured with respect to standard hardware rasterization shaders. Our solution is the first enabling rendering RayGS models at sufficiently high frame rates to support quality-sensitive applications like Virtual and Mixed Reality. Our second contribution enables alias-free rendering for RayGS, by addressing MIP-related issues arising when rendering diverging scales during training and testing. We demonstrate significant performance gains, across different benchmark scenes, while retaining state-of-the-art appearance quality of RayGS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑