HybridSplat: 基于混合散射的快速反射烘焙高斯追踪
HybridSplat: Fast Reflection-baked Gaussian Tracing using Hybrid Splatting
AI总结：
本文提出HybridSplat机制，通过在高斯体素中烘焙视依赖反射，结合统一混合散射框架，实现高保真场景重建，并引入流水线加速和反射敏感高斯剪枝，提升渲染速度和降低内存占用。
摘要：
使用3D高斯散射渲染真实世界场景的复杂反射曾是光实新型视图合成的有希望解决方案，但仍面临渲染速度和内存存储的瓶颈。本文提出一种新的Hybrid Splatting机制，通过在每个高斯体素中烘焙视依赖反射，结合基于瓷砖的高斯散射渲染。然后我们使用统一的混合散射框架将反射高斯体素与基础高斯体素整合，以实现高保真的场景重建。此外，我们进一步引入流水线级别的加速，以及反射敏感的高斯剪枝，以减少模型大小，从而在保持反射渲染质量的同时实现更快的渲染速度和更低的内存存储。通过广泛的评估，我们的HybridSplat在Ref-NeRF和NeRF-Casting的复杂反射场景中将渲染速度提高了约7倍，使用比类似基于光线追踪的高斯散射基线少4倍的高斯体素，成为复杂反射场景的新状态-of-the-art方法。
英文摘要：
Rendering complex reflection of real-world scenes using 3D Gaussian splatting has been a quite promising solution for photorealistic novel view synthesis, but still faces bottlenecks especially in rendering speed and memory storage. This paper proposes a new Hybrid Splatting(HybridSplat) mechanism for Gaussian primitives. Our key idea is a new reflection-baked Gaussian tracing, which bakes the view-dependent reflection within each Gaussian primitive while rendering the reflection using tile-based Gaussian splatting. Then we integrate the reflective Gaussian primitives with base Gaussian primitives using a unified hybrid splatting framework for high-fidelity scene reconstruction. Moreover, we further introduce a pipeline-level acceleration for the hybrid splatting, and reflection-sensitive Gaussian pruning to reduce the model size, thus achieving much faster rendering speed and lower memory storage while preserving the reflection rendering quality. By extensive evaluation, our HybridSplat accelerates about 7x rendering speed across complex reflective scenes from Ref-NeRF, NeRF-Casting with 4x fewer Gaussian primitives than similar ray-tracing based Gaussian splatting baselines, serving as a new state-of-the-art method especially for complex reflective scenes.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
