arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.18263cs.CV

RT-Splatting:基于高斯点散布的联合反射-透射建模

RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting

State Key Laboratory of General Artificial Intelligence(国家一般人工智能重点实验室);School of Intelligence Science and Technology(智能科学与技术学院)

Ji Shi, Xianghua Ying, Bowei Xing, Ruohao Guo, Wenzhen Yue

AI总结:

本文提出RT-Splatting方法,通过将高斯点的几何占用与光学不透明度分离,实现对半透明表面复杂反射和清晰透射的联合建模,从而在实时渲染中获得高质量的反射和透射效果。

摘要:

3D高斯点散布(3DGS)能够实现实时新型视角合成,具有高质量的视觉效果。然而,现有方法在处理半透明镜面表面时存在困难,这些表面同时表现出复杂的反射和清晰的透射,常常产生模糊的反射或过度遮挡的透射。为了解决这个问题,我们提出了RT-Splatting框架,该框架将每个高斯点的几何占用与其光学不透明度解耦。这种分解产生了一个统一的表面-体积场景表示,使用单组高斯基元。我们的混合渲染器将这种表示同时解释为表面以捕获高频反射,以及体积以保持清晰的透射。为了减轻联合优化反射和透射时的模糊性,我们引入了Specular-Aware Gradient Gating,该方法抑制了高镜面区域的误导梯度进入透射分支,从而有效减少 distracting floaters。在具有挑战性的半透明场景上的实验表明,RT-Splatting实现了最先进的性能,能够实时渲染高质量的反射和清晰的透射。此外,我们的分解自然地支持灵活的场景编辑。项目页面可在https://sjj118.github.io/RT-Splatting上找到。

英文摘要:

3D Gaussian Splatting (3DGS) enables real-time novel view synthesis with high visual quality. However, existing methods struggle with semi-transparent specular surfaces that exhibit both complex reflections and clear transmission, often producing blurry reflections or overly occluded transmission. To address this, we present RT-Splatting, a framework that disentangles each Gaussian's geometric occupancy from its optical opacity. This factorization yields a unified surface-volume scene representation with a single set of Gaussian primitives. Our hybrid renderer interprets this representation both as a surface to capture high-frequency reflections and as a volume to preserve clear transmission. To mitigate the ambiguity in jointly optimizing reflection and transmission, we introduce Specular-Aware Gradient Gating, which suppresses misleading gradients from highly specular regions into the transmission branch, effectively reducing distracting floaters. Experiments on challenging semi-transparent scenes show that RT-Splatting achieves state-of-the-art performance, delivering high-fidelity reflections and clear transmission with real-time rendering. Moreover, our factorization naturally enables flexible scene editing. The project page is available at https://sjj118.github.io/RT-Splatting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑