arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.03538cs.CV

PRTGS:面向实时高质量重光照的高斯泼溅预计算辐射传输

PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relighting

Peking University(北京大学)

Yijia Guo, Yuanxi Bai, Liwen Hu, Ziyi Guo, Mianzhi Liu, Yu Cai, Tiejun Huang, Lei Ma

AI总结:

PRTGS通过预计算高斯泼溅的辐射传输,实现低频动态光照下包含柔和阴影和间接光照的实时高质量重光照,达到1080p下30+fps性能。

摘要:

我们提出了PRTGS(Precomputed Radiance Transfer of Gaussian Splats),一种针对低频光照环境下高斯泼溅的实时高质量重光照方法,通过预计算3D高斯泼溅的辐射传输来捕获柔和阴影和相互反射。已有研究表明,3D高斯泼溅(3DGS)在动态光照场景中的效率优于神经场。然而,当前基于3DGS的重光照方法仍难以在动态光照下实时计算高质量的阴影和间接光照,导致渲染结果不真实。我们通过预计算复杂传输函数(如阴影)所需的昂贵传输模拟来解决这一问题,所得传输函数表示为每个高斯泼溅的稠密向量或矩阵集合。我们引入了分别针对训练和渲染阶段的独特预计算方法,以及针对3D高斯泼溅的独特光线追踪和间接光照预计算技术,以加速训练速度并计算与环境光相关的精确间接光照。实验分析表明,我们的方法在保持有竞争力的训练时间的同时达到了最先进的视觉质量,并能在1080p分辨率下对动态光和相对复杂的场景实现高质量实时(30+ fps)重光照。

英文摘要:

We proposed Precomputed RadianceTransfer of GaussianSplats (PRTGS), a real-time high-quality relighting method for Gaussian splats in low-frequency lighting environments that captures soft shadows and interreflections by precomputing 3D Gaussian splats' radiance transfer. Existing studies have demonstrated that 3D Gaussian splatting (3DGS) outperforms neural fields' efficiency for dynamic lighting scenarios. However, the current relighting method based on 3DGS still struggles to compute high-quality shadow and indirect illumination in real time for dynamic light, leading to unrealistic rendering results. We solve this problem by precomputing the expensive transport simulations required for complex transfer functions like shadowing, the resulting transfer functions are represented as dense sets of vectors or matrices for every Gaussian splat. We introduce distinct precomputing methods tailored for training and rendering stages, along with unique ray tracing and indirect lighting precomputation techniques for 3D Gaussian splats to accelerate training speed and compute accurate indirect lighting related to environment light. Experimental analyses demonstrate that our approach achieves state-of-the-art visual quality while maintaining competitive training times and allows high-quality real-time (30+ fps) relighting for dynamic light and relatively complex scenes at 1080p resolution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑