GeoSplatting：面向基于物理的逆向渲染的几何引导高斯泼溅
GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering
AI总结：
本文提出GeoSplatting，通过可优化网格显式引导3D高斯泼溅，利用网格法线和光线追踪实现精确光传输建模，从而提升基于物理的逆向渲染中的材质分解与重光照质量。
摘要：
近期的3D高斯泼溅（3DGS）表示在新视角合成中展示了卓越的性能；进一步，在3DGS上进行材质-光照解耦保证了重光照能力及其对更广泛应用的适应性。后者的通用方法在于集成可微的基于物理的渲染（PBR）技术，以联合恢复BRDF材质和环境光照，但由于准确建模光传输的挑战，实现精确解耦仍是一项固有的困难任务。现有方法通常近似高斯点的法线，这构成了一种隐式的几何约束。然而，它们通常在法线估计中存在不准确的问题，随后会降低光传输的质量，导致有噪声的材质分解和有缺陷的重光照结果。为了解决这个问题，我们提出了GeoSplatting，这是一种通过显式几何指导来增强3DGS以实现精确光传输建模的新方法。通过从可优化的网格中可微地构建基于表面的3DGS，我们的方法利用了定义良好的网格法线和不透明的网格表面，并额外促进了基于网格的光线追踪技术的使用，以实现高效的、感知遮挡的光传输计算。这种增强确保了精确的材质分解，同时保留了3DGS的高效率和高质量渲染能力。在多个数据集上的综合评估证明了GeoSplatting的有效性，突出了其卓越的效率和最先进的逆向渲染性能。项目页面可在https://pku-vcl-geometry.github.io/GeoSplatting/ 找到。
英文摘要：
Recent 3D Gaussian Splatting (3DGS) representations have demonstrated remarkable performance in novel view synthesis; further, material-lighting disentanglement on 3DGS warrants relighting capabilities and its adaptability to broader applications. While the general approach to the latter operation lies in integrating differentiable physically-based rendering (PBR) techniques to jointly recover BRDF materials and environment lighting, achieving a precise disentanglement remains an inherently difficult task due to the challenge of accurately modeling light transport. Existing approaches typically approximate Gaussian points' normals, which constitute an implicit geometric constraint. However, they usually suffer from inaccuracies in normal estimation that subsequently degrade light transport, resulting in noisy material decomposition and flawed relighting results. To address this, we propose GeoSplatting, a novel approach that augments 3DGS with explicit geometry guidance for precise light transport modeling. By differentiably constructing a surface-grounded 3DGS from an optimizable mesh, our approach leverages well-defined mesh normals and the opaque mesh surface, and additionally facilitates the use of mesh-based ray tracing techniques for efficient, occlusion-aware light transport calculations. This enhancement ensures precise material decomposition while preserving the efficiency and high-quality rendering capabilities of 3DGS. Comprehensive evaluations across diverse datasets demonstrate the effectiveness of GeoSplatting, highlighting its superior efficiency and state-of-the-art inverse rendering performance. The project page can be found at https://pku-vcl-geometry.github.io/GeoSplatting/.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
