arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.03462cs.CVcs.GRcs.RO

SpectralSplat:面向驾驶场景的外观-解耦前馈高斯点云法

SpectralSplat: Appearance-Disentangled Feed-Forward Gaussian Splatting for Driving Scenes

Applied Intuition;The Hong Kong University of Science and Technology(香港科技大学);University of California, Berkeley(加州大学伯克利分校)

Quentin Herau, Tianshuo Xu, Depu Meng, Jiezhi Yang, Chensheng Peng, Spencer Sherk, Yihan Hu, Wei Zhan

AI总结:

SpectralSplat通过前馈高斯点云法解耦场景几何与外观属性,提升驾驶场景的重建质量和可控外观迁移能力。

摘要:

前馈3D高斯点云方法在自动驾驶场景中实现了出色的重建质量,但将场景几何与瞬态外观属性如光照、天气和时间结合在一起,阻碍了光照、外观迁移和多遍数据下的一致渲染。我们提出了SpectralSplat,一种在前馈高斯点云框架中解耦外观与几何的方法。我们的关键见解是将颜色预测分解为一个不依赖外观的基础流和一个依赖外观的适应流,两者均由共享的MLP生成,该MLP基于从DINOv2特征中提取的全局外观嵌入进行条件化。为了强制解耦,我们使用混合光照管道训练配对观测,该管道结合了基于物理的内在分解和基于扩散的生成细化。我们还引入了可适应外观的时间历史,存储不依赖外观的特征,使累积的高斯点云能够在任意目标外观下重新渲染。实验表明,SpectralSplat在保持底层骨干网络重建质量的同时,实现了驾驶序列中的可控外观迁移和时间一致的光照。

英文摘要:

Feed-forward 3D Gaussian Splatting methods have achieved impressive reconstruction quality for autonomous driving scenes, yet they entangle scene geometry with transient appearance properties such as lighting, weather, and time of day. This coupling prevents relighting, appearance transfer, and consistent rendering across multi-traversal data captured under varying environmental conditions. We present SpectralSplat, a method that disentangles appearance from geometry within a feed-forward Gaussian Splatting framework. Our key insight is to factor color prediction into an appearance-agnostic base stream and and appearance-conditioned adapted stream, both produced by a shared MLP conditioned on a global appearance embedding derived from DINOv2 features. To enforce disentanglement, we train with paired observations generated by a hybrid relighting pipeline that combines physics-based intrinsic decomposition with diffusion based generative refinement, and supervise with complementary consistency, reconstruction, cross-appearance, and base color losses. We further introduce an appearance-adaptable temporal history that stores appearance-agnostic features, enabling accumulated Gaussians to be re-rendered under arbitrary target appearances. Experiments demonstrate that SpectralSplat preserves the reconstruction quality of the underlying backbone while enabling controllable appearance transfer and temporally consistent relighting across driving sequences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑