arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.02598cs.CVcs.AI

AutoSplat:面向自动驾驶场景重建的约束高斯泼溅

AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstruction

University of Toronto(多伦多大学)

Mustafa Khan, Hamidreza Fazlali, Dhruv Sharma, Tongtong Cao, Dongfeng Bai, Yuan Ren, Bingbing Liu

AI总结:

AutoSplat通过几何约束、反射高斯一致性约束和残差球谐函数,提升自动驾驶场景重建与新视图合成的真实性和多视图一致性。

摘要:

真实场景重建与视图合成对于通过模拟安全关键场景来推进自动驾驶系统至关重要。3D高斯泼溅在实时渲染和静态场景重建方面表现出色,但由于复杂背景、动态物体和稀疏视图,难以对驾驶场景进行建模。我们提出AutoSplat,一个采用高斯泼溅实现自动驾驶场景高度真实重建的框架。通过对表示道路和天空区域的高斯施加几何约束,我们的方法能够对包括车道变更在内的挑战性场景进行多视图一致模拟。利用3D模板,我们引入反射高斯一致性约束,以同时监督前景物体的可见侧和不可见侧。此外,为了建模前景物体的动态外观,我们为每个前景高斯估计残差球谐函数。在Pandaset和KITTI上的大量实验表明,AutoSplat在多种驾驶场景下的场景重建和新视图合成方面优于最先进的方法。请访问我们的项目页面 https://autosplat.github.io/。

英文摘要:

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but struggles with modeling driving scenarios due to complex backgrounds, dynamic objects, and sparse views. We propose AutoSplat, a framework employing Gaussian splatting to achieve highly realistic reconstructions of autonomous driving scenes. By imposing geometric constraints on Gaussians representing the road and sky regions, our method enables multi-view consistent simulation of challenging scenarios including lane changes. Leveraging 3D templates, we introduce a reflected Gaussian consistency constraint to supervise both the visible and unseen side of foreground objects. Moreover, to model the dynamic appearance of foreground objects, we estimate residual spherical harmonics for each foreground Gaussian. Extensive experiments on Pandaset and KITTI demonstrate that AutoSplat outperforms state-of-the-art methods in scene reconstruction and novel view synthesis across diverse driving scenarios. Visit our project page at https://autosplat.github.io/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑