arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.05907cs.CVcs.RO
收藏

Lightning NeRF:面向自动驾驶的高效混合场景表示

Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving

Shanghai Jiao Tong University(上海交通大学);Tusimple(图森未来)

Junyi Cao, Zhichao Li, Naiyan Wang, Chao Ma

AI总结:

针对自动驾驶场景下NeRF因环境复杂、视角受限导致重建质量差、训练渲染慢的问题,提出融合LiDAR几何先验的Lightning NeRF,在多数据集上实现合成质量更优且训练渲染速度大幅提升。

摘要:

近期研究凸显了NeRF在自动驾驶场景中的应用潜力。然而,户外环境的复杂性,加之驾驶场景中视角受限,使得精确重建场景几何的任务颇具难度。这类挑战往往会导致重建质量下降,且训练与渲染耗时均会延长。为应对这些挑战,我们提出了Lightning NeRF。该方法采用高效的混合场景表示,可有效利用自动驾驶场景中来自LiDAR的几何先验。Lightning NeRF显著提升了NeRF的新视角合成性能,并降低了计算开销。通过在KITTI-360、Argoverse2等真实世界数据集以及我们的私有数据集上开展评估,我们证明所提方法不仅在新视角合成质量上超越了当前最优水平,还实现了5倍的训练速度提升与10倍的渲染速度提升。代码可在https://github.com/VISION-SJTU/Lightning-NeRF 获取。

英文摘要:

Recent studies have highlighted the promising application of NeRF in autonomous driving contexts. However, the complexity of outdoor environments, combined with the restricted viewpoints in driving scenarios, complicates the task of precisely reconstructing scene geometry. Such challenges often lead to diminished quality in reconstructions and extended durations for both training and rendering. To tackle these challenges, we present Lightning NeRF. It uses an efficient hybrid scene representation that effectively utilizes the geometry prior from LiDAR in autonomous driving scenarios. Lightning NeRF significantly improves the novel view synthesis performance of NeRF and reduces computational overheads. Through evaluations on real-world datasets, such as KITTI-360, Argoverse2, and our private dataset, we demonstrate that our approach not only exceeds the current state-of-the-art in novel view synthesis quality but also achieves a five-fold increase in training speed and a ten-fold improvement in rendering speed. Codes are available at https://github.com/VISION-SJTU/Lightning-NeRF .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑