arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2407.08280cs.CVcs.GRcs.RO
收藏

WayveScenes101: 面向自动驾驶新视角合成的数据集与基准

WayveScenes101: A Dataset and Benchmark for Novel View Synthesis in Autonomous Driving

Wayve(韦夫科技)

Jannik Zürn, Paul Gladkov, Sofía Dudas, Fergal Cotter, Sofi Toteva, Jamie Shotton, Vasiliki Simaiaki, Nikhil Mohan

AI总结:

本研究推出包含101个多样驾驶场景的WayveScenes101数据集,配套COLMAP生成的相机位姿、场景元数据与轴偏移视角评估协议,用于自动驾驶高动态场景新视角合成的基准测试与方法泛化能力评估。

摘要:

我们推出WayveScenes101数据集,旨在助力学界推动新视角合成领域的技术发展,该数据集聚焦于包含大量动态、可变形元素的高难度驾驶场景,这些元素的几何结构与纹理会发生变化。该数据集涵盖101个驾驶场景,覆盖了广泛的环境条件与驾驶场景。该数据集用于基准测试真实驾驶场景的重建效果,这类场景给场景重建方法带来了诸多固有挑战,包括图像眩光、快速曝光变化,以及存在严重遮挡的高动态场景。除原始图像外,我们还以标准数据格式提供了由COLMAP(运动恢复结构与三维重建工具)生成的相机位姿。我们提出了一套评估协议,用于在与训练视角存在轴偏移的预留相机视角上评估模型,专门测试方法的泛化能力。最后,我们为所有场景提供了详细的元数据,包括天气、时段和交通状况,以便根据场景特征对模型性能进行细致拆解。数据集与代码可在https://github.com/wayveai/wayve_scenes获取。

英文摘要:

We present WayveScenes101, a dataset designed to help the community advance the state of the art in novel view synthesis that focuses on challenging driving scenes containing many dynamic and deformable elements with changing geometry and texture. The dataset comprises 101 driving scenes across a wide range of environmental conditions and driving scenarios. The dataset is designed for benchmarking reconstructions on in-the-wild driving scenes, with many inherent challenges for scene reconstruction methods including image glare, rapid exposure changes, and highly dynamic scenes with significant occlusion. Along with the raw images, we include COLMAP-derived camera poses in standard data formats. We propose an evaluation protocol for evaluating models on held-out camera views that are off-axis from the training views, specifically testing the generalisation capabilities of methods. Finally, we provide detailed metadata for all scenes, including weather, time of day, and traffic conditions, to allow for a detailed model performance breakdown across scene characteristics. Dataset and code are available at https://github.com/wayveai/wayve_scenes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑