arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.01147cs.CV
收藏

4Seasons:挑战性条件下自动驾驶的视觉SLAM与长期定位基准

4Seasons: Benchmarking Visual SLAM and Long-Term Localization for Autonomous Driving in Challenging Conditions

Technical University of Munich(慕尼黑技术大学);Reality Labs at Meta(Meta现实实验室);Microsoft Mixed Reality & AI Lab(微软混合现实与人工智能实验室);Karlsruhe University of Applied Sciences(卡尔斯鲁厄应用科学大学)

Patrick Wenzel, Nan Yang, Rui Wang, Niclas Zeller, Daniel Cremers

AI总结:

本文提出基于4Seasons数据集的统一基准,用于在挑战性条件下联合评估视觉SLAM、地点识别和定位,实验显示现有方法在剧烈外观变化下仍有提升空间。

摘要:

本文基于大规模4Seasons数据集,提出了一种用于自动驾驶在挑战性条件下的新型视觉SLAM和长期定位基准。该基准提供了由季节变化以及多样的天气和光照条件引起的剧烈外观变化。尽管在相似条件下的小规模数据集上推进视觉SLAM已取得显著进展,但仍缺乏代表自动驾驶真实场景的统一基准。我们引入了一个新的统一基准,用于联合评估视觉里程计、全局地点识别和基于地图的视觉定位性能,这对于在任何条件下成功实现自动驾驶至关重要。数据收集历时一年多,在九个不同环境中记录了超过300公里的数据,环境范围从多层停车场到城市(包括隧道)、乡村和高速公路。我们提供了全局一致的参考位姿,精度可达厘米级,这些位姿通过直接立体惯性里程计与RTK GNSS融合获得。我们在该基准上评估了几种最先进的视觉里程计和视觉定位基线方法的性能,并分析了它们的特性。实验结果对当前方法提供了新的见解,并显示出未来研究的巨大潜力。我们的基准和评估协议将在https://go.vision.in.tum.de/4seasons提供。

英文摘要:

In this paper, we present a novel visual SLAM and long-term localization benchmark for autonomous driving in challenging conditions based on the large-scale 4Seasons dataset. The proposed benchmark provides drastic appearance variations caused by seasonal changes and diverse weather and illumination conditions. While significant progress has been made in advancing visual SLAM on small-scale datasets with similar conditions, there is still a lack of unified benchmarks representative of real-world scenarios for autonomous driving. We introduce a new unified benchmark for jointly evaluating visual odometry, global place recognition, and map-based visual localization performance which is crucial to successfully enable autonomous driving in any condition. The data has been collected for more than one year, resulting in more than 300 km of recordings in nine different environments ranging from a multi-level parking garage to urban (including tunnels) to countryside and highway. We provide globally consistent reference poses with up to centimeter-level accuracy obtained from the fusion of direct stereo-inertial odometry with RTK GNSS. We evaluate the performance of several state-of-the-art visual odometry and visual localization baseline approaches on the benchmark and analyze their properties. The experimental results provide new insights into current approaches and show promising potential for future research. Our benchmark and evaluation protocols will be available at https://go.vision.in.tum.de/4seasons.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑