4Seasons: Benchmarking Visual SLAM and Long-Term Localization for Autonomous Driving in Challenging Conditions
Technical University of Munich(慕尼黑技术大学);Reality Labs at Meta(Meta现实实验室);Microsoft Mixed Reality & AI Lab(微软混合现实与人工智能实验室);Karlsruhe University of Applied Sciences(卡尔斯鲁厄应用科学大学)
Patrick Wenzel, Nan Yang, Rui Wang, Niclas Zeller, Daniel Cremers
In this paper, we present a novel visual SLAM and long-term localization benchmark for autonomous driving in challenging conditions based on the large-scale 4Seasons dataset. The proposed benchmark provides drastic appearance variations caused by seasonal changes and diverse weather and illumination conditions. While significant progress has been made in advancing visual SLAM on small-scale datasets with similar conditions, there is still a lack of unified benchmarks representative of real-world scenarios for autonomous driving. We introduce a new unified benchmark for jointly evaluating visual odometry, global place recognition, and map-based visual localization performance which is crucial to successfully enable autonomous driving in any condition. The data has been collected for more than one year, resulting in more than 300 km of recordings in nine different environments ranging from a multi-level parking garage to urban (including tunnels) to countryside and highway. We provide globally consistent reference poses with up to centimeter-level accuracy obtained from the fusion of direct stereo-inertial odometry with RTK GNSS. We evaluate the performance of several state-of-the-art visual odometry and visual localization baseline approaches on the benchmark and analyze their properties. The experimental results provide new insights into current approaches and show promising potential for future research. Our benchmark and evaluation protocols will be available at https://go.vision.in.tum.de/4seasons.
AgriGS-SLAM: Orchard Mapping Across Seasons via Multi-View Gaussian Splatting SLAM
Dipartimento di Bioingegneria, Elettronica e Informazione, Politecnico di Milano(生物工程、电子与信息系,米兰理工大学);Agricultural Biosystems Engineering, Wageningen University & Research(农业生物系统工程,瓦赫宁根大学与研究)
Institute for Intelligent Systems, Esslingen University of Applied Sciences(智能系统研究所,埃斯林根应用科学大学);Department of Computer Science, University of Freiburg(计算机科学系,弗赖堡大学);ANDREAS STIHL AG & Co. KG(安德烈亚斯·施塔尔有限公司)
Institute for Intelligent Systems, Esslingen University of Applied Sciences(埃斯林根应用科学大学智能系统研究所);Department of Computer Science, University of Freiburg(弗莱堡大学计算机科学系)
Benchmarking 6DOF Outdoor Visual Localization in Changing Conditions
ETH Zürich(苏黎世联邦理工学院);University of Oxford(牛津大学);Chalmers University of Technology(查尔姆斯理工大学);Tokyo Institute of Technology(东京工业大学);Technical University of Denmark(丹麦技术大学);Microsoft(微软);Inria(法国国家信息与自动化研究所);CTU in Prague(布拉格捷克技术大学);Centre for Mathematical Sciences, Lund University(隆德大学数学科学中心);ENS/INRIA/CNRS UMR 8548, PSL Research University(巴黎高等师范学院/法国国家信息与自动化研究所/法国国家科学研究中心联合实验室(编号8548),巴黎高等师范学院 - 巴黎科学与人文学院(PSL Research University));CIIRC - Czech Institute of Informatics, Robotics, and Cybernetics, Czech Technical University in Prague(布拉格捷克技术大学捷克信息学、机器人学与控制论研究所(CIIRC));WILLOW project(WILLOW项目)
The Oxford Spires Dataset: Benchmarking Large-Scale LiDAR-Visual Localisation, Reconstruction and Radiance Field Methods
Oxford Robotics Inst., Dept. of Eng. Science, Univ. of Oxford, UK(牛津大学机器人研究所、工程科学系);Group of Automation, Robotics and Computer Vision (AUROVA), University of Alicante, Spain(自动化、机器人与计算机视觉小组(AUROVA)、阿尔基兰特大学)
Why Not Replace? Sustaining Long-Term Visual Localization via Handcrafted-Learned Feature Collaboration on CPU
State Key Laboratory of Intelligent Manufacturing Equipment and Technology, School of Mechanical Science and Engineering, Huazhong University of Science and Technology(智能制造装备与技术国家重点实验室,机械科学与工程学院,华中科技大学)
EndoSLAM Dataset and An Unsupervised Monocular Visual Odometry and Depth Estimation Approach for Endoscopic Videos: Endo-SfMLearner
Institute of Biomedical Engineering, Bogazici University(波加兹奇大学生物医学工程研究所);Computer Science Department, University of Oxford(牛津大学计算机科学系);Brigham and Women’s Hospital, Harvard Medical School(哈佛医学院布莱根妇女医院);Cancer Data Science, Dana Farber Cancer Institute(丹娜-法伯癌症研究所癌症数据科学部);Cancer Program, Broad Institute of Harvard and MIT(哈佛-麻省理工学院布罗德研究所癌症项目);Institute for Systems and Robotics, University of Coimbra(科英布拉大学系统与机器人研究所);Faculty of Medicine, Clinical Academic Center of Coimbra, University of Coimbra(科英布拉大学科英布拉临床学术中心医学院);Department of Biomedical Engineering, Johns Hopkins University(约翰霍普金斯大学生物医学工程系)