Constructing HD semantic maps is a central component of autonomous driving. However, traditional pipelines require a vast amount of human efforts and resources in annotating and maintaining the semantics in the map, which limits its scalability. In this paper, we introduce the problem of HD semantic map learning, which dynamically constructs the local semantics based on onboard sensor observations. Meanwhile, we introduce a semantic map learning method, dubbed HDMapNet. HDMapNet encodes image features from surrounding cameras and/or point clouds from LiDAR, and predicts vectorized map elements in the bird's-eye view. We benchmark HDMapNet on nuScenes dataset and show that in all settings, it performs better than baseline methods. Of note, our camera-LiDAR fusion-based HDMapNet outperforms existing methods by more than 50% in all metrics. In addition, we develop semantic-level and instance-level metrics to evaluate the map learning performance. Finally, we showcase our method is capable of predicting a locally consistent map. By introducing the method and metrics, we invite the community to study this novel map learning problem.
MapExpert: Online HD Map Construction with Simple and Efficient Sparse Map Element Expert
Lanzhou University(兰州大学);Smart (Shanghai) Robotics Technology Co., Ltd.(智己(上海)机器人科技有限公司);University of Science and Technology of China(中国科学技术大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
NavMapFusion: Diffusion-based Fusion of Navigation Maps for Online Vectorized HD Map Construction
Mercedes-Benz Research & Development North America, USA(梅赛德斯-奔驰北美研究与开发);University of Stuttgart, Germany(斯图加特大学);University of California, San Diego, USA(加州大学圣地亚哥分校);University of Southampton, United Kingdom(南安普顿大学)
Enhancing Online Road Network Perception and Reasoning with Standard Definition Maps
Bosch North America(博世北美);Bosch Center for AI (BCAI)(博世人工智能中心);Robert Bosch GmbH(罗伯特·博世有限公司);Contextual Robotics Institute(情境机器人学研究所);UC San Diego(加州大学圣迭戈分校)
MapDiffusion: Generative Diffusion for Vectorized Online HD Map Construction and Uncertainty Estimation in Autonomous Driving
Mercedes-Benz Research & Development North America(梅赛德斯-奔驰北美研发有限公司);University of Stuttgart(斯图加特大学);Institute for Artificial Intelligence(人工智能研究所);University of California, San Diego(加州大学圣地亚哥分校);University of Southampton(南安普顿大学)
Stability Under Scrutiny: Benchmarking Representation Paradigms for Online HD Mapping
State Key Lab of Intelligent Transportation System, Beihang University(北京航空航天大学智能交通系统国家重点实验室);School of Transportation Science and Engineering, Beihang University(北京航空航天大学交通科学与工程学院);Shanghai Jiao Tong University(上海交通大学);Ningbo Institute of Digital Twin, Eastern Institute of Technology(东方理工大学宁波数字孪生研究院);Beijing Academy of Artificial Intelligence (BAAI)(北京智源人工智能研究院);Institute for AI Industry Research (AIR), Tsinghua University(清华大学智能产业研究院)
DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion
Bosch Corporate Research, Bosch (China) Investment Ltd.(博世企业研究院、博世(中国)投资有限公司);School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);Shanghai Jiaotong University(上海交通大学);AIR, Tsinghua University(清华大学人工智能研究院);Robert Bosch GmbH(罗伯特·博世集团)
MapTRv2: An End-to-End Framework for Online Vectorized HD Map Construction
Institute of Artificial Intelligence, Huazhong University of Science and Technology(华中科技大学人工智能研究院);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院);Horizon Robotics(地平线机器人)
UncAD: Towards Safe End-to-end Autonomous Driving via Online Map Uncertainty
Key Laboratory of Safety Intelligent Mining in Non-coal Open-pit Mines, National Mine safety Administration, Guangdong Guangzhou, 510000, China(安全智能采矿非煤矿山重点实验室,国家矿山安全监察局,广东广州,510000,中国);The State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China(人工智能学院,中国科学院大学,北京,中国);EACON, Fujian, China(福建中国EACON)
GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction
National Engineering Research Center of Robot Visual Perception and Control Technology(机器人视觉感知与控制技术国家工程研究中心);State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University(浙江大学极端光学仪器与技术国家重点实验室);Shanghai Supremind Technology Company Ltd(上海赛曼德科技有限公司);College of Computer Science, Zhejiang University(浙江大学计算机学院);USC Viterbi School of Engineering, the University of Southern California(南加州大学维特比工程学院)
Online Vectorized HD Map Construction using Geometry
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);The Chinese University of Hong Kong(香港中文大学);Tencent AI Lab(腾讯AI实验室)
O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representation
Academy for Engineering & Technology(工程与技术学院);Fudan University(复旦大学);State Key Laboratory of Intelligent Vehicle Safety Technology(智能车辆安全技术国家重点实验室);School of Future Technology(未来技术学院);Harbin Institute of Technology(哈尔滨工业大学);Department of Computer Science and Engineering(计算机科学与工程系);Shanghai Jiao Tong University(上海交通大学)