One of the fundamental challenges to scale self-driving is being able to create accurate high definition maps (HD maps) with low cost. Current attempts to automate this process typically focus on simple scenarios, estimate independent maps per frame or do not have the level of precision required by modern self driving vehicles. In contrast, in this paper we focus on drawing the lane boundaries of complex highways with many lanes that contain topology changes due to forks and merges. Towards this goal, we formulate the problem as inference in a directed acyclic graphical model (DAG), where the nodes of the graph encode geometric and topological properties of the local regions of the lane boundaries. Since we do not know a priori the topology of the lanes, we also infer the DAG topology (i.e., nodes and edges) for each region. We demonstrate the effectiveness of our approach on two major North American Highways in two different states and show high precision and recall as well as 89% correct topology.
A Concise Survey on Lane Topology Reasoning for HD Mapping
NavInfo Co., Ltd.（四维图新有限公司）；Autohome Inc.（汽车之家）；Baidu Inc.（百度公司）；Xidian University of Technology（西安工业大学）；Hefei University of Technology（合肥工业大学）；Renmin University of China（中国人民大学）
RATopo: Improving Lane Topology Reasoning via Redundancy Assignment
School of Artificial Intelligence Beihang University Beijing China（人工智能学院 北航 北京 中国）；Zhongguancun Academy Beijing China（中关村学院 北京 中国）；Hangzhou International Innovation Institute Beihang University Hangzhou China（杭州国际创新研究院 北航 杭州 中国）；Beihang University（北航）；Zhongguancun Academy（中关村学院）；University of Macau（澳门大学）
TopoPoint: Enhance Topology Reasoning via Endpoint Detection in Autonomous Driving
Institute of Computing Technology, Chinese Academy of Science（中国科学院计算技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Shanghai AI Lab（上海人工智能实验室）；Shanghai Innovation Institute（上海创新研究院）
TopoLogic: An Interpretable Pipeline for Lane Topology Reasoning on Driving Scenes
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Hangzhou Dianzi University（杭州电子科技大学）
Beijing Institute of Technology（北京理工大学）；MEGVII Technology（旷视科技）；University of Science and Technology of China（中国科学技术大学）；SKL-IOTSC, University of Macau（澳门大学智慧城市物联网国家重点实验室）
Topology reasoning aims to comprehensively understand road scenes and present drivable routes in autonomous driving. It requires detecting road centerlines (lane) and traffic elements, further reasoning their topology relationship, i.e., lane-lane topology, and lane-traffic topology. In this work, we first present that the topology score relies heavily on detection performance on lane and traffic elements. Therefore, we introduce a powerful 3D lane detector and an improved 2D traffic element detector to extend the upper limit of topology performance. Further, we propose TopoMLP, a simple yet h…
Reusing Attention for One-stage Lane Topology Understanding
Institute for AI Industry Research, Tsinghua University（人工智能产业研究院，清华大学）；Bosch Corporate Research, China（博世企业研究，中国）；Institute for Interdisciplinary Information Sciences, Tsinghua University（交叉信息科学研究院，清华大学）；Department of Computer Science, ETH Zürich（计算机科学系，苏黎世联邦理工学院）；State Key Lab of Intelligent Transportation System, Beihang University（智能交通系统国家重点实验室，北航）
The Hong Kong University of Science and Technology（香港科技大学）；The Hong Kong Polytechnic University（香港理工大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute（香港科技大学深港协同创新研究院）
With the fast development of autonomous driving technologies, there is an increasing demand for high-definition (HD) maps, which provide reliable and robust prior information about the static part of the traffic environments. As one of the important elements in HD maps, road lane centerline is critical for downstream tasks, such as prediction and planning. Manually annotating centerlines for road lanes in HD maps is labor-intensive, expensive and inefficient, severely restricting the wide applications of autonomous driving systems. Previous work seldom explores the lane centerline detection pr…
Chameleon: Fast-slow Neuro-symbolic Lane Topology Extraction
Institute for AI Industry Research (AIR), Tsinghua University（清华大学人工智能产业研究院（AIR））；Bosch Corporate Research, China（博世中国企业研究中心）；Institute for Interdisciplinary Information Sciences(IIIS), Tsinghua University（清华大学交叉信息研究院）
ARETE: Attention-based Rasterized Encoding for Topology Estimation using HSV-transformed Crowdsourced Vehicle Fleet Data
Mercedes-Benz AG, Research \& Development, Sindelfingen, Germany Institute for Intelligent Systems, Esslingen University of Applied Sciences, Esslingen, Germany
University of Toronto（多伦多大学）；Uber Advanced Technologies Group（优步先进技术集团）
Forecasting the future behaviors of dynamic actors is an important task in many robotics applications such as self-driving. It is extremely challenging as actors have latent intentions and their trajectories are governed by complex interactions between the other actors, themselves, and the maps. In this paper, we propose LaneRCNN, a graph-centric motion forecasting model. Importantly, relying on a specially designed graph encoder, we learn a local lane graph representation per actor (LaneRoI) to encode its past motions and the local map topology. We further develop an interaction module which …
OpenDriveLab（开放驾驶实验室）；Shanghai AI Lab（上海人工智能实验室）；Huawei（华为）；Fudan University（复旦大学）；The University of Hong Kong（香港大学）；Shanghai Jiao Tong University（上海交通大学）
LANet: A Lane Boundaries-Aware Approach For Robust Trajectory Prediction
Artificial Intelligence Creative Research Lab, ETRI University of Science（ETRI人工智能创意研究实验室，科学技术大学）；Artificial Intelligence Creative Research Lab, ETRI Daejeon, South Korea（ETRI人工智能创意研究实验室，韩国大田）
Knowledge of the road network topology is crucial for autonomous planning and navigation. Yet, recovering such topology from a single image has only been explored in part. Furthermore, it needs to refer to the ground plane, where also the driving actions are taken. This paper aims at extracting the local road network topology, directly in the bird's-eye-view (BEV), all in a complex urban setting. The only input consists of a single onboard, forward looking camera image. We represent the road topology using a set of directed lane curves and their interactions, which are captured using their int…
Monocular Lane Detection Based on Deep Learning: A Survey
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Peng Cheng Laboratory（鹏城实验室）；Wuhan AI Research（武汉人工智能研究院）；University of Chinese Academy of Sciences（中国科学院大学）
Predicting the possible future behaviors of vehicles that drive on shared roads is a crucial task for safe autonomous driving. Many existing approaches to this problem strive to distill all possible vehicle behaviors into a simplified set of high-level actions. However, these action categories do not suffice to describe the full range of maneuvers possible in the complex road networks we encounter in the real world. To combat this deficiency, we propose a new method that leverages the mapped road topology to reason over possible goals and predict the future spatial occupancy of dynamic road ac…
Fine-Grained Behavior and Lane Constraints Guided Trajectory Prediction Method
School of Mechanical Engineering, Zhejiang University（浙江大学机械工程学院）；Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, School of Automation and Intelligent Manufacturing, Southern University of Science and Technology（南方科技大学自动化与智能制造学院广东省全驱系统控制理论与技术重点实验室）；Leapmotor Technology（零跑科技）
University of Massachusetts（马萨诸塞大学）；Nissan Research Center（日产研究中心）
Autonomous vehicles (AVs) require accurate metric and topological location estimates for safe, effective navigation and decision-making. Although many high-definition (HD) roadmaps exist, they are not always accurate since public roads are dynamic, shaped unpredictably by both human activity and nature. Thus, AVs must be able to handle situations in which the topology specified by the map does not agree with reality. We present the Variable Structure Multiple Hidden Markov Model (VSM-HMM) as a framework for localizing in the presence of topological uncertainty, and demonstrate its effectivenes…
GFSR: Geometric Fidelity and Spatial Refinement for Reliable Lane Detection
the School of Big Data and Statistics, Anhui University（安徽大学大数据与统计学院）；the School of Artificial Intelligence and Data Science, University of Science and Technology of China（中国科学技术大学人工智能与数据科学学院）；Institute of Dataspace, Hefei Comprehensive National Science Center（合肥综合性国家科学中心数据空间研究院）；the College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算机与数据科学学院）；the School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University（深圳大学医学院生物医学工程学院）
Unified Modeling of Lane and Lane Topology for Driving Scene Reasoning
School of Artificial Intelligence, Beihang University（北京航空航天大学人工智能学院）；Zhongguancun Academy, Beijing, China（中关村学院，北京，中国）；Hangzhou International Innovation Institute, Beihang University（杭州国际创新院，北京航空航天大学）；Meituan, Beijing, China（美团，北京，中国）
CNRS UMR 7253 Heudiasyc（法国国家科学研究中心 Heudiasyc 混合实验室）；Renault S.A.S（雷诺股份有限公司）
For an autonomous vehicle, situation understand-ing is a key capability towards safe and comfortable decision-making and navigation. Information is in general provided bymultiple sources. Prior information about the road topology andtraffic laws can be given by a High Definition (HD) map whilethe perception system provides the description of the spaceand of road entities evolving in the vehicle surroundings. Incomplex situations such as those encountered in urban areas,the road user behaviors are governed by strong interactionswith the others, and with the road network. In such situations,reli…
FZI Research Center for Information Technology（FZI信息技术研究中心）；Karlsruhe Institute of Technology (KIT)（卡尔斯鲁厄理工学院（KIT））
Estimating and understanding the current scene is an inevitable capability of automated vehicles. Usually, maps are used as prior for interpreting sensor measurements in order to drive safely and comfortably. Only few approaches take into account that maps might be outdated and lead to wrong assumptions on the environment. This work estimates a lane-level intersection topology without any map prior by observing the trajectories of other traffic participants. We are able to deliver both a coarse lane-level topology as well as the lane course inside and outside of the intersection using Markov c…
Automated Digital Twin Construction for Highway Scenarios Using LiDAR Point Clouds and OpenStreetMap
Institute of Automotive Engineering, Graz University of Technology（格拉茨技术大学汽车工程研究所）；School of Intelligent Connected Vehicle, Hubei University of Automotive Technology（湖北汽车工业学院智能网联汽车学院）；Professorship of Autonomous Vehicle Systems, Technical University of Munich（慕尼黑工业大学自动驾驶系统教席）
Refine Connections, Close the Gap: A Reliable Enhancement Framework for Driving Scene Topology
Bosch Research North America（博世北美研究院）；Bosch Center for Artificial Intelligence (BCAI)（博世人工智能中心）；Massachusetts Institute of Technology（麻省理工学院）；Bosch XC China（博世中国XC部门）
OPPO Research Institute（OPPO研究院）；Waseda University（早稻田大学）
We propose a motion forecasting model called BANet, which means Boundary-Aware Network, and it is a variant of LaneGCN. We believe that it is not enough to use only the lane centerline as input to obtain the embedding features of the vector map nodes. The lane centerline can only provide the topology of the lanes, and other elements of the vector map also contain rich information. For example, the lane boundary can provide traffic rule constraint information such as whether it is possible to change lanes which is very important. Therefore, we achieved better performance by encoding more vector…
We propose a motion forecasting model that exploits a novel structured map representation as well as actor-map interactions. Instead of encoding vectorized maps as raster images, we construct a lane graph from raw map data to explicitly preserve the map structure. To capture the complex topology and long range dependencies of the lane graph, we propose LaneGCN which extends graph convolutions with multiple adjacency matrices and along-lane dilation. To capture the complex interactions between actors and maps, we exploit a fusion network consisting of four types of interactions, actor-to-lane, …
