在自动驾驶系统中，除了摄像头、雷达等用于感知车辆外部环境的环境感知传感器外，实际上还有一种感知传感器一直在系统中默默发挥作用，那就是定位模块。本文探讨了SLAM（Simultaneous Localization and Mapping，同步定位与地图构建）技术在自动驾驶车辆自动换道行为预测和环境感知场景中的应用。文中讨论了传统定位方法的局限性，介绍了SLAM技术，并对LIDAR SLAM与视觉SLAM进行了比较。来自Tesla、Waymo和Mobileye等公司的真实案例展示了AI驱动技术、传感器融合与SLAM在自动驾驶系统中的集成。随后，论文深入分析了SLAM算法、传感器技术的具体内容，以及自动换道在驾驶安全性和效率方面的重要性。文中重点介绍了Tesla最近对其Autopilot系统的更新，该系统利用SLAM技术加入了自动换道功能。论文最后强调，SLAM在使自动驾驶车辆实现准确的环境感知、定位和决策方面发挥着关键作用，最终提升安全性和驾驶体验。
英文摘要：
In addition to environmental perception sensors such as cameras, radars, etc. in the automatic driving system, the external environment of the vehicle is perceived, in fact, there is also a perception sensor that has been silently dedicated in the system, that is, the positioning module. This paper explores the application of SLAM (Simultaneous Localization and Mapping) technology in the context of automatic lane change behavior prediction and environment perception for autonomous vehicles. It discusses the limitations of traditional positioning methods, introduces SLAM technology, and compares LIDAR SLAM with visual SLAM. Real-world examples from companies like Tesla, Waymo, and Mobileye showcase the integration of AI-driven technologies, sensor fusion, and SLAM in autonomous driving systems. The paper then delves into the specifics of SLAM algorithms, sensor technologies, and the importance of automatic lane changes in driving safety and efficiency. It highlights Tesla's recent update to its Autopilot system, which incorporates automatic lane change functionality using SLAM technology. The paper concludes by emphasizing the crucial role of SLAM in enabling accurate environment perception, positioning, and decision-making for autonomous vehicles, ultimately enhancing safety and driving experience.
College of Information Science and Engineering, Ritsumeikan University（立命馆大学信息科学与工程学院）；Ritsumeikan Global Innovation Research Organization, Ritsumeikan University（立命馆大学全球创新研究机构）
Using the spatial structure of various indoor environments as prior knowledge, the robot would construct the map more efficiently. Autonomous mobile robots generally apply simultaneous localization and mapping (SLAM) methods to understand the reachable area in newly visited environments. However, conventional mapping approaches are limited by only considering sensor observation and control signals to estimate the current environment map. This paper proposes a novel SLAM method, map completion network-based SLAM (MCN-SLAM), based on a probabilistic generative model incorporating deep neural net…
Structure from Motion (SfM) techniques are being increasingly used to create 3D maps from images in many domains including environmental monitoring. However, SfM techniques are often confounded in visually repetitive environments as they rely primarily on globally distinct image features. Simultaneous Localization and Mapping (SLAM) techniques offer a potential solution in visually repetitive environments since they use local feature matching, but SLAM approaches work best with wide-angle cameras that are often unsuitable for documenting the environmental system of interest. We resolve this is…
This paper proposes an A*SLAM system that features combining two sets of fisheye stereo cameras and taking the image edge as the SLAM features. The dual fisheye stereo camera sets cover the full environmental view of the SLAM system. From each fisheye stereo image pair, a panorama depth image can be directly extracted for initializing the SLAM feature. The edge feature is an illumination invariant feature. The paper presents a method of the edge-based simultaneous localization and mapping process using both the normal and inverted images interchangeably.
American University of Beirut（贝鲁特美国大学）；University of Waterloo（滑铁卢大学）
Extensive research in the field of monocular SLAM for the past fifteen years has yielded workable systems that found their way into various applications in robotics and augmented reality. Although filter-based monocular SLAM systems were common at some time, the more efficient keyframe-based solutions are becoming the de facto methodology for building a monocular SLAM system. The objective of this paper is threefold: first, the paper serves as a guideline for people seeking to design their own monocular SLAM according to specific environmental constraints. Second, it presents a survey that cov…
Massachusetts Institute of Technology（麻省理工学院）；Laboratory for Information and Decision Systems（信息与决策系统实验室）；Computer Science and Artificial Intelligence Laboratory（计算机科学与人工智能实验室）
Simultaneous localization and mapping (SLAM) is the process of constructing a global model of an environment from local observations of it; this is a foundational capability for mobile robots, supporting such core functions as planning, navigation, and control. This article reviews recent progress in SLAM, focusing on advances in the expressive capacity of the environmental models used in SLAM systems (representation) and the performance of the algorithms used to estimate these models from data (inference). A prominent theme of recent SLAM research is the pursuit of environmental representatio…
Institute for Intelligent Systems, Esslingen University of Applied Sciences（智能系统研究所，埃斯林根应用科学大学）；Department of Computer Science, University of Freiburg（计算机科学系，弗赖堡大学）；ANDREAS STIHL AG & Co. KG（安德烈亚斯·施塔尔有限公司）
Despite the growing interest for autonomous environmental monitoring, effective SLAM realization in native habitats remains largely unsolved. In this paper, we fill this gap by presenting a novel online graph-based SLAM system for 2D LiDAR sensor in natural environments. By taking advantage of robust weighting scheme, sliding-windowed optimization, fast scan-matcher and parallel computing, our system not only delivers stable performance in cluttered surroudings but also meets real-time constraint. Simulated and experimental results confirm the feasibility and efficiency in the overall design o…
FR-SLAM: A SLAM Improvement Method Based on Floor Plan Registration
Suzhou Campus Southeast University（东南大学苏州校区）；Nanjing center for applied mathematics（南京应用数学中心）；School of Automation（自动化学院）；School of Cyber Science and Engineering（网络科学与工程学院）；Shenzhen Research Institute Southeast University（东南大学深圳研究院）；Samsung Electronics（三星电子）；Samsung Electronics(China) R&D Center（三星电子（中国）研发中心）
Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Peking University（北京大学）；University of Birmingham（伯明翰大学）；Robert Bosch GmbH（罗伯特·博世有限公司）；University of California, Berkeley（加州大学伯克利分校）
The current optimization approaches of construction machinery are mainly based on internal sensors. However, the decision of a reasonable strategy is not only determined by its intrinsic signals, but also very strongly by environmental information, especially the terrain. Due to the dynamically changing of the construction site and the consequent absence of a high definition map, the Simultaneous Localization and Mapping (SLAM) offering the terrain information for construction machines is still challenging. Current SLAM technologies proposed for mobile machines are strongly dependent on costly…
Robust and lane-level positioning is essential for autonomous vehicles. As an irreplaceable sensor, LiDAR can provide continuous and high-frequency pose estimation by means of mapping, on condition that enough environment features are available. The error of mapping can accumulate over time. Therefore, LiDAR is usually integrated with other sensors. In diverse urban scenarios, the environment feature availability relies heavily on the traffic (moving and static objects) and the degree of urbanization. Common LiDAR-based SLAM demonstrations tend to be studied in light traffic and less urbanized…
PAS-SLAM: A Visual SLAM System for Planar Ambiguous Scenes
School of Electronic Information and Electrical Engineering, Dalian University of Technology（大连理工大学电子信息与电气工程学部）；Department of Automation, Tsinghua University（清华大学自动化系）；School of Electronic and Computer Engineering, Peking University（北京大学电子与计算机工程学院）；College of Information Science and Engineering, Northeastern University（东北大学信息科学与工程学院）
A reliable pose estimator robust to environmental disturbances is desirable for mobile robots. To this end, inertial measurement units (IMUs) play an important role because they can perceive the full motion state of the vehicle independently. However, it suffers from accumulative error due to inherent noise and bias instability, especially for low-cost sensors. In our previous studies on Wheel-INS \cite{niu2021, wu2021}, we proposed to limit the error drift of the pure inertial navigation system (INS) by mounting an IMU to the wheel of the robot to take advantage of rotation modulation. Howeve…
Imperial College（帝国理工学院）；The Univ. of Edinburgh（爱丁堡大学）；Univ. of Manchester（曼彻斯特大学）
Real-time dense computer vision and SLAM offer great potential for a new level of scene modelling, tracking and real environmental interaction for many types of robot, but their high computational requirements mean that use on mass market embedded platforms is challenging. Meanwhile, trends in low-cost, low-power processing are towards massive parallelism and heterogeneity, making it difficult for robotics and vision researchers to implement their algorithms in a performance-portable way. In this paper we introduce SLAMBench, a publicly-available software framework which represents a starting …
A robust and efficient Simultaneous Localization and Mapping (SLAM) system is essential for robot autonomy. For visual SLAM algorithms, though the theoretical framework has been well established for most aspects, feature extraction and association is still empirically designed in most cases, and can be vulnerable in complex environments. This paper shows that feature extraction with deep convolutional neural networks (CNNs) can be seamlessly incorporated into a modern SLAM framework. The proposed SLAM system utilizes a state-of-the-art CNN to detect keypoints in each image frame, and to give n…
A Simultaneous Localization and Mapping (SLAM) system must be robust to support long-term mobile vehicle and robot applications. However, camera and LiDAR based SLAM systems can be fragile when facing challenging illumination or weather conditions which degrade their imagery and point cloud data. Radar, whose operating electromagnetic spectrum is less affected by environmental changes, is promising although its distinct sensing geometry and noise characteristics bring open challenges when being exploited for SLAM. % However, there are still open challenges since most existing visual and LiDAR …
Institute for Intelligent Systems, Esslingen University of Applied Sciences（埃斯林根应用科学大学智能系统研究所）；Department of Computer Science, University of Freiburg（弗莱堡大学计算机科学系）
Accurately forecasting the future movements of surrounding vehicles is essential for safe and efficient operations of autonomous driving cars. This task is difficult because a vehicle's moving trajectory is greatly determined by its driver's intention, which is often hard to estimate. By leveraging attention mechanisms along with long short-term memory (LSTM) networks, this work learns the relation between a driver's intention and the vehicle's changing positions relative to road infrastructures, and uses it to guide the prediction. Different from other state-of-the-art solutions, our work tre…
Lane detection is one of the indispensable and key elements of self-driving environmental perception. Many lane detection models have been proposed, solving lane detection under challenging conditions, including intersection merging and splitting, curves, boundaries, occlusions and combinations of scene types. Nevertheless, lane detection will remain an open problem for some time to come. The ability to cope well with those challenging scenes impacts greatly the applications of lane detection on advanced driver assistance systems (ADASs). In this paper, a spatio-temporal network with double Co…
Fudan University（复旦大学）；FAW (Nanjing) Technology Development Co.,Ltd（一汽（南京）科技开发有限公司）
Automatic underground parking has attracted considerable attention as the scope of autonomous driving expands. The auto-vehicle is supposed to obtain the environmental information, track its location, and build a reliable map of the scenario. Mainstream solutions consist of well-trained neural networks and simultaneous localization and mapping (SLAM) methods, which need numerous carefully labeled images and multiple sensor estimations. However, there is a lack of underground parking scenario datasets with multiple sensors and well-labeled images that support both SLAM tasks and perception task…
SKiD-SLAM: Robust, Lightweight, and Distributed Multi-Robot LiDAR SLAM in Resource-Constrained Field Environments
Dept. Electr. and Comput. Eng.（电子与计算机工程系）；Inha University（inha大学）；Laboratory for Information & Decision Systems (LIDS)（信息与决策系统实验室）；Massachusetts Institute of Technology（麻省理工学院）
Hunan University（湖南大学）；University of Alberta（阿尔伯塔大学）；Southern University of Science and Technology（南方科技大学）；Shaanxi Normal University（陕西师范大学）；The University of Western Australia（西澳大学）
Indirect methods for visual SLAM are gaining popularity due to their robustness to environmental variations. ORB-SLAM2 \cite{orbslam2} is a benchmark method in this domain, however, it consumes significant time for computing descriptors that never get reused unless a frame is selected as a keyframe. To overcome these problems, we present FastORB-SLAM which is lightweight and efficient as it tracks keypoints between adjacent frames without computing descriptors. To achieve this, a two-stage coarse-to-fine descriptor independent keypoint matching method is proposed based on sparse optical flow. …
Leibniz University Hannover（汉诺威莱布尼茨大学）；Université de Sherbrooke（舍布鲁克大学）
This work presents an extension of graph-based SLAM methods to exploit the potential of 3D laser scans for loop detection. Every high-dimensional point cloud is replaced by a compact global descriptor, whereby a trained detector decides whether a loop exists. Searching for loops is performed locally in a variable space to consider the odometry drift. Since closing a wrong loop has fatal consequences, an extensive verification is performed before acceptance. The proposed algorithm is implemented as an extension of the widely used state-of-the-art library RTAB-Map, and several experiments show t…
A Sensor-Aware Phenomenological Framework for Lidar Degradation Simulation and SLAM Robustness Evaluation
Turku Intelligent Embedded and Robotic Systems (TIERS) Lab , University of Turku（图尔库智能嵌入与机器人系统实验室，图尔库大学）；School of Information Science and Technology, Fudan University（信息科学与技术学院，复旦大学）
AutoLoop: Fast Visual SLAM Fine-tuning through Agentic Curriculum Learning
University of Haifa（海法大学）；Leon H. Charney School of Marine Sciences（莱昂·H·查尼海洋科学学院）；Hatter Department of Marine Technologies（哈特海洋技术系）；Swarm & AI Lab (SAIL)（群体与人工智能实验室（SAIL））
Electric vhicles and autonomous driving dominate current research efforts in the automotive sector. The two topics go hand in hand in terms of enabling safer and more environmentally friendly driving. One fundamental building block of an autonomous vehicle is the ability to build a map of the environment and localize itself on such a map. In this paper, we make use of a stereo camera sensor in order to perceive the environment and create the map. With live Simultaneous Localization and Mapping (SLAM), there is a risk of mislocalization, since no ground truth map is used as a reference and erro…
Visual perception plays an important role in autonomous driving. One of the primary tasks is object detection and identification. Since the vision sensor is rich in color and texture information, it can quickly and accurately identify various road information. The commonly used technique is based on extracting and calculating various features of the image. The recent development of deep learning-based method has better reliability and processing speed and has a greater advantage in recognizing complex elements. For depth estimation, vision sensor is also used for ranging due to their small siz…
Leveraging Semantic Graphs for Efficient and Robust LiDAR SLAM
College of Intelligence Science and Technology and the National Key Laboratory of Equipment State Sensing and Smart Support, National University of Defense Technology, China（智能科学与技术学院和装备状态感知与智能支撑国家重点实验室，国防科技大学，中国）；T Stone Robotics Institute and Department of Mechanical and Automation Engineering, the Chinese University of Hong Kong, China（石墨机器人研究院和机械与自动化工程系，香港中文大学，中国）
Investigation of the Challenges of Underwater-Visual-Monocular-SLAM
Oceanic Machine Vision, GEOMAR Helmholtz Centre for Ocean Research Kiel（海洋机器视觉，基尔海洋研究所）；Marine Data Science, Department of Computer Science, Christian-Albrechts-Universität zu Kiel（海洋数据科学，计算机科学系，基尔亚历山大-冯-洪堡大学）；Computer Vision and Robotics Research Institute (VICOROB), University of Girona（计算机视觉与机器人研究 institute（VICOROB），加泰罗尼亚大学）
Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving
University of Southern California（南加州大学）；Virginia Tech（弗吉尼亚理工大学）；Miami University（迈阿密大学）；Northern Arizona University（北亚利桑那大学）；Northeastern University（东北大学）
SMapper: A Multi-Modal Data Acquisition Platform for SLAM Benchmarking
Automation and Robotics Research Group (ARG), Interdisciplinary Centre for Security, Reliability, and Trust (SnT), University of Luxembourg（卢森堡大学自动化与机器人研究组（ARG）、安全、可靠与信任跨学科研究中心（SnT））
FusionPortableV2: A Unified Multi-Sensor Dataset for Generalized SLAM Across Diverse Platforms and Scalable Environments
The Hong Kong University of Science and Technology（香港科技大学）；University College London（伦敦大学学院）；Southern University of Science and Technology（南方科技大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））
