Cooperative Adaptive Cruise Control (CACC) represents a quintessential control strategy for orchestrating vehicular platoon movement within Connected and Automated Vehicle (CAV) systems, significantly enhancing traffic efficiency and reducing energy consumption. In recent years, the data-driven methods, such as reinforcement learning (RL), have been employed to address this task due to their significant advantages in terms of efficiency and flexibility. However, the delay issue, which often arises in real-world CACC systems, is rarely taken into account by current RL-based approaches. To tackle this problem, we propose a Delay-Aware Multi-Agent Reinforcement Learning (DAMARL) framework aimed at achieving safe and stable control for CACC. We model the entire decision-making process using a Multi-Agent Delay-Aware Markov Decision Process (MADA-MDP) and develop a centralized training with decentralized execution (CTDE) MARL framework for distributed control of CACC platoons. An attention mechanism-integrated policy network is introduced to enhance the performance of CAV communication and decision-making. Additionally, a velocity optimization model-based action filter is incorporated to further ensure the stability of the platoon. Experimental results across various delay conditions and platoon sizes demonstrate that our approach consistently outperforms baseline methods in terms of platoon safety, stability and overall performance.
Gaussian Process based Stochastic Model Predictive Control for Cooperative Adaptive Cruise Control
School of Electrical & Computer Engineering, Univ. of Georgia(佐治亚大学电气与计算机工程学院);Dept. of Electrical & Computer Engineering, Univ. of Central Florida(中佛罗里达大学电气与计算机工程系)
AuNa: Modularly Integrated Simulation Framework for Cooperative Autonomous Navigation
TU Dortmund University(多特蒙德工业大学);TU Eindhoven(埃因霍温理工大学);Technische Hochschule Ingolstadt(英戈尔施塔特应用技术大学);Polytechnic Institute of Porto(波尔图理工学院);University of Twente(特温特大学)
Experimentally-Driven Analysis of Stability in Connected Vehicle Platooning: Insights and Control Strategies
Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University(艾尔沃大学电气工程与自动化系);Department of Electrical and Computer Engineering, School of Engineering, University of Cyprus(塞浦路斯大学电气与计算机工程系);FinEst Centre for Smart Cities, Tallinn, Estonia(爱沙尼亚塔林智能城市中心)