The deployment of autonomous vehicles controlled by machine learning techniques requires extensive testing in diverse real-world environments, robust handling of edge cases and out-of-distribution scenarios, and comprehensive safety validation to ensure that these systems can navigate safely and effectively under unpredictable conditions. Addressing Out-Of-Distribution (OOD) driving scenarios is essential for enhancing safety, as OOD scenarios help validate the reliability of the models within the vehicle's autonomy stack. However, generating OOD scenarios is challenging due to their long-tailed distribution and rarity in urban driving dataset. Recently, Large Language Models (LLMs) have shown promise in autonomous driving, particularly for their zero-shot generalization and common-sense reasoning capabilities. In this paper, we leverage these LLM strengths to introduce a framework for generating diverse OOD driving scenarios. Our approach uses LLMs to construct a branching tree, where each branch represents a unique OOD scenario. These scenarios are then simulated in the CARLA simulator using an automated framework that aligns scene augmentation with the corresponding textual descriptions. We evaluate our framework through extensive simulations, and assess its performance via a diversity metric that measures the richness of the scenarios. Additionally, we introduce a new "OOD-ness" metric, which quantifies how much the generated scenarios deviate from typical urban driving conditions. Furthermore, we explore the capacity of modern Vision-Language Models (VLMs) to interpret and safely navigate through the simulated OOD scenarios. Our findings offer valuable insights into the reliability of language models in addressing OOD scenarios within the context of urban driving.
AdvDiffuser: Generating Adversarial Safety-Critical Driving Scenarios via Guided Diffusion
School of Computer Science and Engineering, Sun Yat-Sen University(中山大学计算机科学与工程学院);School of Computer Science, Wuhan University(武汉大学计算机学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Mechanical and Automotive Engineering, Qingdao University of Technology(青岛理工大学机械与汽车工程学院)
Bridging Data-Driven and Knowledge-Driven Approaches for Safety-Critical Scenario Generation in Automated Vehicle Validation
Research Center of Synkrotron, Inc.(同步辐射公司研究中心);Institute for Interdisciplinary Information Core Technology(跨学科信息核心技术研究所);Academy of Advanced Interdisciplinary Research, Xidian University(西安电子科技大学先进交叉学科研究院)
Controllable Collision Scenario Generation via Collision Pattern Prediction
Department of Computer Science, National Yang Ming Chiao Tung University(国立阳明交通大学计算机科学系);School of Informatics, Computing, and Engineering, Indiana University(印第安纳大学信息科学与工程学院);MediaTek Inc.(联发科公司)
CountARFactuals -- Generating plausible model-agnostic counterfactual explanations with adversarial random forests
Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);LMU Munich(慕尼黑大学);Leibniz Institute for Prevention Research & Epidemiology – BIPS(莱布尼茨预防研究与流行病学研究所);University of Bremen(不来梅大学);University of Tübingen(蒂宾根大学);University of Copenhagen(哥本哈根大学)
LD-Scene: LLM-Guided Diffusion for Controllable Generation of Adversarial Safety-Critical Driving Scenarios
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院)
Reinforcement Learning for Testing Interdependent Requirements in Autonomous Vehicles: An Empirical Study
Simula Research Laboratory and University of Oslo(Simula研究实验室和奥斯陆大学);Mondragon University(蒙dragon大学);Simula Research Laboratory(Simula研究实验室);University of Oslo(奥斯陆大学)