Reliable detection of various objects and road users in the surrounding environment is crucial for the safe operation of automated driving systems (ADS). Despite recent progresses in developing highly accurate object detectors based on Deep Neural Networks (DNNs), they still remain prone to detection errors, which can lead to fatal consequences in safety-critical applications such as ADS. An effective remedy to this problem is to equip the system with run-time monitoring, named as introspection in the context of autonomous systems. Motivated by this, we introduce a novel introspection solution, which operates at the frame level for DNN-based 2D object detection and leverages neural network activation patterns. The proposed approach pre-processes the neural activation patterns of the object detector's backbone using several different modes. To provide extensive comparative analysis and fair comparison, we also adapt and implement several state-of-the-art (SOTA) introspection mechanisms for error detection in 2D object detection, using one-stage and two-stage object detectors evaluated on KITTI and BDD datasets. We compare the performance of the proposed solution in terms of error detection, adaptability to dataset shift, and, computational and memory resource requirements. Our performance evaluation shows that the proposed introspection solution outperforms SOTA methods, achieving an absolute reduction in the missed error ratio of 9% to 17% in the BDD dataset.
Integrity Monitoring of 3D Object Detection in Automated Driving Systems using Raw Activation Patterns and Spatial Filtering
WMG, University of Warwick(华威大学WMG学院);School of Electronics, Electrical Engineering and Computer Science (EEECS), Queen’s University of Belfast(贝尔法斯特女王大学电子、电气工程与计算机科学学院)
Occluded nuScenes: A Multi-Sensor Dataset for Evaluating Perception Robustness in Automated Driving
University of Limerick(利默里克大学);Data Driven Computer Engineering Research Centre(数据驱动计算机工程研究中心);Lero, The Irish Software Research Centre(Lero爱尔兰软件研究中心);Valeo Vision Systems(Valéo视觉系统);Queen Mary University of London(伦敦女王学院)
Automated Evaluation of Large Vision-Language Models on Self-driving Corner Cases
Hong Kong University of Science and Technology(香港科技大学);Dalian University of Technology(大连理工大学);The Chinese University of Hong Kong(香港中文大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室)
NARRATE: A Multimodal Real-World Australian Driving Dataset for Human-Centred Explanations in Automated Driving
ARC Training Centre for Automated Vehicles in Rural and Remote Regions (AVR3)(澳大利亚农村及偏远地区自动驾驶车辆ARC培训中心);Université Gustave Eiffel(Gustave Eiffel大学);Queensland University of Technology (QUT)(昆士兰科技大学)
An Approach to Systematic Data Acquisition and Data-Driven Simulation for the Safety Testing of Automated Driving Functions
Stuttgart Media University(斯图加特媒体大学);Fraunhofer-Gesellschaft e.V.(弗劳恩霍夫协会);Fraunhofer EMI(弗劳恩霍夫应用信息技术研究所);Fraunhofer IVI(弗劳恩霍夫交通与基础设施系统研究所);Fraunhofer IOSB(弗劳恩霍夫光学、微系统和图像处理研究所);GOTECH GmbH(高泰克有限公司);Technische Universität München(慕尼黑工业大学);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);understandAI GmbH(安代人工智能有限公司);Porsche Engineering Group GmbH(保时捷工程集团有限公司)