arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.07685cs.CVcs.AIcs.RO
收藏

基于早期层神经激活模式的自动驾驶系统3D目标检测运行时监控

Run-time Monitoring of 3D Object Detection in Automated Driving Systems Using Early Layer Neural Activation Patterns

WMG, University of Warwick(华威大学WMG学院)

Hakan Yekta Yatbaz, Mehrdad Dianati, Konstantinos Koufos, Roger Woodman

AI总结:

针对自动驾驶3D目标检测完整性监控的现有不足,研究不同层激活模式的作用,发现早期层可提升检测性能但增加复杂度,进而提出多层激活结合的实时自省方法。

摘要:

监控自动驾驶系统(ADS)感知模块中目标检测的完整性以排查错误,对保障安全至关重要。尽管基于深度神经网络(DNN)的目标检测器近期取得了进展,但它们易受检测错误影响的问题,尤其是在研究较少的3D目标检测领域,仍是重大隐患。当前2D目标检测领域的前沿完整性监控(也称为自省)机制主要利用基于DNN的检测器主干网络最后一层的激活模式,但这可能不足以应对3D目标检测中数据的复杂性和稀疏性。为此,本文对从主干网络不同层提取的激活模式在3D目标检测器运行自省中的作用开展了广泛研究。通过使用Kitti和NuScenes数据集,结合PointPillars和CenterPoint检测器进行对比分析,我们证明使用更早层的激活模式可提升完整性监控系统的错误检测性能,但会增加计算复杂度。为满足ADS的实时运行需求,我们还提出了一种结合检测器主干网络多层激活模式的新型自省方法,并报告了其性能。

英文摘要:

Monitoring the integrity of object detection for errors within the perception module of automated driving systems (ADS) is paramount for ensuring safety. Despite recent advancements in deep neural network (DNN)-based object detectors, their susceptibility to detection errors, particularly in the less-explored realm of 3D object detection, remains a significant concern. State-of-the-art integrity monitoring (also known as introspection) mechanisms in 2D object detection mainly utilise the activation patterns in the final layer of the DNN-based detector's backbone. However, that may not sufficiently address the complexities and sparsity of data in 3D object detection. To this end, we conduct, in this article, an extensive investigation into the effects of activation patterns extracted from various layers of the backbone network for introspecting the operation of 3D object detectors. Through a comparative analysis using Kitti and NuScenes datasets with PointPillars and CenterPoint detectors, we demonstrate that using earlier layers' activation patterns enhances the error detection performance of the integrity monitoring system, yet increases computational complexity. To address the real-time operation requirements in ADS, we also introduce a novel introspection method that combines activation patterns from multiple layers of the detector's backbone and report its performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑