PeSOTIF:一个用于长尾交通场景下感知SOTIF问题的可视化数据集
PeSOTIF: a Challenging Visual Dataset for Perception SOTIF Problems in Long-tail Traffic Scenarios
摘要:
自动驾驶系统中的感知算法在长尾交通场景中面临着巨大的挑战,其中算法性能的不确定性和动态的操作环境可能会引发预期功能安全性(SOTIF)问题。然而,这些场景并没有系统地包含在当前的开源数据集中,本文相应地填补了这一空白。基于触发条件的分析和枚举,发布了高质量的多样化数据集,包括从多个资源收集的各种长尾流量场景。考虑到概率目标检测(POD)的发展,该数据集将可能导致场景中感知SOTIF问题的触发源标记为关键对象。此外,评估协议建议,以验证POD算法的有效性,通过不确定性识别的关键对象。数据集从未停止扩展,第一批开源数据源数据包括1126帧,平均每帧中有2. 27个关键对象和2. 47个正常对象。为了演示如何使用该数据集进行SOTIF研究,本文进一步量化了感知SOTIF熵,以确定场景对于感知系统是否未知和不安全。实验结果表明,量化熵能有效地反映感知算法的失效情况。
英文摘要:
Perception algorithms in autonomous driving systems confront great challenges in long-tail traffic scenarios, where the problems of Safety of the Intended Functionality (SOTIF) could be triggered by the algorithm performance insufficiencies and dynamic operational environment. However, such scenarios are not systematically included in current open-source datasets, and this paper fills the gap accordingly. Based on the analysis and enumeration of trigger conditions, a high-quality diverse dataset is released, including various long-tail traffic scenarios collected from multiple resources. Considering the development of probabilistic object detection (POD), this dataset marks trigger sources that may cause perception SOTIF problems in the scenarios as key objects. In addition, an evaluation protocol is suggested to verify the effectiveness of POD algorithms in identifying the key objects via uncertainty. The dataset never stops expanding, and the first batch of open-source data includes 1126 frames with an average of 2.27 key objects and 2.47 normal objects in each frame. To demonstrate how to use this dataset for SOTIF research, this paper further quantifies the perception SOTIF entropy to confirm whether a scenario is unknown and unsafe for a perception system. The experimental results show that the quantified entropy can effectively and efficiently reflect the failure of the perception algorithm.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。