arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.13869cs.LGcs.AI
收藏

准确预测智能系统安全关键稀有事件的概率

Accurately Predicting Probabilities of Safety-Critical Rare Events for Intelligent Systems

Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心(BNRist))

Ruoxuan Bai, Jingxuan Yang, Weiduo Gong, Yi Zhang, Qiujing Lu, Shuo Feng

AI总结:

针对智能系统中安全关键稀有事件导致的极端数据不平衡问题,提出多阶段学习框架以逐步稠密化数据集,在月球着陆器和双足步行者场景中实现了更准确可靠的临界性概率预测。

摘要:

智能系统正日益成为我们日常生活中不可或缺的一部分,但安全关键稀有事件对其实际部署构成了重大潜在威胁。应对这一挑战的关键在于,根据当前状态准确预测在给定时间步内发生安全关键事件的概率,我们将这一度量定义为“临界性”。预测临界性的复杂性源于:与稀有事件相关的高维变量中,稀有事件导致了极端的数据不平衡,我们将这一挑战称为稀有性诅咒。现有方法往往要么过于保守,要么容易忽略安全关键事件,因此难以同时实现高精确率和高召回率,这严重限制了其适用性。本研究致力于开发一种在精确率和召回率方面均表现优异的临界性预测模型,用于评估安全关键自主系统的临界性。我们提出了一种多阶段学习框架,旨在逐步使数据集稠密化,从而跨阶段缓解稀有性诅咒。为验证该方法,我们在两种情形中进行评估:月球着陆器和双足步行者场景。结果表明,我们的方法优于传统方法,可为智能系统的临界性提供更准确、可靠的评估。

英文摘要:

Intelligent systems are increasingly integral to our daily lives, yet rare safety-critical events present significant latent threats to their practical deployment. Addressing this challenge hinges on accurately predicting the probability of safety-critical events occurring within a given time step from the current state, a metric we define as 'criticality'. The complexity of predicting criticality arises from the extreme data imbalance caused by rare events in high dimensional variables associated with the rare events, a challenge we refer to as the curse of rarity. Existing methods tend to be either overly conservative or prone to overlooking safety-critical events, thus struggling to achieve both high precision and recall rates, which severely limits their applicability. This study endeavors to develop a criticality prediction model that excels in both precision and recall rates for evaluating the criticality of safety-critical autonomous systems. We propose a multi-stage learning framework designed to progressively densify the dataset, mitigating the curse of rarity across stages. To validate our approach, we evaluate it in two cases: lunar lander and bipedal walker scenarios. The results demonstrate that our method surpasses traditional approaches, providing a more accurate and dependable assessment of criticality in intelligent systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑