arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.06261cs.LGcs.AIcs.DB
收藏

可解释的离群值摘要

Interpretable Outlier Summarization

University of California, San Diego(加州大学圣地亚哥分校);Massachusetts Institute of Technology(麻省理工学院);Worcester Polytechnic Institute(伍斯特理工学院)

Yu Wang, Lei Cao, Yizhou Yan, Samuel Madden

AI总结:

提出STAIR及局部化变体L-STAIR,通过优化目标生成低复杂度规则集,以可解释方式总结离群值检测结果,显著降低规则复杂度,便于人类理解。

摘要:

离群值检测在现实应用中至关重要,用于防止金融欺诈、防御网络入侵或检测即将发生的设备故障。为了减少评估离群值检测结果所需的人力,并有效地将离群值转化为可操作的见解,用户通常期望系统能够自动生成对离群值检测结果子组的可解释摘要。遗憾的是,迄今为止尚无此类系统。为填补这一空白,我们提出了STAIR,它学习一组紧凑且人类可理解的规则来总结和解释异常检测结果。与使用经典决策树算法生成这些规则不同,STAIR提出了一种新的优化目标,以生成数量少且复杂度最低的规则,从而具有强可解释性,并准确总结检测结果。STAIR的学习算法通过迭代拆分大型规则来生成规则集,并在每次迭代中最大化该目标。此外,为了有效处理难以用简单规则总结的高维、高度复杂的数据集,我们提出了一种局部化的STAIR方法,称为L-STAIR。它考虑数据局部性,同时划分数据并为每个划分学习一组局部规则。我们在许多离群值基准数据集上的实验研究表明,与决策树方法相比,STAIR显著降低了总结离群值检测结果所需规则的复杂度,从而更便于人类理解和评估。

英文摘要:

Outlier detection is critical in real applications to prevent financial fraud, defend network intrusions, or detecting imminent device failures. To reduce the human effort in evaluating outlier detection results and effectively turn the outliers into actionable insights, the users often expect a system to automatically produce interpretable summarizations of subgroups of outlier detection results. Unfortunately, to date no such systems exist. To fill this gap, we propose STAIR which learns a compact set of human understandable rules to summarize and explain the anomaly detection results. Rather than use the classical decision tree algorithms to produce these rules, STAIR proposes a new optimization objective to produce a small number of rules with least complexity, hence strong interpretability, to accurately summarize the detection results. The learning algorithm of STAIR produces a rule set by iteratively splitting the large rules and is optimal in maximizing this objective in each iteration. Moreover, to effectively handle high dimensional, highly complex data sets which are hard to summarize with simple rules, we propose a localized STAIR approach, called L-STAIR. Taking data locality into consideration, it simultaneously partitions data and learns a set of localized rules for each partition. Our experimental study on many outlier benchmark datasets shows that STAIR significantly reduces the complexity of the rules required to summarize the outlier detection results, thus more amenable for humans to understand and evaluate, compared to the decision tree methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑