arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1503.00038cs.AIcs.LGstat.ML
收藏

用于异常检测的序贯特征提取

Sequential Feature Explanations for Anomaly Detection

Oregon State University(俄勒冈州立大学)

Md Amran Siddiqui, Alan Fern, Thomas G. Dietterich, Weng-Keen Wong

摘要:

在许多应用中,异常检测系统将最异常的数据实例呈现给人类分析师,然后人类分析师必须确定该实例是否真正感兴趣(例如,安全设置中的威胁)。不幸的是,大多数异常检测器都没有解释为什么一个实例被认为是异常的,这使得分析师无法指导从哪里开始调查。为了解决这个问题,我们研究了计算和评估异常检测器的序列特征解释(SFE)的问题。异常的SFE是一系列特征,这些特征一次一个地(按顺序)呈现给分析员,直到突出显示的特征中包含的信息足以让分析员对异常做出有信心的判断。由于分析师的努力与他们在调查中考虑的信息量有关,因此解释的质量与必须揭示以获得信心的特征的数量有关。我们的主要贡献之一是提出了一个新的框架,大规模的定量评估的SFE,质量措施是基于分析师的努力。为此,我们根据真实数据集以及可以模拟进行评估的人工专家构建异常检测基准。我们的第二个贡献是评估框架内的几种新的解释方法和传统的异常检测基准,提供了一些见解的方法。

英文摘要:

In many applications, an anomaly detection system presents the most anomalous data instance to a human analyst, who then must determine whether the instance is truly of interest (e.g. a threat in a security setting). Unfortunately, most anomaly detectors provide no explanation about why an instance was considered anomalous, leaving the analyst with no guidance about where to begin the investigation. To address this issue, we study the problems of computing and evaluating sequential feature explanations (SFEs) for anomaly detectors. An SFE of an anomaly is a sequence of features, which are presented to the analyst one at a time (in order) until the information contained in the highlighted features is enough for the analyst to make a confident judgement about the anomaly. Since analyst effort is related to the amount of information that they consider in an investigation, an explanation's quality is related to the number of features that must be revealed to attain confidence. One of our main contributions is to present a novel framework for large scale quantitative evaluations of SFEs, where the quality measure is based on analyst effort. To do this we construct anomaly detection benchmarks from real data sets along with artificial experts that can be simulated for evaluation. Our second contribution is to evaluate several novel explanation approaches within the framework and on traditional anomaly detection benchmarks, offering several insights into the approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑