arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.01615cs.LGcs.AIcs.DB
收藏

数据异常的类型

A Typology of Data Anomalies

Ralph Foorthuis

摘要:

异常是在某种程度上不寻常的情况,并且似乎不符合数据集中存在的一般模式。有几种概念可以区分不同类型的异常。然而,这些要么是太具体,一般适用或如此抽象,他们既不提供具体的洞察异常类型的性质,也不促进异常检测算法的功能评估。随着最近对“黑匣子”算法和分析的批评,很明显这是一种不受欢迎的情况。因此,本文介绍了一个一般类型的异常,提供了一个明确的和有形的定义数据集中的不同类型的异常。类型学还有助于评估异常检测算法的功能能力,并作为一个框架,协助分析数据,模式和异常的概念层次。最后,它作为一个分析工具,从其他类型学研究异常类型。

英文摘要:

Anomalies are cases that are in some way unusual and do not appear to fit the general patterns present in the dataset. Several conceptualizations exist to distinguish between different types of anomalies. However, these are either too specific to be generally applicable or so abstract that they neither provide concrete insight into the nature of anomaly types nor facilitate the functional evaluation of anomaly detection algorithms. With the recent criticism on 'black box' algorithms and analytics it has become clear that this is an undesirable situation. This paper therefore introduces a general typology of anomalies that offers a clear and tangible definition of the different types of anomalies in datasets. The typology also facilitates the evaluation of the functional capabilities of anomaly detection algorithms and as a framework assists in analyzing the conceptual levels of data, patterns and anomalies. Finally, it serves as an analytical tool for studying anomaly types from other typologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑