arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2008.06869cs.DBcs.AIcs.LGstat.OT
收藏

SECODA:基于分割和组合的异常检测

SECODA: Segmentation- and Combination-Based Detection of Anomalies

UWV(荷兰乌得勒支工作与收入机构)

Ralph Foorthuis

摘要:

本研究介绍SECODA,一种新的通用无监督非参数异常检测算法的数据集包含连续和分类属性。该方法保证识别具有唯一或稀疏属性值组合的情况。连续属性被反复离散化,以便正确确定这种值组合的频率。星座的概念,指数增长的权重和离散化切割点,以及修剪启发式的最佳迭代次数来检测异常。此外,该算法具有较低的内存印记,其运行时性能与数据集的大小呈线性关系。模拟和真实数据集的评估表明,该算法能够识别许多不同类型的异常,包括复杂的多维实例。对一个真实数据集的数据质量用例的评估表明,SECODA可以为现实世界的设置带来相关和实用的价值。

英文摘要:

This study introduces SECODA, a novel general-purpose unsupervised non-parametric anomaly detection algorithm for datasets containing continuous and categorical attributes. The method is guaranteed to identify cases with unique or sparse combinations of attribute values. Continuous attributes are discretized repeatedly in order to correctly determine the frequency of such value combinations. The concept of constellations, exponentially increasing weights and discretization cut points, as well as a pruning heuristic are used to detect anomalies with an optimal number of iterations. Moreover, the algorithm has a low memory imprint and its runtime performance scales linearly with the size of the dataset. An evaluation with simulated and real-life datasets shows that this algorithm is able to identify many different types of anomalies, including complex multidimensional instances. An evaluation in terms of a data quality use case with a real dataset demonstrates that SECODA can bring relevant and practical value to real-world settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑