arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2010.04705cs.LGcs.DBstat.ML
收藏

探测高密度异常的数学框架

Algorithmic Frameworks for the Detection of High Density Anomalies

HEINEKEN(喜力)

Ralph Foorthuis

摘要:

本研究探讨了高密度异常的概念。与孤立出现的异常的传统概念相反,高密度异常是位于数据空间的最正常区域中的异常情况。这些异常与各种实际用例相关,例如不当行为检测和数据质量分析。当分析非常大或有噪声的集合时,识别它们的有效方法特别重要,因为传统的异常检测算法会返回许多误报。为了能够识别高密度异常,本研究介绍了几种非参数算法框架的无监督检测。这些框架能够利用现有的底层异常检测算法,并为该检测任务中固有的平衡问题提供不同的解决方案。该框架与合成和真实世界的数据集进行评估,并与现有的基线算法检测传统的异常进行比较。迭代部分推送(IPP)框架被证明可以产生最佳的检测结果。

英文摘要:

This study explores the concept of high-density anomalies. As opposed to the traditional concept of anomalies as isolated occurrences, high-density anomalies are deviant cases positioned in the most normal regions of the data space. Such anomalies are relevant for various practical use cases, such as misbehavior detection and data quality analysis. Effective methods for identifying them are particularly important when analyzing very large or noisy sets, for which traditional anomaly detection algorithms will return many false positives. In order to be able to identify high-density anomalies, this study introduces several non-parametric algorithmic frameworks for unsupervised detection. These frameworks are able to leverage existing underlying anomaly detection algorithms and offer different solutions for the balancing problem inherent in this detection task. The frameworks are evaluated with both synthetic and real-world datasets, and are compared with existing baseline algorithms for detecting traditional anomalies. The Iterative Partial Push (IPP) framework proves to yield the best detection results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑