arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.12702cs.LGstat.ML
收藏

基于扩展主元特征的改进直方图异常检测器

Improved histogram-based anomaly detector with the extended principal component features

Deakin University(迪肯大学);University of South Dakota(南达科他大学)

Sunil Aryal, Arbind Agrahari Baniya, KC Santosh

摘要:

在这个大数据时代,数据库在记录数量方面正在快速增长。在这些海量数据库中快速自动检测异常记录是一项具有挑战性的任务。传统的基于距离的异常检测器不适用于这些海量数据集。最近,一个简单的,但非常快速的异常检测器,使用一维直方图已经推出。数据实例的异常得分被计算为它所落入的每个维度中的直方图的概率质量的乘积。与许多数据集中的许多最先进的方法相比,它产生了具有竞争力的结果。因为它假设数据特征是相互独立的,所以当特征之间存在相关性时,它会导致检测精度差。为了解决这个问题,我们建议通过添加更多的功能,基于主成分来增加特征的大小。我们的研究结果表明,使用原始输入功能与主成分一起提高了基于直方图的异常检测器的检测精度显着,而不会影响太多的运行时间。

英文摘要:

In this era of big data, databases are growing rapidly in terms of the number of records. Fast automatic detection of anomalous records in these massive databases is a challenging task. Traditional distance based anomaly detectors are not applicable in these massive datasets. Recently, a simple but extremely fast anomaly detector using one-dimensional histograms has been introduced. The anomaly score of a data instance is computed as the product of the probability mass of histograms in each dimensions where it falls into. It is shown to produce competitive results compared to many state-of-the-art methods in many datasets. Because it assumes data features are independent of each other, it results in poor detection accuracy when there is correlation between features. To address this issue, we propose to increase the feature size by adding more features based on principal components. Our results show that using the original input features together with principal components improves the detection accuracy of histogram-based anomaly detector significantly without compromising much in terms of run-time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑