基于最小描述长度聚类的异构数据分类异常检测
Categorical anomaly detection in heterogeneous data using minimum description length clustering
摘要:
基于最小描述长度(MDL)原则,针对分类数据提出了快速有效的无监督异常检测算法。然而,当检测表示不同来源的混合物的异构数据集中的异常时,它们可能是无效的,例如系统和用户进程具有不同行为模式的安全场景。我们提出了一种元算法,用于增强任何基于MDL的异常检测模型,通过将混合模型拟合到数据中来处理异构数据,通过k-均值聚类的变体。我们的实验结果表明,使用离散混合模型提供了竞争力的性能相对于以前的两个异常检测算法,而更复杂的模型的混合物产生进一步的收益,从安全场景的合成数据集和现实的数据集。
英文摘要:
Fast and effective unsupervised anomaly detection algorithms have been proposed for categorical data based on the minimum description length (MDL) principle. However, they can be ineffective when detecting anomalies in heterogeneous datasets representing a mixture of different sources, such as security scenarios in which system and user processes have distinct behavior patterns. We propose a meta-algorithm for enhancing any MDL-based anomaly detection model to deal with heterogeneous data by fitting a mixture model to the data, via a variant of k-means clustering. Our experimental results show that using a discrete mixture model provides competitive performance relative to two previous anomaly detection algorithms, while mixtures of more sophisticated models yield further gains, on both synthetic datasets and realistic datasets from a security scenario.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。