arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.07655cs.SEcs.AIcs.LG
收藏

MLAD:一种面向多系统日志异常检测的统一模型

MLAD: A Unified Model for Multi-system Log Anomaly Detection

Renmin University of China(中国人民大学);Beihang University(北京航空航天大学);Cloudwise Research(云智慧研究院)

Runqiang Zang, Hongcheng Guo, Jian Yang, Jiaheng Liu, Zhoujun Li, Tieqiao Zheng, Xu Shi, Liangfan Zheng, Bo Zhang

AI总结:

本文提出统一多系统日志异常检测模型MLAD,利用Sentence-bert语义向量、改进注意力层和高斯混合模型解决“恒等捷径”问题,并在三个真实数据集上验证其优越性。

摘要:

尽管无监督日志异常检测技术取得了快速进展,当前主流模型仍然需要针对各个系统数据集进行专门训练,导致成本高昂,并且由于数据集规模的限制,可扩展性有限,从而造成性能瓶颈。此外,许多模型缺乏认知推理能力,难以直接迁移到相似系统以进行有效的异常检测。同时,与重建网络类似,这些模型经常遇到“恒等捷径”困境,即大多数系统日志被归类为正常,在遇到罕见异常日志时,由于重建误差而错误地预测为正常类别。为了解决上述问题,我们提出了MLAD,这是一种新颖的异常检测模型,融合了跨多个系统的语义关系推理。具体来说,我们采用Sentence-bert来捕获日志序列之间的相似性,并将其转换为高维可学习的语义向量。随后,我们改进了注意力层的公式,以辨别序列中每个关键词的重要性,并通过适当的向量空间扩散来建模多系统数据集的整体分布。最后,我们采用高斯混合模型来突出与“恒等捷径”问题相关的罕见词的不确定性,并使用最大期望模型优化样本的向量空间。在三个真实世界数据集上的实验证明了MLAD的优越性。

英文摘要:

In spite of the rapid advancements in unsupervised log anomaly detection techniques, the current mainstream models still necessitate specific training for individual system datasets, resulting in costly procedures and limited scalability due to dataset size, thereby leading to performance bottlenecks. Furthermore, numerous models lack cognitive reasoning capabilities, posing challenges in direct transferability to similar systems for effective anomaly detection. Additionally, akin to reconstruction networks, these models often encounter the "identical shortcut" predicament, wherein the majority of system logs are classified as normal, erroneously predicting normal classes when confronted with rare anomaly logs due to reconstruction errors. To address the aforementioned issues, we propose MLAD, a novel anomaly detection model that incorporates semantic relational reasoning across multiple systems. Specifically, we employ Sentence-bert to capture the similarities between log sequences and convert them into highly-dimensional learnable semantic vectors. Subsequently, we revamp the formulas of the Attention layer to discern the significance of each keyword in the sequence and model the overall distribution of the multi-system dataset through appropriate vector space diffusion. Lastly, we employ a Gaussian mixture model to highlight the uncertainty of rare words pertaining to the "identical shortcut" problem, optimizing the vector space of the samples using the maximum expectation model. Experiments on three real-world datasets demonstrate the superiority of MLAD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑