arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.00527cs.SEcs.AIcs.LG
收藏

基于图神经网络的日志异常检测与解释

Graph Neural Networks based Log Anomaly Detection and Explanation

Leiden University(莱顿大学)

Zhong Li, Jiayang Shi, Matthijs van Leeuwen

AI总结:

提出 Logs2Graphs 与 OCDiGCN,将事件日志构建为带属性有向加权图并进行无监督图级异常检测,同时给出关键节点解释,在五个基准上性能优异。

摘要:

事件日志被广泛用于记录高科技系统的状态,因此日志异常检测对于监控这些系统十分重要。现有的大多数日志异常检测方法以日志事件计数矩阵或日志事件序列作为输入,利用日志事件之间的数量关系和/或顺序关系来检测异常。遗憾的是,仅考虑数量关系或顺序关系可能导致检测准确率较低。为缓解这一问题,我们提出了一种基于图的无监督日志异常检测方法,称为 Logs2Graphs。该方法首先将事件日志转换为带属性、有向且加权的图,然后利用图神经网络执行图级异常检测。具体而言,我们提出了 One-Class Digraph Inception Convolutional Networks,缩写为 OCDiGCN,这是一种新颖的图神经网络模型,用于在带属性、有向且加权的图集合中检测图级异常。通过将图表示与异常检测步骤耦合,OCDiGCN 能够学习特别适合异常检测的表示,从而获得较高的检测准确率。重要的是,对于每个识别出的异常,我们还提供一小部分在 OCDiGCN 预测中起关键作用的节点作为解释,这些节点能够为后续的根因诊断提供有价值的线索。在五个基准数据集上的实验表明,Logs2Graphs 在简单数据集上的表现至少与最先进的日志异常检测方法相当,而在复杂数据集上则大幅优于最先进的日志异常检测方法。

英文摘要:

Event logs are widely used to record the status of high-tech systems, making log anomaly detection important for monitoring those systems. Most existing log anomaly detection methods take a log event count matrix or log event sequences as input, exploiting quantitative and/or sequential relationships between log events to detect anomalies. Unfortunately, only considering quantitative or sequential relationships may result in low detection accuracy. To alleviate this problem, we propose a graph-based method for unsupervised log anomaly detection, dubbed Logs2Graphs, which first converts event logs into attributed, directed, and weighted graphs, and then leverages graph neural networks to perform graph-level anomaly detection. Specifically, we introduce One-Class Digraph Inception Convolutional Networks, abbreviated as OCDiGCN, a novel graph neural network model for detecting graph-level anomalies in a collection of attributed, directed, and weighted graphs. By coupling the graph representation and anomaly detection steps, OCDiGCN can learn a representation that is especially suited for anomaly detection, resulting in a high detection accuracy. Importantly, for each identified anomaly, we additionally provide a small subset of nodes that play a crucial role in OCDiGCN's prediction as explanations, which can offer valuable cues for subsequent root cause diagnosis. Experiments on five benchmark datasets show that Logs2Graphs performs at least on par with state-of-the-art log anomaly detection methods on simple datasets while largely outperforming state-of-the-art log anomaly detection methods on complicated datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑