ASGNet:用于基于日志的异常诊断的自适应语义门网络
ASGNet: Adaptive Semantic Gate Networks for Log-Based Anomaly Diagnosis
AI总结:
本文提出ASGNet,通过变分编码模块和自适应语义阈值机制结合统计特征与语义特征,解决日志异常诊断中的过拟合问题,在真实数据集上优于所有基线方法。
摘要:
日志被广泛用于软件系统的开发和维护中。日志可以帮助工程师了解系统的运行时行为并诊断系统故障。对于异常诊断,现有方法通常使用从历史日志中提取的日志事件数据来构建诊断模型。然而,我们发现现有方法并未充分利用两类特征:(1)统计特征:日志数据中的一些固有统计特征,如词频和异常标签分布,未得到充分利用。与日志原始数据相比,统计特征是确定性的,且自然兼容相应任务。(2)语义特征:日志包含软件系统背后的执行逻辑,因此日志语句共享深层语义关系。如何有效结合日志数据中的统计特征和语义特征以提升日志异常诊断的性能是本文的关键点。在本文中,我们提出了一种自适应语义门网络(ASGNet),它结合了统计特征和语义特征,选择性地使用统计特征来巩固日志文本语义表示。具体而言,ASGNet通过变分编码模块对统计特征进行编码,并通过精心设计的自适应语义阈值机制融合有用信息。该阈值机制基于决策中语义特征的置信度将信息流引入分类器,这有助于训练鲁棒的分类器,并能解决由使用统计特征引起的过拟合问题。在真实数据集上的实验结果表明,我们提出的方法在各项性能指标上均优于所有基线方法。
英文摘要:
Logs are widely used in the development and maintenance of software systems. Logs can help engineers understand the runtime behavior of systems and diagnose system failures. For anomaly diagnosis, existing methods generally use log event data extracted from historical logs to build diagnostic models. However, we find that existing methods do not make full use of two types of features, (1) statistical features: some inherent statistical features in log data, such as word frequency and abnormal label distribution, are not well exploited. Compared with log raw data, statistical features are deterministic and naturally compatible with corresponding tasks. (2) semantic features: Logs contain the execution logic behind software systems, thus log statements share deep semantic relationships. How to effectively combine statistical features and semantic features in log data to improve the performance of log anomaly diagnosis is the key point of this paper. In this paper, we propose an adaptive semantic gate networks (ASGNet) that combines statistical features and semantic features to selectively use statistical features to consolidate log text semantic representation. Specifically, ASGNet encodes statistical features via a variational encoding module and fuses useful information through a well-designed adaptive semantic threshold mechanism. The threshold mechanism introduces the information flow into the classifier based on the confidence of the semantic features in the decision, which is conducive to training a robust classifier and can solve the overfitting problem caused by the use of statistical features. The experimental results on the real data set show that our method proposed is superior to all baseline methods in terms of various performance indicators.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。