arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.07237cs.SE
收藏

可靠性工程自动日志分析综述

A Survey on Automated Log Analysis for Reliability Engineering

Shilin He, Pinjia He, Zhuangbin Chen, Tianyi Yang, Yuxin Su, Michael R. Lyu

摘要:

日志是由软件源代码中的日志语句生成的半结构化文本。近几十年来,软件日志在许多软件系统的可靠性保证机制中已变得必不可少,因为它们通常是记录软件运行时信息的唯一可用数据。随着现代软件向大规模发展,日志的数量迅速增加。为了使现代软件日志在可靠性工程中的有效和高效的使用,已经进行了一些研究自动日志分析。本调查详细介绍了自动日志分析研究的概况,包括如何自动化和辅助日志语句的编写,如何压缩日志,如何将日志解析为结构化事件模板,以及如何使用日志来检测异常,预测故障和促进诊断。此外,我们还调查了发布开源工具包和数据集的工作。基于对最新进展的讨论,我们提出了几个有前途的未来方向,现实世界和下一代自动日志分析。

英文摘要:

Logs are semi-structured text generated by logging statements in software source code. In recent decades, software logs have become imperative in the reliability assurance mechanism of many software systems because they are often the only data available that record software runtime information. As modern software is evolving into a large scale, the volume of logs has increased rapidly. To enable effective and efficient usage of modern software logs in reliability engineering, a number of studies have been conducted on automated log analysis. This survey presents a detailed overview of automated log analysis research, including how to automate and assist the writing of logging statements, how to compress logs, how to parse logs into structured event templates, and how to employ logs to detect anomalies, predict failures, and facilitate diagnosis. Additionally, we survey work that releases open-source toolkits and datasets. Based on the discussion of the recent advances, we present several promising future directions toward real-world and next-generation automated log analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑