arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.07169cs.SE
收藏

基于文档的语义感知日志解析

Documentation based Semantic-Aware Log Parsing

Lei Yu, Tian Wu, Jiaqi Li, Patrick Chan, Hong Min, Fanjing Meng

摘要:

随着深度学习技术的最新进展,人们对将机器学习应用于日志数据的兴趣迅速增长。作为日志分析的基本部分,将原始日志转换为结构化事件的准确日志解析对于后续的机器学习和数据采掘任务至关重要。以前的方法要么分析源代码进行解析,要么是数据驱动的,如文本聚类。他们在很大程度上忽视了利用另一种广泛可用且有价值的资源,即为消息提供详细解释的软件文档,以提高准确性。在本文中,我们提出了一种方法和系统框架,使用文档知识的日志解析。通过参数值识别,不仅可以提高文档化消息的解析精度,而且可以提高文档化消息的解析精度。此外,它可以发现通过共享参数建立的事件模板之间的联系,并指示事件上下文的相关性。

英文摘要:

With the recent advances of deep learning techniques, there are rapidly growing interests in applying machine learning to log data. As a fundamental part of log analytics, accurate log parsing that transforms raw logs to structured events is critical for subsequent machine learning and data mining tasks. Previous approaches either analyze the source code for parsing or are data-driven such as text clustering. They largely neglect to exploit another widely available and valuable resource, software documentation that provides detailed explanations for the messages, to improve accuracy. In this paper, we propose an approach and system framework to use documentation knowledge for log parsing. With parameter value identification, it not only can improve the parsing accuracy for documented messages but also for undocumented messages. In addition, it can discover the linkages between event templates that are established by sharing parameters and indicate the correlation of the event context.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑