arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.06334cs.SEcs.AIcs.LG
收藏

使用自然语言处理自动标记错误报告

Auto-labelling of Bug Report using Natural Language Processing

Juniper Networks Inc.(瞻博网络公司);San José State University(圣何塞州立大学)

Avinash Patil, Aryan Jadon

AI总结:

本文提出一种结合NLP技术的自动标记错误报告方法,利用自定义数据转换器、深度神经网络和非泛化机器学习,在数千个错误报告上实现recall@5为70%的高检索准确率。

摘要:

在错误跟踪系统中检测相似错误报告的练习被称为重复错误报告检测。事先了解错误报告的存在可以减少调试问题和确定根本原因的努力。基于规则和查询的解决方案会推荐一长串潜在相似错误报告,但没有明确的排名。此外,分诊工程师不太愿意花时间浏览大量列表。因此,这阻碍了重复错误报告检索解决方案的使用。在本文中,我们提出了一种结合NLP技术的解决方案。我们的方法考虑了错误报告的非结构化和结构化属性,如摘要、描述和严重性、受影响的产品、平台、类别等。它使用自定义数据转换器、深度神经网络和非泛化机器学习方法来检索现有的相同错误报告。我们使用包含数千个错误报告的重要数据源进行了大量实验,并展示了所提出的解决方案在recall@5上实现了70%的高检索准确率。

英文摘要:

The exercise of detecting similar bug reports in bug tracking systems is known as duplicate bug report detection. Having prior knowledge of a bug report's existence reduces efforts put into debugging problems and identifying the root cause. Rule and Query-based solutions recommend a long list of potential similar bug reports with no clear ranking. In addition, triage engineers are less motivated to spend time going through an extensive list. Consequently, this deters the use of duplicate bug report retrieval solutions. In this paper, we have proposed a solution using a combination of NLP techniques. Our approach considers unstructured and structured attributes of a bug report like summary, description and severity, impacted products, platforms, categories, etc. It uses a custom data transformer, a deep neural network, and a non-generalizing machine learning method to retrieve existing identical bug reports. We have performed numerous experiments with significant data sources containing thousands of bug reports and showcased that the proposed solution achieves a high retrieval accuracy of 70% for recall@5.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑