arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.01336cs.SEcs.CL
收藏

识别bug报告中的非自然语言工件

Identifying non-natural language artifacts in bug reports

Graz University of Technology(格拉茨工业大学)

Thomas Hirsch, Birgit Hofer

摘要:

Bug报告是自然语言处理(NLP)的一个常用目标。但是,bug报告通常包含代码片段、日志输出和堆栈跟踪等工件。这些工件不仅会使bug报告充满噪音,而且往往会对NLP方法构成真正的问题,必须加以删除。在本文中,我们提出了一种基于机器学习的方法来分类内容到自然语言和工件在行级实现Python。我们展示了如何将来自GitHub问题跟踪器的数据用于自动生成训练集,并为bug报告提供了一种自定义的预处理方法。我们的模型在0.95 ROC-AUC和0.93 F1上对我们手动注释的验证集进行了评分,并在0.72秒内对10 k行进行了分类。我们针对同一个任务,针对一个外国数据集和一个外国R模型对我们的模型进行了交叉评估。我们的模型和数据集的Python实现在开源许可证下公开提供。

英文摘要:

Bug reports are a popular target for natural language processing (NLP). However, bug reports often contain artifacts such as code snippets, log outputs and stack traces. These artifacts not only inflate the bug reports with noise, but often constitute a real problem for the NLP approach at hand and have to be removed. In this paper, we present a machine learning based approach to classify content into natural language and artifacts at line level implemented in Python. We show how data from GitHub issue trackers can be used for automated training set generation, and present a custom preprocessing approach for bug reports. Our model scores at 0.95 ROC-AUC and 0.93 F1 against our manually annotated validation set, and classifies 10k lines in 0.72 seconds. We cross evaluated our model against a foreign dataset and a foreign R model for the same task. The Python implementation of our model and our datasets are made publicly available under an open source license.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑