arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.09976cs.SE
收藏

理解文本差异对重复错误报告检测的影响

Towards Understanding the Impacts of Textual Dissimilarity on Duplicate Bug Report Detection

Sigma Jahan, Mohammad Masudur Rahman

摘要:

大约40%的软件错误报告是彼此重复的,这在软件维护期间造成了重大开销。传统的技术通常专注于检测文本相似的重复错误报告。然而,在缺陷跟踪系统中,许多重复的缺陷报告可能在文本上并不相似,传统的技术可能达不到这一点。在本文中,我们进行了一个大规模的实证研究,以更好地了解文本的不同检测重复的错误报告的影响。首先,我们从三个开源系统中收集了总共92,854个错误报告,并构建了两个包含文本相似和文本不相似的重复错误报告的数据集。然后,我们确定了现有的三种技术在检测重复的错误报告的性能,并表明它们的性能显着差的文本不同的重复报告。其次,我们使用描述性分析、词嵌入可视化和人工分析相结合的方法来分析这两组错误报告。我们发现,文本上不同的重复错误报告往往会遗漏重要的组件(例如,预期的行为和步骤来再现),这可能导致它们的文本差异和现有技术的较差性能。最后,我们应用特定领域的嵌入重复的错误报告检测问题,这表明混合的结果。以上所有这些发现都需要进一步的调查和更有效的解决方案来检测文本上不同的重复错误报告。

英文摘要:

About 40% of software bug reports are duplicates of one another, which pose a major overhead during software maintenance. Traditional techniques often focus on detecting duplicate bug reports that are textually similar. However, in bug tracking systems, many duplicate bug reports might not be textually similar, for which the traditional techniques might fall short. In this paper, we conduct a large-scale empirical study to better understand the impacts of textual dissimilarity on the detection of duplicate bug reports. First, we collect a total of 92,854 bug reports from three open-source systems and construct two datasets containing textually similar and textually dissimilar duplicate bug reports. Then we determine the performance of three existing techniques in detecting duplicate bug reports and show that their performance is significantly poor for textually dissimilar duplicate reports. Second, we analyze the two groups of bug reports using a combination of descriptive analysis, word embedding visualization, and manual analysis. We found that textually dissimilar duplicate bug reports often miss important components (e.g., expected behaviors and steps to reproduce), which could lead to their textual differences and poor performance by the existing techniques. Finally, we apply domain-specific embedding to duplicate bug report detection problems, which shows mixed results. All these findings above warrant further investigation and more effective solutions for detecting textually dissimilar duplicate bug reports.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑