arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.00548cs.SE
收藏

重复bug报告检测:我们走多远?

Duplicate Bug Report Detection: How Far Are We?

Singapore Management University(新加坡管理大学);Royal Holloway, University of London(伦敦大学皇家霍利学院);Chennai Mathematical Institute(钦奈数学研究所)

Ting Zhang, DongGyun Han, Venkatesh Vinayakarao, Ivana Clairine Irsan, Bowen Xu, Ferdian Thung, David Lo, Lingxiao Jiang

AI总结:

本文比较了重复bug报告检测技术,发现数据年龄和问题跟踪系统选择显著影响结果,简单技术在多数项目中表现优于复杂方法,揭示了当前技术的现状。

摘要:

许多重复bug报告检测(DBRD)技术已在研究文献中提出。行业使用其他技术。不幸的是,这些技术之间缺乏充分比较,不清楚我们目前进展如何。本文通过比较上述技术填补这一空白。为了比较,我们需要一个基准来估计工具在现实环境中的表现。因此,我们首先研究了影响DBRD技术准确公平比较的潜在偏差。实验表明,数据年龄和问题跟踪系统选择导致显著差异。基于这些发现,我们准备了一个新的基准。我们随后使用它评估DBRD技术,以更好地估计我们目前的进展。令人惊讶的是,在大多数项目中,一个简单的技术优于最近提出的复杂技术。此外,我们还比较了研究中提出的DBRD技术与Mozilla和VSCode中使用的技术。令人惊讶的是,一个已在实践中采用的简单技术可以实现与最近提出的研究工具相当的结果。本研究对当前DBRD状态进行了反思,并分享了见解以促进未来DBRD研究。

英文摘要:

Many Duplicate Bug Report Detection (DBRD) techniques have been proposed in the research literature. The industry uses some other techniques. Unfortunately, there is insufficient comparison among them, and it is unclear how far we have been. This work fills this gap by comparing the aforementioned techniques. To compare them, we first need a benchmark that can estimate how a tool would perform if applied in a realistic setting today. Thus, we first investigated potential biases that affect the fair comparison of the accuracy of DBRD techniques. Our experiments suggest that data age and issue tracking system choice cause a significant difference. Based on these findings, we prepared a new benchmark. We then used it to evaluate DBRD techniques to estimate better how far we have been. Surprisingly, a simpler technique outperforms recently proposed sophisticated techniques on most projects in our benchmark. In addition, we compared the DBRD techniques proposed in research with those used in Mozilla and VSCode. Surprisingly, we observe that a simple technique already adopted in practice can achieve comparable results as a recently proposed research tool. Our study gives reflections on the current state of DBRD, and we share our insights to benefit future DBRD research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑