arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.11289cs.SE
收藏

持续学习缺陷定位

Continuously Learning Bug Locations

Paulina Stevia Nouwou Mindom, Leuson Da Silva, Amin Nikanjam, Foutse Khomh

AI总结:

本文提出利用持续学习技术应对概念漂移,在非静态设置下进行缺陷定位,实验表明其性能显著优于深度学习方法,且计算成本更低。

摘要:

在软件开发过程中,自动定位与缺陷报告相关的错误变更集至关重要。基于深度学习(DL)的技术通过利用代码的结构信息并学习变更集与缺陷报告之间的关联,展现出良好的前景。然而,由于与变更集相关的源代码会不断演化,这类模型的性能往往会因概念漂移而随时间下降。针对这一挑战,本文在多子任务设置下评估了使用持续学习(CL)技术进行缺陷定位的潜力(每个子任务处理静态或非静态数据),并将其与利用BERT模型的缺陷定位技术、基于深度强化学习且利用A2C算法的技术,以及用于语义缺陷定位的基于DL的函数级交互模型进行了比较。此外,我们通过使用逻辑回归来识别并整合最显著的缺陷引入因素,对CL技术进行了增强。我们在七个广泛使用的软件项目上的实证评估表明,在非静态设置下,CL技术的性能优于基于DL的技术,在平均倒数排名(MRR)上最高提升61%,在平均精度均值(MAP)上提升44%,在top@1上提升83%,在top@5上提升56%,在top@10上提升66%。进一步,我们表明所研究的CL技术能够有效定位与缺陷报告相关的变更集,同时能够缓解所研究任务中的灾难性遗忘,并且在训练过程中所需的计算量最多减少5倍。我们的发现证明了在非静态设置下采用CL进行缺陷定位的潜力,并希望这有助于利用CL技术改进软件工程中的缺陷定位活动。

英文摘要:

Automatically locating buggy changesets associated with bug reports is crucial in the software development process. Deep Learning (DL)-based techniques show promising results by leveraging structural information from the code and learning links between changesets and bug reports. However, since source code associated with changesets evolves, the performance of such models tends to degrade over time due to concept drift. Aiming to address this challenge, in this paper, we evaluate the potential of using Continual Learning (CL) techniques in multiple sub-tasks setting for bug localization (each of which operates on either stationary or non-stationary data), comparing it against a bug localization technique that leverages the BERT model, a deep reinforcement learning-based technique that leverages the A2C algorithm, and a DL-based function-level interaction model for semantic bug localization. Additionally, we enhanced the CL techniques by using logistic regression to identify and integrate the most significant bug-inducing factors. Our empirical evaluation across seven widely used software projects shows that CL techniques perform better than DL-based techniques by up to 61% in terms of Mean Reciprocal Rank (MRR), 44% in terms of Mean Average Precision (MAP), 83% in terms of top@1, 56% in terms of top@5, and 66% in terms of top@10 metrics in non-stationary setting. Further, we show that the CL techniques we studied are effective at localizing changesets relevant to a bug report while being able to mitigate catastrophic forgetting across the studied tasks and require up to 5x less computational effort during training. Our findings demonstrate the potential of adopting CL for bug localization in non-stationary settings, and we hope it helps to improve bug localization activities in Software Engineering using CL techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑