arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.11532cs.SE
收藏

预测突变检测有效性的威胁:未覆盖突变体的影响

The Threat to the Validity of Predictive Mutation Testing: The Impact of Uncovered Mutants

Alireza Aghamohammadi, Seyed-Hassan Mirian-Hosseinabadi

摘要:

预测突变测试(PMT)是一种通过使用机器学习方法来预测突变体是否会被杀死的技术。研究人员提出了各种机器学习方法的PMT下的跨项目设置。然而,他们没有考虑未发现的突变体的影响。如果在其上生成突变体的语句没有被任何测试用例执行,则突变体是未被发现的。我们发现,未发现的突变体膨胀以前的PMT结果。此外,我们的目标是提出一种替代方法来改善PMT和跨项目PMT提出不同的解释。我们复制了以前的PMT研究。我们还提出了一种基于随机森林和梯度提升相结合的方法来改善PMT的结果。我们经验性地评估了我们的方法在相同的654 Java项目提供了以前的PMT文献。我们的研究结果表明,PMT的性能急剧下降的AUC从0.83到0.51。此外,PMT在27%的测试项目上的表现不如随机猜测。所提出的方法通过实现0.61的平均AUC值来改善PMT结果。

英文摘要:

Predictive Mutation Testing (PMT) is a technique to predict whether a mutant will be killed by using machine learning approaches. Researchers have proposed various machine learning methods for PMT under the cross-project setting. However, they did not consider the impact of uncovered mutants. A mutant is uncovered if the statement on which the mutant is generated is not executed by any test cases. We show that uncovered mutants inflate previous PMT results. Moreover, we aim at proposing an alternative approach to improve PMT and suggesting a different interpretation for cross-project PMT. We replicated the previous PMT research. We also proposed an approach based on the combination of Random Forest and Gradient Boosting to improve the PMT results. We empirically evaluated our approach on the same 654 Java projects provided by the previous PMT literature. Our results indicate that the performance of PMT drastically decreases in terms of AUC from 0.83 to 0.51. Furthermore, PMT performs worse than random guesses on 27% of the test projects. The proposed approach improves the PMT results by achieving the average AUC value of 0.61.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑