Causal Testing:查找缺陷的根本原因
Causal Testing: Finding Defects' Root Causes
摘要:
了解缺陷的根本原因对于隔离和修复bug行为至关重要。我们提出了因果测试,这是一种新的根本原因分析方法,它依赖于反事实因果关系理论来识别一组执行,这些执行可能包含理解和修复错误行为所需的关键因果信息。使用Defects4J基准测试,我们发现因果测试可以应用于71%的真实缺陷,并且对于其中的77%,它可以帮助开发人员识别缺陷的根本原因。一个有37名开发人员参与的对照实验表明,因果测试提高了参与者识别缺陷原因的能力,从标准测试工具的80%提高到因果测试的86%。参与者报告说,因果测试提供了使用JUnit等工具无法获得的有用信息。Holmes,我们的原型,因果测试的开源Eclipse插件实现,可以在http://holmes.cs.umass.edu/上找到。
英文摘要:
Understanding the root cause of a defect is critical to isolating and repairing buggy behavior. We present Causal Testing, a new method of root-cause analysis that relies on the theory of counterfactual causality to identify a set of executions that likely hold key causal information necessary to understand and repair buggy behavior. Using the Defects4J benchmark, we find that Causal Testing could be applied to 71% of real-world defects, and for 77% of those, it can help developers identify the root cause of the defect. A controlled experiment with 37 developers shows that Causal Testing improves participants' ability to identify the cause of the defect from 80% of the time with standard testing tools to 86% of the time with Causal Testing. The participants report that Causal Testing provides useful information they cannot get using tools such as JUnit. Holmes, our prototype, open-source Eclipse plugin implementation of Causal Testing, is available at http://holmes.cs.umass.edu/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。