有效减少测试集的子状态分析
Substate Profiling for Effective Test Suite Reduction
摘要:
测试用例缩减(TSR)的目的是从回归测试用例集中去除冗余的测试用例。典型的TSR方法确保原始测试套件覆盖的结构剖面元素也被缩减的测试套件覆盖。这是合理的,结构配置文件可能无法隔离失败的运行,通过运行,这减少了有效性的TSR方面的缺陷检测。这促使我们探索基于程序变量的集体值的状态配置文件。本文介绍了子状态剖析,一种新的形式的状态剖析,增强现有的基于配置文件的分析技术,如TSR和覆盖率为基础的故障定位。与现有的捕获程序状态的方法相比,子状态分析更实用,粒度更细。我们评估了我们的方法,使用13个多故障主题程序,包括53个缺陷。我们的研究涉及贪婪TSR使用子状态配置文件和四个结构配置文件,即,基本块,分支,def-use对,以及三者的组合。对于大多数受试者,Substate Profiling检测到了相当多的缺陷,减少程度相当。此外,在许多情况下,发现子状态剖面与结构剖面是互补的,因此,将两种类型结合起来是有益的。
英文摘要:
Test suite reduction (TSR) aims at removing redundant test cases from regression test suites. A typical TSR approach ensures that structural profile elements covered by the original test suite are also covered by the reduced test suite. It is plausible that structural profiles might be unable to segregate failing runs from passing runs, which diminishes the effectiveness of TSR in regard to defect detection. This motivated us to explore state profiles, which are based on the collective values of program variables. This paper presents Substate Profiling, a new form of state profiling that enhances existing profile-based analysis techniques such as TSR and coverage-based fault localization. Compared to current approaches for capturing program states, Substate Profiling is more practical and finer grained. We evaluated our approach using thirteen multi-fault subject programs comprising 53 defects. Our study involved greedy TSR using Substate profiles and four structural profiles, namely, basic-block, branch, def-use pair, and the combination of the three. For the majority of the subjects, Substate Profiling detected considerably more defects with a comparable level of reduction. Also, Substate profiles were found to be complementary to structural profiles in many cases, thus, combining both types is beneficial.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。