arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1702.03457cs.SE
收藏

可配置系统的时空有效回归测试

Time-Space Efficient Regression Testing for Configurable Systems

Sabrina Souto, Marcelo d'Amorim

摘要:

可配置系统是指可以从一组选项中进行调整的系统。它们是普遍存在的,测试它们是重要和具有挑战性的。用于测试可配置系统的现有方法要么是不可靠的(即,它们可能错过断层揭示构造)或不成比例。本文提出了EvoSPLat,可配置系统的回归测试技术。EvoSPLat建立在我们以前开发的技术SPLat的基础上,SPLat可以从测试中探索所有动态可达配置。EvoSPLat针对回归测试中的两种使用场景进行了调优:回归配置选择(RCS)和回归测试选择(RTS)。EvoSPLat for RCS修剪不受更改影响的配置(非测试),而EvoSPLat for RTS修剪不受更改影响的测试(非配置)。在进化的背景下处理这两种情况是很重要的。实验结果表明,EvoSPLat是有前途的。我们观察到可配置Java程序的时间(22%)和配置数量(45%)大幅减少。在一个大型的真实世界可配置系统(GCC)的案例研究中,EvoSPLat减少了35%的运行时间。将EvoSPLat与采样技术进行比较,2-wise是最有效的技术,但它错过了两个错误,而EvoSPLat检测所有错误的速度平均比6-wise快四倍。

英文摘要:

Configurable systems are those that can be adapted from a set of options. They are prevalent and testing them is important and challenging. Existing approaches for testing configurable systems are either unsound (i.e., they can miss fault-revealing configurations) or do not scale. This paper proposes EvoSPLat, a regression testing technique for configurable systems. EvoSPLat builds on our previously-developed technique, SPLat, which explores all dynamically reachable configurations from a test. EvoSPLat is tuned for two scenarios of use in regression testing: Regression Configuration Selection (RCS) and Regression Test Selection (RTS). EvoSPLat for RCS prunes configurations (not tests) that are not impacted by changes whereas EvoSPLat for RTS prunes tests (not configurations) which are not impacted by changes. Handling both scenarios in the context of evolution is important. Experimental results show that EvoSPLat is promising. We observed a substantial reduction in time (22%) and in the number of configurations (45%) for configurable Java programs. In a case study on a large real-world configurable system (GCC), EvoSPLat reduced 35% of the running time. Comparing EvoSPLat with sampling techniques, 2-wise was the most efficient technique, but it missed two bugs whereas EvoSPLat detected all bugs four times faster than 6-wise, on average.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑