arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.09342cs.SE
收藏

开源缺陷注入基准测试平台的评估测试

Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing

Miroslav Bures, Pavel Herout, Bestoun S. Ahmed

摘要:

评估测试技术有效性的一种自然方法是在应用创建的测试用例时测量缺陷检测率。在这里,真实的或人为的软件缺陷可以被注入到软件的源代码中。对于更广泛的评估,通常需要注入人工缺陷,并且可以通过使用代码突变操作符的突变测试来执行。然而,为了模拟由于对设计规范的误解而产生的复杂缺陷,突变测试在某些情况下可能会达到极限。在本文中,我们提出了一个开源的基准测试平台应用程序,采用人工缺陷注入的补充方法。在从预定义的构建块将人工缺陷注入其源代码之后,对应用程序进行编译。大多数的功能和用户界面元素通过创建可用于实验的基于前端的自动化测试用例来覆盖。

英文摘要:

A natural method to evaluate the effectiveness of a testing technique is to measure the defect detection rate when applying the created test cases. Here, real or artificial software defects can be injected into the source code of software. For a more extensive evaluation, the injection of artificial defects is usually needed and can be performed via mutation testing using code mutation operators. However, to simulate complex defects arising from a misunderstanding of design specifications, mutation testing might reach its limit in some cases. In this paper, we present an open-source benchmark testbed application that employs a complement method of artificial defect injection. The application is compiled after artificial defects are injected into its source code from predefined building blocks. The majority of the functions and user interface elements are covered by creating front-end-based automated test cases that can be used in experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑