arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.08134cs.SEcs.AI
收藏

组合测试基准生成器

A Benchmark Generator for Combinatorial Testing

Universitat de Lleida(莱里达大学)

Carlos Ansotegui, Eduard Torres

摘要:

组合测试(CT)工具对于正确测试各种系统(训练系统、图形用户界面(GUI)、自动驾驶系统等)至关重要。虽然有一个积极的研究社区致力于开发CT工具,矛盾的是,很少有人注意到提供足够的资源来测试CT工具本身。特别是,评估其正确性、有效性和效率的一套可用基准相当有限。在本文中,我们介绍了一个新的生成器的CT基准,基本上借用了结构中包含的过多的可用组合问题从其他研究社区,以创建有意义的基准。我们还使用这些新的基准对CT工具进行了广泛的评估。由于这项研究,我们提供了一些见解,在何种情况下应使用特定的CT工具。

英文摘要:

Combinatorial Testing (CT) tools are essential to test properly a wide range of systems (train systems, Graphical User Interfaces (GUIs), autonomous driving systems, etc). While there is an active research community working on developing CT tools, paradoxically little attention has been paid to making available enough resources to test the CT tools themselves. In particular, the set of available benchmarks to asses their correctness, effectiveness and efficiency is rather limited. In this paper, we introduce a new generator of CT benchmarks that essentially borrows the structure contained in the plethora of available Combinatorial Problems from other research communities in order to create meaningful benchmarks. We additionally perform an extensive evaluation of CT tools with these new benchmarks. Thanks to this study we provide some insights on under which circumstances a particular CT tool should be used.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑