测试生成的能耗研究
On the Energy Consumption of Test Generation
AI总结:
本文针对自动化测试生成领域缺乏能耗研究的现状,测量了EvoSuite工具不同测试生成算法的能耗及生成测试的执行能耗,并与手动测试对比,发现算法能耗存在差异、手动测试能耗更高却未必覆盖率更优,为相关优化提供了方向。
摘要:
近年来,自动化测试生成领域的研究取得了显著进展,催生了多种可高效生成测试用例的方法与工具。其中,EvoSuite工具始终处于该领域研究前沿,集成了多种用于Java程序自动化测试生成的算法,也已被用于为各类程序生成测试用例。\n现有多项实证研究报告了EvoSuite中实现的各类测试生成策略与算法在代码覆盖率及其他相关指标上的有效性,但据我们所知,目前尚无针对自动化测试生成相关能耗的研究。本文旨在通过测量EvoSuite生成测试时的能耗,探究这一维度的特性。我们还测量了生成的测试用例在执行时的能耗,并将其与开发人员手动编写的测试用例的能耗进行对比。\n结果表明,不同的测试生成算法能耗存在差异,在圈复杂度较高的类上差异尤为明显。此外,我们还观察到,手动测试的能耗往往高于自动生成的测试,却未必能实现更高的代码覆盖率。我们的研究结果还揭示了能耗显著偏高的方法,为EvoSuite本身及各类被测程序的优化指明了潜在方向。
英文摘要:
Research in the area of automated test generation has seen remarkable progress in recent years, resulting in several approaches and tools for effective and efficient generation of test cases. In particular, the EvoSuite tool has been at the forefront of this progress embodying various algorithms for automated test generation of Java programs. EvoSuite has been used to generate test cases for a wide variety of programs as well. While there are a number of empirical studies that report results on the effectiveness, in terms of code coverage and other related metrics, of the various test generation strategies and algorithms implemented in EvoSuite, there are no studies, to the best of our knowledge, on the energy consumption associated to the automated test generation. In this paper, we set out to investigate this aspect by measuring the energy consumed by EvoSuite when generating tests. We also measure the energy consumed in the execution of the test cases generated, comparing them with those manually written by developers. The results show that the different test generation algorithms consumed different amounts of energy, in particular on classes with high cyclomatic complexity. Furthermore, we also observe that manual tests tend to consume more energy as compared to automatically generated tests, without necessarily achieving higher code coverage. Our results also give insight into the methods that consume significantly higher levels of energy, indicating potential points of improvement both for EvoSuite as well as the different programs under test.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。