基于搜索的测试数据生成的超参数调整
Revisiting Hyper-Parameter Tuning for Search-based Test Data Generation
摘要:
基于搜索的软件测试(SBST)是近年来研究较多的一种测试方法。从理论上讲,由于Meta启发式搜索方法的性能高度依赖于它们的参数,因此有必要研究SBST调整。在这项研究中,我们部分复制了以前的论文SBST工具调整,并重新审视该文件的一些要求。特别是,与以前的工作不同,我们的结果表明,调优的影响非常有限,只有一小部分的类在一个项目中。我们还认为,在以前的文件中的评估指标的选择,并表明,即使是受影响的类调整,最好的和平均配置之间的实际差异是微小的。最后,我们将详尽地探索超参数的搜索空间,并表明一半的研究配置与基线论文的默认配置相同或更好。
英文摘要:
Search-based software testing (SBST) has been studied a lot in the literature, lately. Since, in theory, the performance of meta-heuristic search methods are highly dependent on their parameters, there is a need to study SBST tuning. In this study, we partially replicate a previous paper on SBST tool tuning and revisit some of the claims of that paper. In particular, unlike the previous work, our results show that the tuning impact is very limited to only a small portion of the classes in a project. We also argue the choice of evaluation metric in the previous paper and show that even for the impacted classes by tuning, the practical difference between the best and an average configuration is minor. Finally, we will exhaustively explore the search space of hyper-parameters and show that half of the studied configurations perform the same or better than the baseline paper's default configuration.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。