arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.07072cs.SEcs.AI
收藏

InterEvo-TR:结合可读性评估的交互式进化测试生成

InterEvo-TR: Interactive Evolutionary Test Generation With Readability Assessment

University of Cádiz(加的斯大学);University of Córdoba(科尔多瓦大学)

Pedro Delgado-Pérez, Aurora Ramírez, Kevin J. Valle-Gómez, Inmaculada Medina-Bulo, José Raúl Romero

AI总结:

本文提出 InterEvo-TR,将测试人员的交互式可读性评估融入 EvoSuite 进化测试生成过程,并通过 39 名参与者的受控实验验证了该交互策略在可读性评估中的有效性,为交互式测试生成发展奠定基础。

摘要:

自动化测试用例生成已被证明有助于降低软件测试通常高昂的成本。然而,多项研究也注意到,与手动设计的测试套件相比,测试人员对生成的测试套件的可理解性持怀疑态度。这一事实表明,让测试人员参与测试生成过程可能有助于提高他们对自动生成的测试套件的接受度。在本文中,我们提出将测试人员进行的交互式可读性评估纳入 EvoSuite——一个广为人知的进化测试生成工具。我们的方法 InterEvo-TR 在搜索过程中的不同时刻与测试人员交互,并展示覆盖相同覆盖目标的不同测试用例,以供其进行主观评价。这种交互式方法的设计涉及交互时间安排、一种使所选目标多样化的方法、保存和处理可读性值的方案,以及一些定制修订参与程度的机制等方面。为了分析我们方案的可能性和实用性,我们进行了一项受控实验,39 名参与者(包括学术界人士、专业开发者和学生协作者)与 InterEvo-TR 进行了交互。我们的结果表明,选择和呈现中间结果的策略对于可读性评估目的是有效的。此外,参与者的行为和对问卷的回答使我们能够分析影响测试代码可读性的因素,以及在测试用例生成背景下交互式方法的优势和局限性,为未来基于交互性的发展铺平了道路。

英文摘要:

Automated test case generation has proven to be useful to reduce the usually high expenses of software testing. However, several studies have also noted the skepticism of testers regarding the comprehension of generated test suites when compared to manually designed ones. This fact suggests that involving testers in the test generation process could be helpful to increase their acceptance of automatically-produced test suites. In this paper, we propose incorporating interactive readability assessments made by a tester into EvoSuite, a widely-known evolutionary test generation tool. Our approach, InterEvo-TR, interacts with the tester at different moments during the search and shows different test cases covering the same coverage target for their subjective evaluation. The design of such an interactive approach involves a schedule of interaction, a method to diversify the selected targets, a plan to save and handle the readability values, and some mechanisms to customize the level of engagement in the revision, among other aspects. To analyze the potential and practicability of our proposal, we conduct a controlled experiment in which 39 participants, including academics, professional developers, and student collaborators, interact with InterEvo-TR. Our results show that the strategy to select and present intermediate results is effective for the purpose of readability assessment. Furthermore, the participants' actions and responses to a questionnaire allowed us to analyze the aspects influencing test code readability and the benefits and limitations of an interactive approach in the context of test case generation, paving the way for future developments based on interactivity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑