arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.02669cs.SE
收藏

基于UI的Flaky测试的实证分析

An Empirical Analysis of UI-based Flaky Tests

Alan Romano, Zihe Song, Sampath Grandhi, Wei Yang, Weihang Wang

摘要:

近年来,片状测试引起了研究界的关注,这是有充分理由的。这些测试会导致浪费时间和资源,并且会降低测试套件的可靠性,并影响构建系统。然而,大多数现有的工作对可扩展性测试只集中在传统的单元测试。这项工作忽略了比传统单元测试具有更大输入空间和更多样化运行条件的UI测试。此外,UI测试往往更复杂,资源量更大,这使得它们不适合涉及多次重新运行测试套件的检测技术。在本文中,我们进行了一项研究,对CNOUI测试。我们分析了来自Web和Android环境的62个项目中的235个UI测试样本。我们确定了UI测试中常见的flakiness的根本原因,用于表现恶意行为的策略,以及用于补救恶意UI测试的修复策略。本文的研究结果可为开发UI测试中片状缺陷的检测和预防技术提供基础。

英文摘要:

Flaky tests have gained attention from the research community in recent years and with good reason. These tests lead to wasted time and resources, and they reduce the reliability of the test suites and build systems they affect. However, most of the existing work on flaky tests focus exclusively on traditional unit tests. This work ignores UI tests that have larger input spaces and more diverse running conditions than traditional unit tests. In addition, UI tests tend to be more complex and resource-heavy, making them unsuited for detection techniques involving rerunning test suites multiple times. In this paper, we perform a study on flaky UI tests. We analyze 235 flaky UI test samples found in 62 projects from both web and Android environments. We identify the common underlying root causes of flakiness in the UI tests, the strategies used to manifest the flaky behavior, and the fixing strategies used to remedy flaky UI tests. The findings made in this work can provide a foundation for the development of detection and prevention techniques for flakiness arising in UI tests.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑