arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.06224cs.SE
收藏

AI辅助测试自动化的多年灰色文献综述

A Multi-Year Grey Literature Review on AI-assisted Test Automation

Filippo Ricca, Alessandro Marchetto, Andrea Stocco

AI总结:

本文通过五年灰色文献综述和专家访谈,系统梳理了AI辅助测试自动化所解决的问题、解决方案及100种工具,提出新分类法并揭示AI在TA中的现状与未来潜力。

摘要:

背景:测试自动化(TA)技术对于软件工程中的质量保证至关重要,但面临诸如测试套件维护成本高以及需要广泛编程技能等局限性。人工智能(AI)通过自动化和改进的实践为解决这些问题提供了新的机会。目标:鉴于AI在工业界的普遍使用,事实来源存在于灰色文献以及专业人士、利益相关者、开发人员和最终用户的头脑中。本研究调查灰色文献,以探索AI如何在TA中被采用,重点关注其解决的问题、其解决方案以及可用的工具。此外,本研究收集专家见解,以了解AI在TA中当前和未来的角色。方法:我们在五年内审查了超过3,600个灰色文献来源,包括博客、白皮书和用户手册,并最终筛选出342份文档,以开发TA问题和AI解决方案的分类法。我们还编目了100种AI驱动的TA工具,并采访了五位专家软件测试人员,以深入了解AI在TA中当前和未来的角色。结果:研究发现,手动测试代码开发和维护是TA中的主要挑战。相比之下,自动化测试生成和自修复测试脚本是最常见的AI解决方案。我们识别出100种基于AI的TA工具,其中Applitools、Testim、Functionize、AccelQ和Mabl在实践中被采用最多。结论:本文通过灰色文献分析和专家访谈,详细概述了AI对TA的影响。它提出了TA问题和AI解决方案的新分类法,提供了AI驱动工具的目录,并将解决方案与问题以及工具与解决方案相关联。访谈见解进一步揭示了AI在TA中的现状和未来潜力。我们的发现支持从业者选择TA工具,并指导未来的研究方向。

英文摘要:

Context: Test Automation (TA) techniques are crucial for quality assurance in software engineering but face limitations such as high test suite maintenance costs and the need for extensive programming skills. Artificial Intelligence (AI) offers new opportunities to address these issues through automation and improved practices. Objectives: Given the prevalent usage of AI in industry, sources of truth are held in grey literature as well as the minds of professionals, stakeholders, developers, and end-users. This study surveys grey literature to explore how AI is adopted in TA, focusing on the problems it solves, its solutions, and the available tools. Additionally, the study gathers expert insights to understand AI's current and future role in TA. Methods: We reviewed over 3,600 grey literature sources over five years, including blogs, white papers, and user manuals, and finally filtered 342 documents to develop taxonomies of TA problems and AI solutions. We also cataloged 100 AI-driven TA tools and interviewed five expert software testers to gain insights into AI's current and future role in TA. Results: The study found that manual test code development and maintenance are the main challenges in TA. In contrast, automated test generation and self-healing test scripts are the most common AI solutions. We identified 100 AI-based TA tools, with Applitools, Testim, Functionize, AccelQ, and Mabl being the most adopted in practice. Conclusion: This paper offers a detailed overview of AI's impact on TA through grey literature analysis and expert interviews. It presents new taxonomies of TA problems and AI solutions, provides a catalog of AI-driven tools, and relates solutions to problems and tools to solutions. Interview insights further revealed the state and future potential of AI in TA. Our findings support practitioners in selecting TA tools and guide future research directions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑