AUITestAgent:面向需求的自动化GUI功能测试
AUITestAgent: Automatic Requirements Oriented GUI Function Testing
AI总结:
针对移动应用GUI测试人力成本高的问题,提出首款自然语言驱动的自动化测试工具AUITestAgent,通过动态智能体提取交互、多维策略验证,在基准测试中表现优于现有工具,且在企业实际部署中有效检出功能缺陷。
摘要:
图形用户界面(GUI)是用户与移动应用交互的方式。为确保其正常运行,测试工程师必须依据通常以自然语言编写的测试需求,确认GUI功能符合预期。尽管广泛采用的手动测试和基于脚本的方法行之有效,但由于现代移动应用GUI页面数量庞大且迭代迅速,这些方法需要投入大量人力。本文提出AUITestAgent,这是首款面向移动应用的自然语言驱动自动化GUI测试工具,能够实现GUI交互与功能验证全流程的完全自动化。由于测试需求通常包含交互命令和验证判定规则,AUITestAgent可通过动态组织的智能体从测试需求中提取GUI交互操作。随后,AUITestAgent采用多维数据提取策略,从交互轨迹中检索与测试需求相关的数据并执行验证。在定制基准上的实验表明,AUITestAgent在生成的GUI交互质量上优于现有工具,验证准确率达到94%。此外,在美团的实地部署验证了AUITestAgent的实际可用性,它在两个月内的10次回归测试中发现了4个新的功能缺陷。
英文摘要:
The Graphical User Interface (GUI) is how users interact with mobile apps. To ensure it functions properly, testing engineers have to make sure it functions as intended, based on test requirements that are typically written in natural language. While widely adopted manual testing and script-based methods are effective, they demand substantial effort due to the vast number of GUI pages and rapid iterations in modern mobile apps. This paper introduces AUITestAgent, the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification. Since test requirements typically contain interaction commands and verification oracles. AUITestAgent can extract GUI interactions from test requirements via dynamically organized agents. Then, AUITestAgent employs a multi-dimensional data extraction strategy to retrieve data relevant to the test requirements from the interaction trace and perform verification. Experiments on customized benchmarks demonstrate that AUITestAgent outperforms existing tools in the quality of generated GUI interactions and achieved the accuracy of verifications of 94%. Moreover, field deployment in Meituan has shown AUITestAgent's practical usability, with it detecting 4 new functional bugs during 10 regression tests in two months.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。