arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.06563cs.SEcs.AI
收藏

AI驱动的自然语言需求测试用例生成:技术与研究空白综述

AI-Driven Test Case Generation from Natural Language Requirements: A Survey of Techniques and Research Gaps

School of Electrical Engineering and Computer Science(电气工程与计算机科学学院)

Orimoloye Folorunsho, Hassan Reza

AI总结:

综述AI、NLP和LLM从自然语言需求生成测试用例的技术,指出当前方法无法同时满足自动化、歧义处理等六个质量维度,提出四个研究方向。

摘要:

软件测试对于验证系统是否满足指定需求至关重要,但仍是开发中最耗时和最昂贵的活动之一。基于需求的测试生成允许从需求工件早期导出测试用例,但由于固有的歧义和不精确性,直接从自然语言生成测试用例具有挑战性。人工智能、自然语言处理(NLP)和大语言模型(LLM)的最新进展使得自动化这一流程越来越可行,同时也引入了新的风险,包括幻觉、可追溯性降低和不一致的评估。本综述探讨了四个研究问题:提出了哪些AI和NLP技术用于从自然语言需求生成测试用例;哪些工具和框架支持这些方法;如何评估生成的测试用例;以及存在哪些研究空白。遵循Kitchenham和Charters的系统综述指南,我们搜索了2000-2025年的主要学术数据库,并在应用严格纳入标准后,确定了21项主要研究。文献被组织为三个进化时代,揭示出没有现有方法能同时满足六个关键质量维度:自动化、歧义处理、领域适用性、可追溯性、评估彻底性和幻觉控制。本综述做出了三个主要贡献:基于AI的测试生成的三时代进化综合;六标准差距分析,显示当前没有方法完全满足所有质量维度;以及针对幻觉、可追溯性、复杂性敏感性和合规性的四个可操作研究指南。

英文摘要:

Software testing is critical for verifying that systems meet specified requirements, yet remains among the most time-consuming and expensive activities in development. Requirements-based test generation allows test cases to be derived early from requirements artifacts, but generating them directly from natural language is challenging due to inherent ambiguity and imprecision. Recent advances in AI, natural language processing (NLP), and large language models (LLMs) have made automating this pipeline increasingly feasible, while introducing new risks including hallucination, reduced traceability, and inconsistent evaluation. This survey addresses four research questions: what AI and NLP techniques have been proposed for generating test cases from natural language requirements; what tools and frameworks support these approaches; how generated test cases are evaluated; and what research gaps remain. Following Kitchenham and Charters' systematic review guidelines, we searched major scholarly databases spanning 2000-2025 and, after applying strict inclusion criteria, identified 21 primary studies. The literature is organized into three evolutionary eras, revealing that no existing approach simultaneously satisfies six key quality dimensions: automation, ambiguity handling, domain applicability, traceability, evaluation thoroughness, and hallucination control. The survey makes three main contributions: a three-era evolutionary synthesis of AI-based test generation; a six-criteria gap analysis showing no current approach fully addresses all quality dimensions; and four actionable research guidelines targeting hallucination, traceability, complexity sensitivity, and compliance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑