arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.00547cs.SE
收藏

从需求到测试用例:一种面向高性能ECU测试用例自动化的基于NLP的方法

From Requirements to Test Cases: An NLP-Based Approach for High-Performance ECU Test Case Automation

Nikitha Medeshetty, Ahmad Nauman Ghazi, Sadi Alawadi, Fahed Alkhabbas

AI总结:

本研究探讨利用基于规则的信息提取和NER等NLP技术,将自然语言需求转化为结构化测试用例,发现基于规则的方法在简单需求中准确率达95%,显著提升测试效率。

摘要:

自动化测试用例规格说明的生成对于提升软件测试的效率和准确性至关重要,特别是在高性能电子控制单元(ECU)等复杂系统中。本研究探讨了自然语言处理(NLP)技术的应用,包括基于规则的信息提取和命名实体识别(NER),以将自然语言需求转化为结构化的测试用例规格说明。研究使用了来自Polarion工具的400份特征元素文档组成的数据集,来评估这两种方法在提取信号名称和数值等关键元素方面的表现。结果显示,基于规则的方法优于NER方法,在具有单一信号的更简单需求中达到了95%的准确率;而利用SVM和其他机器学习算法的NER方法达到了77.3%的准确率,但在复杂场景中表现不佳。统计分析证实,与人工方法相比,基于规则的方法显著提升了效率和准确性。本研究突出了NLP驱动的自动化在改善质量保证、减少人工工作量和加速测试用例生成方面的潜力,未来的工作将集中于改进NER和混合模型以处理更大的复杂性。

英文摘要:

Automating test case specification generation is vital for improving the efficiency and accuracy of software testing, particularly in complex systems like high-performance Electronic Control Units (ECUs). This study investigates the use of Natural Language Processing (NLP) techniques, including Rule-Based Information Extraction and Named Entity Recognition (NER), to transform natural language requirements into structured test case specifications. A dataset of 400 feature element documents from the Polarion tool was used to evaluate both approaches for extracting key elements such as signal names and values. The results reveal that the Rule-Based method outperforms the NER method, achieving 95% accuracy for more straightforward requirements with single signals, while the NER method, leveraging SVM and other machine learning algorithms, achieved 77.3% accuracy but struggled with complex scenarios. Statistical analysis confirmed that the Rule-Based approach significantly enhances efficiency and accuracy compared to manual methods. This research highlights the potential of NLP-driven automation in improving quality assurance, reducing manual effort, and expediting test case generation, with future work focused on refining NER and hybrid models to handle greater complexity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑