探索在一家 IT 咨询公司中使用 LLM 进行需求规格说明
Exploring the Use of LLMs for Requirements Specification in an IT Consulting Company
AI总结:
本文在 IT 咨询场景中评估三种 LLM 基于需求摘要和 FDS 模板生成功能设计规格说明的效果,证明其可提效标准化,但仍需人工监督与修订。
摘要:
在实践中,需求规格说明仍然是一项关键挑战。生成规格说明所需的知识往往分散在多种来源中(例如会议纪要、电子邮件和高层产品描述),使该过程繁琐且耗时。本文报告了我们在一家 IT 咨询公司中使用大型语言模型(LLM)自动化需求规格说明流程的经验。在该公司中,需求通过功能设计规格说明(FDS)来描述,这是一种概述系统、应用程序或流程的功能需求和特性的文档。我们向 LLM 提供需求获取文档摘要和 FDS 模板,提示它们生成 Epic FDS(包括高层产品描述)和用户故事,随后将这些内容汇编成完整的 FDS 文档。我们将三个最先进 LLM 生成的 FDS 的正确性和质量与人类分析师产出的 FDS 进行了比较。结果表明,LLM 可以帮助实现需求规格说明的自动化和标准化,减少时间与人力投入。然而,LLM 生成的 FDS 的质量高度依赖输入,并且通常需要人工修订。因此,我们倡导一种协同方法:LLM 作为高效的起草工具,而人类分析师提供高质量需求工程(RE)文档所需的关键上下文和技术监督。
英文摘要:
In practice, requirements specification remains a critical challenge. The knowledge necessary to generate a specification can often be fragmented across diverse sources (e.g., meeting minutes, emails, and high-level product descriptions), making the process cumbersome and time-consuming. In this paper, we report our experience using large language models (LLMs) in an IT consulting company to automate the requirements specification process. In this company, requirements are specified using a Functional Design Specification (FDS), a document that outlines the functional requirements and features of a system, application, or process. We provide LLMs with a summary of the requirements elicitation documents and FDS templates, prompting them to generate Epic FDS (including high-level product descriptions) and user stories, which are subsequently compiled into a complete FDS document. We compared the correctness and quality of the FDS generated by three state-of-the-art LLMs against those produced by human analysts. Our results show that LLMs can help automate and standardize the requirements specification, reducing time and human effort. However, the quality of LLM-generated FDS highly depends on inputs and often requires human revision. Thus, we advocate for a synergistic approach in which an LLM serves as an effective drafting tool while human analysts provide the critical contextual and technical oversight necessary for high-quality requirements engineering (RE) documentation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。