arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2504.00513cs.SEcs.AI
收藏

在AI系统中利用LLM生成用户故事:UStAI数据集

Leveraging LLMs for User Stories in AI Systems: UStAI Dataset

King Fahd University of Petroleum and Minerals(国王法赫德石油和矿产大学)

Asma Yamani, Malak Baslyman, Moataz Ahmed

AI总结:

本文研究利用LLMs基于学术论文摘要为AI系统生成用户故事,通过QUS框架评估了三种LLMs生成的1260个用户故事,并发布了UStAI数据集以辅助早期需求获取。

摘要:

AI系统在各个行业和领域正获得广泛应用。创建高质量的AI系统需求对于使AI系统与业务目标和消费者价值保持一致以及履行社会责任至关重要。然而,由于AI系统的不确定性和对敏感数据的严重依赖,需要更多研究来解决AI系统需求的获取和分析问题。由于许多AI系统具有专有性质,缺乏用于AI系统的开源需求工件和技术需求文档,限制了更广泛的研究和调查。随着大型语言模型(LLMs)成为人类生成文本的一种有前途的替代方案,本文研究了基于学术论文摘要使用LLMs为AI系统生成用户故事的潜在用途。我们使用三种LLMs进行了实证评估,从26个领域的42篇摘要中生成了1260个用户故事。我们使用Quality User Story (QUS)框架评估其质量。此外,我们识别了相关的非功能性需求(NFRs)和伦理原则。我们的分析表明,所研究的LLMs能够生成受各种利益相关者需求启发的用户故事,为研究生成用户故事以及辅助AI系统的早期需求获取阶段提供了一种有前途的方法。我们将各种LLMs生成的故事集合编译并整理成一个数据集(UStAI),现已公开发布供使用。

英文摘要:

AI systems are gaining widespread adoption across various sectors and domains. Creating high-quality AI system requirements is crucial for aligning the AI system with business goals and consumer values and for social responsibility. However, with the uncertain nature of AI systems and the heavy reliance on sensitive data, more research is needed to address the elicitation and analysis of AI systems requirements. With the proprietary nature of many AI systems, there is a lack of open-source requirements artifacts and technical requirements documents for AI systems, limiting broader research and investigation. With Large Language Models (LLMs) emerging as a promising alternative to human-generated text, this paper investigates the potential use of LLMs to generate user stories for AI systems based on abstracts from scholarly papers. We conducted an empirical evaluation using three LLMs and generated $1260$ user stories from $42$ abstracts from $26$ domains. We assess their quality using the Quality User Story (QUS) framework. Moreover, we identify relevant non-functional requirements (NFRs) and ethical principles. Our analysis demonstrates that the investigated LLMs can generate user stories inspired by the needs of various stakeholders, offering a promising approach for generating user stories for research purposes and for aiding in the early requirements elicitation phase of AI systems. We have compiled and curated a collection of stories generated by various LLMs into a dataset (UStAI), which is now publicly available for use.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑