arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.06505cs.SE
收藏

基于大型语言模型的多语言众包需求工程

Multilingual Crowd-Based Requirements Engineering Using Large Language Models

Arthur Pilone, Paulo Meirelles, Fabio Kon, Walid Maalej

AI总结:

提出基于大语言模型的DeeperMatcher方法,帮助敏捷团队匹配问题与用户评论,实现多语言众包需求工程,并在英文和巴西葡萄牙语数据上初步验证,准确性依赖文本嵌入方法。

摘要:

确保软件项目成功的一个核心挑战是保证开发者与用户观点的趋同。尽管从社交媒体、应用商店评论和支持渠道获取大量用户数据带来了诸多益处,但软件开发团队如何有效利用这些数据仍不明确。我们提出了一种名为DeeperMatcher的基于大语言模型(LLM)的方法,帮助敏捷团队在问题与任务管理中应用众包需求工程(CrowdRE)。我们目前正在实现一个命令行工具,使开发者能够将问题与相关的用户评论进行匹配。我们在一个知名开源项目的现有英文数据集上验证了我们的方法。此外,为了检验DeeperMatcher在其他语言上的表现,我们与一个本地项目的开发者一起进行了单案例机制实验,该项目的问题和用户反馈使用巴西葡萄牙语。我们的初步分析表明,我们方法的准确性高度依赖于所使用的文本嵌入方法。我们讨论了实现可靠的多语言众包需求工程所需的进一步改进。

英文摘要:

A central challenge for ensuring the success of software projects is to assure the convergence of developers' and users' views. While the availability of large amounts of user data from social media, app store reviews, and support channels bears many benefits, it still remains unclear how software development teams can effectively use this data. We present an LLM-powered approach called DeeperMatcher that helps agile teams use crowd-based requirements engineering (CrowdRE) in their issue and task management. We are currently implementing a command-line tool that enables developers to match issues with relevant user reviews. We validated our approach on an existing English dataset from a well-known open-source project. Additionally, to check how well DeeperMatcher works for other languages, we conducted a single-case mechanism experiment alongside developers of a local project that has issues and user feedback in Brazilian Portuguese. Our preliminary analysis indicates that the accuracy of our approach is highly dependent on the text embedding method used. We discuss further refinements needed for reliable crowd-based requirements engineering with multilingual support.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑