设计基于大语言模型的多智能体系统用于软件工程任务:质量属性、设计模式与理由
Designing LLM-based Multi-Agent Systems for Software Engineering Tasks: Quality Attributes, Design Patterns and Rationale
AI总结:
本文研究了基于大语言模型的多智能体系统在软件工程任务中的设计,发现代码生成是最常见任务,功能性适应性是主要关注的质量属性,基于角色的合作是最常用的设计模式,提高生成代码质量是主要设计动机。
摘要:
随着软件工程(SE)任务的复杂性持续增加,多智能体系统(MASs)因其自主性和可扩展性而成为研究和实践的焦点。此外,通过利用大语言模型(LLMs)的推理和规划能力,基于LLMs的MASs在软件工程领域的应用正受到越来越多的关注。然而,目前尚无专门研究系统地探讨基于LLMs的MASs的设计,包括设计者主要关注的质量属性(QAs)、使用的设计模式以及指导设计LLMs-MASs用于SE任务的理性。为此,我们进行了一项研究,以识别LLMs-MASs用于SE任务所关注的质量属性、MASs中使用的模式以及MASs的设计理由。我们收集了94篇关于LLMs-MASs用于SE任务的论文作为来源。我们的研究表明:(1)在识别出的十种SE任务中,代码生成是LLMs-MASs最常解决的任务;(2)功能性适应性是LLMs-MASs设计者最关注的质量属性;(3)基于角色的合作是16种用于构建LLMs-MASs的设计模式中最常使用的模式;(4)提高生成代码的质量是LLMs-MASs设计背后最常见的理由。基于研究结果,我们提出了对设计LLMs-MASs以支持SE任务的启示。
英文摘要:
As the complexity of Software Engineering (SE) tasks continues to escalate, Multi-Agent Systems (MASs) have emerged as a focal point of research and practice due to their autonomy and scalability. Furthermore, through leveraging the reasoning and planning capabilities of Large Language Models (LLMs), the application of LLM-based MASs in the field of SE is garnering increasing attention. However, there is no dedicated study that systematically explores the design of LLM-based MASs, including the Quality Attributes (QAs) on which designers mainly focus, the design patterns used by designers, and the rationale guiding the design of LLM-based MASs for SE tasks. To this end, we conducted a study to identify the QAs that LLM-based MASs for SE tasks focus on, the design patterns used in the MASs, and the design rationale for the MASs. We collected 106 papers on LLM-based MASs for SE tasks as the source. Our study shows that: (1) Code Generation is the most common SE task solved by LLM-based MASs among ten identified SE tasks, (2) Functional Suitability is the QA on which designers of LLM-based MASs pay the most attention, (3) Role-Based Cooperation is the design pattern most frequently employed among 16 patterns used to construct LLM-based MASs, and (4) Improving the Quality of Generated Code is the most common rationale behind the design of LLM-based MASs. Building on the study results, we presented the implications for the design of LLM-based MASs to support SE tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。