arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2308.10620cs.SEcs.AI
收藏

面向软件工程的大语言模型:一项系统性文献综述

Large Language Models for Software Engineering: A Systematic Literature Review

Huazhong University of Science and Technology(华中科技大学);Monash University(莫纳什大学);Singapore Management University(新加坡管理大学);Beihang University(北京航空航天大学);The Hong Kong Polytechnic University(香港理工大学)

Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, Haoyu Wang

AI总结:

本文通过系统性综述395篇论文,梳理LLM在软件工程中的模型、数据、优化评估方法及成功任务,并指出研究空白与未来方向。

摘要:

大语言模型(LLMs)已显著影响包括软件工程(SE)在内的众多领域。近期许多出版物探索了将LLMs应用于各种SE任务。然而,对LLMs在SE中的应用、效果及可能局限性的全面理解仍处于早期阶段。为弥合这一差距,我们针对LLM4SE开展了一项系统性文献综述(SLR),重点关注如何利用LLMs优化流程和成果。我们筛选并分析了2017年1月至2024年1月期间的395篇研究论文,以回答四个关键研究问题(RQs)。在RQ1中,我们对SE任务中采用的不同LLMs进行分类,刻画其独特特征与用途。在RQ2中,我们分析数据收集、预处理和应用所使用的方法,强调精心整理的数据集对成功实施面向SE的LLM的作用。RQ3调查用于优化和评估LLMs在SE中性能的策略。最后,RQ4考察迄今为止LLMs已取得成功的具体SE任务,说明其对该领域的实际贡献。基于这些RQs的答案,我们讨论当前最先进水平与趋势,指出现有研究中的空白,并标示未来研究中有前景的方向。我们的制品公开发布于https://github.com/xinyi-hou/LLM4SE_SLR。

英文摘要:

Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the application, effects, and possible limitations of LLMs on SE is still in its early stages. To bridge this gap, we conducted a systematic literature review (SLR) on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes. We select and analyze 395 research papers from January 2017 to January 2024 to answer four key research questions (RQs). In RQ1, we categorize different LLMs that have been employed in SE tasks, characterizing their distinctive features and uses. In RQ2, we analyze the methods used in data collection, preprocessing, and application, highlighting the role of well-curated datasets for successful LLM for SE implementation. RQ3 investigates the strategies employed to optimize and evaluate the performance of LLMs in SE. Finally, RQ4 examines the specific SE tasks where LLMs have shown success to date, illustrating their practical contributions to the field. From the answers to these RQs, we discuss the current state-of-the-art and trends, identifying gaps in existing research, and flagging promising areas for future study. Our artifacts are publicly available at https://github.com/xinyi-hou/LLM4SE_SLR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑