面向软件工程的高效绿色大语言模型:文献综述、愿景与未来之路
Efficient and Green Large Language Models for Software Engineering: Literature Review, Vision, and the Road Ahead
AI总结:
本文综述 LLM4SE 发展,指出其效率与环境成本问题,提出高效绿色化愿景、研究路线图及潜在解决方案。
摘要:
大语言模型(LLM)近期在各类软件工程任务中展现出卓越能力,推动了面向软件工程的大语言模型(LLM4SE)领域的快速发展。然而,目前对开发高效 LLM4SE 技术和绿色 LLM4SE 解决方案的关注仍然有限:前者要求最低的计算成本、时间和内存资源,后者则旨在减少能源消耗、水资源使用和碳排放。本文旨在将研究界的关注点重新引向 LLM4SE 的效率与绿色化,同时分享实现这一目标的潜在研究方向。文章首先简要概述 LLM4SE 的重要性,并强调对高效、绿色 LLM4SE 解决方案的需求。随后,论文提出了一个未来愿景:高效且绿色的 LLM4SE 将彻底变革基于 LLM 的软件工程工具格局,使工业界、个体从业者和社会等各类利益相关者受益。接着,文章描绘了未来研究路线图,概述了可供研究界探索的具体研究路径和潜在解决方案。尽管本文并非一份确定性指南,但其目标是激发进一步进展,最终将高效、绿色的 LLM4SE 确立为软件工程未来的核心要素。
英文摘要:
Large Language Models (LLMs) have recently shown remarkable capabilities in various software engineering tasks, spurring the rapid growth of the Large Language Models for Software Engineering (LLM4SE) area. However, limited attention has been paid to developing efficient LLM4SE techniques that demand minimal computational cost, time, and memory resources, as well as green LLM4SE solutions that reduce energy consumption, water usage, and carbon emissions. This paper aims to redirect the focus of the research community towards the efficiency and greenness of LLM4SE, while also sharing potential research directions to achieve this goal. It commences with a brief overview of the significance of LLM4SE and highlights the need for efficient and green LLM4SE solutions. Subsequently, the paper presents a vision for a future where efficient and green LLM4SE revolutionizes the LLM-based software engineering tool landscape, benefiting various stakeholders, including industry, individual practitioners, and society. The paper then delineates a roadmap for future research, outlining specific research paths and potential solutions for the research community to pursue. While not intended to be a definitive guide, the paper aims to inspire further progress, with the ultimate goal of establishing efficient and green LLM4SE as a central element in the future of software engineering.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。