arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.10034cs.NEcs.AIcs.CL
收藏

大语言模型时代的进化计算:综述与路线图

Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap

The Hong Kong Polytechnic University(香港理工大学);Chongqing University(重庆大学)

Xingyu Wu, Sheng-hao Wu, Jibin Wu, Liang Feng, Kay Chen Tan

AI总结:

本文综述了大语言模型与进化算法间的互补优势,提出LLM增强EA与EA增强LLM两大方向,并探讨其在代码生成、软件工程等任务中的协同潜力。

摘要:

大语言模型(LLMs)不仅彻底改变了自然语言处理,还将其能力扩展到各个领域,标志着向人工通用智能迈出的重要一步。尽管LLMs与进化算法(EAs)在目标和方法上有所不同,但它们在解决复杂问题的适用性方面有着共同的追求。同时,EA可以为LLM在黑箱设置下的进一步优化提供框架,赋予LLM灵活的全局搜索能力。另一方面,LLM固有的丰富领域知识可以使EA进行更智能的搜索。此外,LLM的文本处理和生成能力将有助于EA在广泛任务中的部署。基于这些互补优势,本文提供了全面的回顾和前瞻性路线图,将相互启发分为两大方向:LLM增强的EA和EA增强的LLM。进一步介绍了一些集成协同方法,以举例说明LLMs和EAs在不同场景中的互补性,包括代码生成、软件工程、神经架构搜索和各种生成任务。作为首个关注LLM时代EA研究的全面综述,本文为理解LLMs和EAs的协作潜力奠定了基石。所识别的挑战和未来方向为研究人员和实践者提供了指导,以释放这种创新协作在推动优化和人工智能进步方面的全部潜力。我们创建了一个GitHub仓库来索引相关论文:https://github.com/wuxingyu-ai/LLM4EC。

英文摘要:

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and evolutionary algorithms (EAs), despite differing in objectives and methodologies, share a common pursuit of applicability in complex problems. Meanwhile, EA can provide an optimization framework for LLM's further enhancement under black-box settings, empowering LLM with flexible global search capacities. On the other hand, the abundant domain knowledge inherent in LLMs could enable EA to conduct more intelligent searches. Furthermore, the text processing and generative capabilities of LLMs would aid in deploying EAs across a wide range of tasks. Based on these complementary advantages, this paper provides a thorough review and a forward-looking roadmap, categorizing the reciprocal inspiration into two main avenues: LLM-enhanced EA and EA-enhanced LLM. Some integrated synergy methods are further introduced to exemplify the complementarity between LLMs and EAs in diverse scenarios, including code generation, software engineering, neural architecture search, and various generation tasks. As the first comprehensive review focused on the EA research in the era of LLMs, this paper provides a foundational stepping stone for understanding the collaborative potential of LLMs and EAs. The identified challenges and future directions offer guidance for researchers and practitioners to unlock the full potential of this innovative collaboration in propelling advancements in optimization and artificial intelligence. We have created a GitHub repository to index the relevant papers: https://github.com/wuxingyu-ai/LLM4EC.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑