Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and evolutionary algorithms (EAs), despite differing in objectives and methodologies, share a common pursuit of applicability in complex problems. Meanwhile, EA can provide an optimization framework for LLM's further enhancement under black-box settings, empowering LLM with flexible global search capacities. On the other hand, the abundant domain knowledge inherent in LLMs could enable EA to conduct more intelligent searches. Furthermore, the text processing and generative capabilities of LLMs would aid in deploying EAs across a wide range of tasks. Based on these complementary advantages, this paper provides a thorough review and a forward-looking roadmap, categorizing the reciprocal inspiration into two main avenues: LLM-enhanced EA and EA-enhanced LLM. Some integrated synergy methods are further introduced to exemplify the complementarity between LLMs and EAs in diverse scenarios, including code generation, software engineering, neural architecture search, and various generation tasks. As the first comprehensive review focused on the EA research in the era of LLMs, this paper provides a foundational stepping stone for understanding the collaborative potential of LLMs and EAs. The identified challenges and future directions offer guidance for researchers and practitioners to unlock the full potential of this innovative collaboration in propelling advancements in optimization and artificial intelligence. We have created a GitHub repository to index the relevant papers: https://github.com/wuxingyu-ai/LLM4EC.
Cold-Start Recommendation towards the Era of Large Language Models (LLMs): A Comprehensive Survey and Roadmap
Institute for Clarity in Documentation(文献信息研究所);Inria Paris-Rocquencourt(法国国家信息与自动化研究所巴黎-罗康库尔中心);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕尔默研究实验室);The Thørväld Group(索沃尔德集团);The Kumquat Consortium(金桔联盟)
Search-Based Software Engineering and AI Foundation Models: Current Landscape and Future Roadmap
Simula Research Laboratory(Simula研究实验室);National Institute of Informatics(日本信息机构);Kristiania University of Applied Sciences and Oslo Metropolitan University(克里斯蒂安尼亚应用科学大学和奥斯陆 Metropolitan 大学)
Evaluation and Facilitation of Online Discussions in the LLM Era: A Survey
Archimedes, Athena Research Center(阿希米德研究中心);Athens University of Economics and Business(雅典经济与商业大学);École Normale Supérieure Paris-Saclay(巴黎萨克雷高等师范学校);INSEAD
A Comprehensive Survey on Linguistic Steganography: Methods, Countermeasures, Evaluation, and Challenges
Graduate School of Informatics, Kyoto University(京都大学信息学研究科);School of Cyberspace Security, Beijing University of Posts and Telecommunications(北京邮电大学网络空间安全学院)
An Evolutionary Large Language Model for Hallucination Mitigation
BIOSTIM Laboratory Faculty of Medicine Salah Boubnider University Constantine, Algeria(BIOSTIM实验室医学院萨拉赫·布宾德大学阿尔及利亚科纳克特);Department of IFA Faculty of NTIC Abdelhamid Mehri University Constantine, Algeria(IFA部门NTIC学院阿卜杜勒哈米德·梅赫里大学阿尔及利亚科纳克特)
Evolutionary Computation and Explainable AI: A Roadmap to Understandable Intelligent Systems
Queen’s University(女王大学);Newcastle University(纽卡斯尔大学);University of Stirling(斯特灵大学);University of Parma(帕尔马大学);Robert Gordon University(罗伯特戈登大学);University of Trento(特伦托大学);Universiteit Leiden(莱顿大学);University of Exeter(埃克塞特大学)
From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms
Hong Kong Baptist University(香港 Baptist 大学);South China Normal University(南方中国师范大学);Hong Kong University of Science and Technology(香港科学与技术大学);National University of Singapore(新加坡国立大学);University of Science and Technology Beijing(北京科技大学)
Evolutionary Computation for Trustworthy AI: From Attacks and Defenses to Self-Evolving Era
Nanyang Technological University, Singapore(南洋理工大学);Center for Frontier AI Research, Institute of High Performance Computing, A*STAR, Singapore(新加坡国立研究科学院前沿人工智能研究中心高性能计算研究所);Google(谷歌);Sichuan University, China(四川大学);Lingnan University, Hong Kong, China(岭南大学)
Evolutionary Computation: A Paradigm of Natural Generative AI and Creative Synthesis
Centre for Frontier AI Research (CFAR), Agency for Science, Technology and Research (A*STAR), Singapore(前沿人工智能研究中心(CFAR),科技研究局(A*STAR),新加坡);School of Mechanical Sciences, Indian Institute of Technology (IIT) Goa(机械科学学院,印度理工学院(IIT) Goa);School of Computer Science and Technology, Dalian University of Technology (DLUT)(计算机科学与技术学院,大连理工大学);College of Computing and Data Science (CCDS), Nanyang Technological University (NTU)(计算与数据科学学院(CCDS),南洋理工大学);Honda Research Institute Europe (HRI-EU), Offenbach am Main, Germany(本田欧洲研究院(HRI-EU),德国Offenbach am Main);Data Science and Artificial Intelligence Research Centre, School of Computer Science and Engineering, Nanyang Technological University (NTU)(数据科学与人工智能研究中心,计算机科学与工程学院,南洋理工大学)