Language Model Evolutionary Algorithms for Recommender Systems: Benchmarks and Algorithm Comparisons
Nanyang Technological University(南洋理工大学);Singapore University of Technology and Design(新加坡科技设计大学);Centre for Frontier AI Research, A*STAR(前沿人工智能研究中心,A*STAR);Institute of High Performance Computing, A*STAR(高性能计算研究所,A*STAR)
Jiao Liu, Zhu Sun, Shanshan Feng, Caishun Chen, Yew-Soon Ong
In the evolutionary computing community, the remarkable language-handling capabilities and reasoning power of large language models (LLMs) have significantly enhanced the functionality of evolutionary algorithms (EAs), enabling them to tackle optimization problems involving structured language or program code. Although this field is still in its early stages, its impressive potential has led to the development of various LLM-based EAs. To effectively evaluate the performance and practical applicability of these LLM-based EAs, benchmarks with real-world relevance are essential. In this paper, we focus on LLM-based recommender systems (RSs) and introduce a benchmark problem set, named RSBench, specifically designed to assess the performance of LLM-based EAs in recommendation prompt optimization. RSBench emphasizes session-based recommendations, aiming to discover a set of Pareto optimal prompts that guide the recommendation process, providing accurate, diverse, and fair recommendations. We develop three LLM-based EAs based on established EA frameworks and experimentally evaluate their performance using RSBench. Our study offers valuable insights into the application of EAs in LLM-based RSs. Additionally, we explore key components that may influence the overall performance of the RS, providing meaningful guidance for future research on the development of LLM-based EAs in RSs. The source code of the proposed RSBench can be found at https://github.com/LiuJ-2023/RSBench/tree/main.
A Pairwise Comparison Relation-assisted Multi-objective Evolutionary Neural Architecture Search Method with Multi-population Mechanism
School of Software, Nanjing University of Information Science and Technology(南京信息工程大学软件学院);Department of Electrical and Computer Engineering, New Jersey Institute of Technology(新泽西理工学院电子与计算机工程系);RIKEN Center for Computational Science (R-CCS)(日本计算科学中心(R-CCS));Department of Computing Sciences, Tampere University(塔尔基大学计算机科学系)
Evolutionary Biparty Multiobjective UAV Path Planning: Problems and Empirical Comparisons
Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies, School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(广东省新型安全智能技术重点实验室,哈尔滨工业大学计算机科学与技术学院,深圳);Peng Cheng Laboratory(鹏城实验室);School of Artificial Intelligence/School of Future Technology, Nanjing University of Information Science and Technology(人工智能学院/未来技术学院,南京信息科学技术大学)
A Novel Training Protocol for Performance Predictors of Evolutionary Neural Architecture Search Algorithms
College of Computer Science, Sichuan University(四川大学计算机学院);Zhizhe Information Technology Services Company Limited(智哲信息技术服务有限公司);School of Electrical and Computer Engineering, Oklahoma State University(俄克拉荷马州立大学电气与计算机工程学院)