Game-Theoretic Co-Evolution for LLM-Based Heuristic Discovery
C2DL, Institute of Automation, Chinese Academy of Sciences(C2DL,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);Tsinghua University(清华大学)
Xinyi Ke, Kai Li, Junliang Xing, Yifan Zhang, Jian Cheng
Large language models (LLMs) have enabled rapid progress in automatic heuristic discovery (AHD), yet most existing methods are predominantly limited by static evaluation against fixed instance distributions, leading to potential overfitting and poor generalization under distributional shifts. We propose Algorithm Space Response Oracles (ASRO), a game-theoretic framework that reframes heuristic discovery as a program level co-evolution between solver and instance generator. ASRO models their interaction as a two-player zero-sum game, maintains growing strategy pools on both sides, and iteratively expands them via LLM-based best-response oracles against mixed opponent meta-strategies, thereby replacing static evaluation with an adaptive, self-generated curriculum. Across multiple combinatorial optimization domains, ASRO consistently outperforms static-training AHD baselines built on the same program search mechanisms, achieving substantially improved generalization and robustness on diverse and out-of-distribution instances.
VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problems
Bielefeld University(比勒菲尔德大学);Radical Numerics;KAIST(韩国科学技术院);Peking University(北京大学);University of Turin(都灵大学);Stanford University(斯坦福大学);RIKEN(日本研究机构);Omelet;University of Vienna(维也纳大学)
G-LNS: Generative Large Neighborhood Search for LLM-Based Automatic Heuristic Design
Software College, Northeastern University(东北大学软件学院);International Centre for Theoretical Physics Asia-Pacific, University of Chinese Academy of Sciences(中国科学院大学国际理论物理亚太中心);Taiji Laboratory for Gravitational Wave Universe, University of Chinese Academy of Sciences(中国科学院大学太极引力波宇宙实验室);Tsinghua University(清华大学)
Helsinki Institute for Information Technology HIIT(赫尔辛基信息技术研究所);CSC and Scilifelab(CSC和生命科学实验室);Department of Computer Science Royal Institute of Technology (KTH)(皇家理工学院计算机科学系);University of Helsinki(赫尔辛基大学)