数字红皇后:基于大语言模型的Core War中的对抗程序进化
Digital Red Queen: Adversarial Program Evolution in Core War with LLMs
AI总结:
本文提出DRQ算法,利用大语言模型在Core War游戏中通过持续适应变化的目标进化出通用且高效的战士,揭示了动态对抗进化在人工智能系统中的潜力。
摘要:
大型语言模型(LLMs)越来越多地被用于在许多领域中进化解决特定问题的解决方案,这一过程受到生物进化启发。然而,与生物进化不同,大多数LLM进化框架都被建模为静态优化问题,忽略了真实世界进化过程中存在的开放性对抗动态。在此,我们研究了数字红皇后(DRQ),一种简单的自博弈算法,通过持续适应于变化的目标来拥抱所谓的
英文摘要:
Large language models (LLMs) are increasingly being used to evolve solutions to problems in many domains, in a process inspired by biological evolution. However, unlike biological evolution, most LLM-evolution frameworks are formulated as static optimization problems, overlooking the open-ended adversarial dynamics that characterize real-world evolutionary processes. Here, we study Digital Red Queen (DRQ), a simple self-play algorithm that embraces these so-called "Red Queen" dynamics via continual adaptation to a changing objective. DRQ uses an LLM to evolve assembly-like programs, called warriors, which compete against each other for control of a virtual machine in the game of Core War, a Turing-complete environment studied in artificial life and connected to cybersecurity. In each round of DRQ, the model evolves a new warrior to defeat all previous ones, producing a sequence of adapted warriors. Over many rounds, we observe that warriors become increasingly general (relative to a set of held-out human warriors). Interestingly, warriors also become less behaviorally diverse across independent runs, indicating a convergence pressure toward a general-purpose behavioral strategy, much like convergent evolution in nature. This result highlights a potential value of shifting from static objectives to dynamic Red Queen objectives. Our work positions Core War as a rich, controllable sandbox for studying adversarial adaptation in artificial systems and for evaluating LLM-based evolution methods. More broadly, the simplicity and effectiveness of DRQ suggest that similarly minimal self-play approaches could prove useful in other more practical multi-agent adversarial domains, like real-world cybersecurity or combating drug resistance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。