利用生成式代码优化学习游戏博弈智能体
Learning Game-Playing Agents with Generative Code Optimization
AI总结:
本文提出用大语言模型将游戏策略表示为可自我演化的 Python 代码,通过执行轨迹与自然语言反馈优化智能体,在 Atari 游戏上以更少训练时间和环境交互达到与深度强化学习基线相当的性能。
摘要:
我们提出了一种用于学习游戏博弈智能体的生成式优化方法,其中策略被表示为 Python 程序,并利用大语言模型(LLMs)进行优化。我们的方法将决策策略视为可自我演化的代码,以当前观测作为输入,以游戏内动作作为输出,使智能体能够通过执行轨迹和自然语言反馈实现自我改进,且仅需极少的人工干预。在 Atari 游戏上的应用中,我们的游戏博弈 Python 程序取得了与深度强化学习(RL)基线相当的性能,同时显著减少了训练时间和环境交互次数。本工作凸显了程序化策略表示在构建高效、可适应且具备复杂长时程推理能力的智能体方面的前景。
英文摘要:
We present a generative optimization approach for learning game-playing agents, where policies are represented as Python programs and refined using large language models (LLMs). Our method treats decision-making policies as self-evolving code, with current observation as input and an in-game action as output, enabling agents to self-improve through execution traces and natural language feedback with minimal human intervention. Applied to Atari games, our game-playing Python program achieves performance competitive with deep reinforcement learning (RL) baselines while using significantly less training time and much fewer environment interactions. This work highlights the promise of programmatic policy representations for building efficient, adaptable agents capable of complex, long-horizon reasoning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。