arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2609.25652cs.CV

GameDirector:将游戏逻辑与渲染解耦,实现玩家可配置的游戏世界模型

GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Models

发表机构腾讯 · 南洋理工大学 · A*STAR前沿人工智能研究中心
另 1 家 · 查看机构详情
  • Tencent(腾讯)
  • Nanyang Technological University(南洋理工大学)
  • Centre for Frontier AI Research, A*STAR(A*STAR前沿人工智能研究中心)
  • National University of Singapore(新加坡国立大学)

机构由 AI 辅助整理,请以论文原文为准。

Zijun Lin, Zhiyang Deng, Yuzhe Wu, Bihan Wen, Yeying Jin

首次发表
浏览论文内容

中文总结 AI 辅助

GameDirector提出首个智能体框架,将基于规则的玩法逻辑与视觉渲染解耦,通过文本提示引导视频世界模型,实现玩家可配置的游戏机制,并在实验中提升Boss行动质量超过39.9%。

中文摘要 AI 辅助

近期游戏世界模型支持基于玩家输入的真实视觉模拟和交互式游戏玩法。然而,它们通常从像素级监督中学习环境动态,在单一端到端框架内联合建模感知、记忆、状态转换和渲染。虽然这种设计能够实现开放式的、可操作控制的生成,但仍不足以提供完整的游戏体验。游戏由明确的机制支配,如生命值扣除、技能激活、战斗规则和终止条件。这些机制依赖于精确且一致的状态转换,而生成模型本身无法可靠地强制执行。相比之下,游戏引擎可以通过硬编码规则保证此类机制,但为玩家驱动的创作提供的灵活性有限。为弥合这些范式,我们引入了GameDirector,这是首个将基于规则的玩法逻辑与视觉渲染解耦的智能体框架。给定玩家定义的配置,该框架充当智能导演,解释视觉观察、更新游戏状态、战术性地控制NPC并执行游戏规则。然后,它将这些决策转换为文本提示,引导视频世界模型渲染由此产生的游戏画面。这种分离允许玩家像游戏开发者一样配置角色、状态和规则,同时保持连贯的游戏机制。在三个游戏上使用我们自动化游戏智能体收集的数据进行的实验表明,GameDirector实现了准确的状态跟踪、可靠的规则遵循,并在各种端到端游戏世界模型设置上将Boss行动质量提高了超过39.9%。总体而言,通过外部化玩家可控的游戏逻辑,GameDirector在硬编码模拟和生成建模之间建立了中间地带,实现了更灵活和闭环的游戏体验。

英文摘要

Recent game world models support realistic visual simulation and interactive gameplay based on player inputs. However, they typically learn environment dynamics from pixel-level supervision, jointly modeling perception, memory, state transitions, and rendering within a single end-to-end framework. While this design enables open-ended, action-controllable generation, it still falls short of delivering a complete gameplay experience. Games are governed by explicit mechanics, such as health deduction, skill activation, combat rules, and termination conditions. These mechanics depend on precise and consistent state transitions that generative models alone cannot reliably enforce. In contrast, game engines can guarantee such mechanics through hard-coded rules, but provide limited flexibility for player-driven creation. To bridge these paradigms, we introduce GameDirector, the first agentic framework that decouples rule-based gameplay logic from visual rendering. Given player-defined configurations, the framework acts as an intelligent director that interprets visual observations, updates game states, tactically controls NPCs, and enforces gameplay rules. It then translates these decisions into text prompts that guide the video world model to render the resulting gameplay. This separation allows players to configure characters, states, and rules much like a game developer while preserving coherent game mechanics. Experiments on three games, using data collected by our automated gameplay agent, show that GameDirector achieves accurate state tracking, reliable rule following, and improves boss action quality by more than 39.9% over various end-to-end game world model settings. Overall, by externalizing player-controllable game logic, GameDirector establishes a middle ground between hard-coded simulation and generative modeling, enabling more flexible and closed-loop gameplay experiences.

补充信息

↑