StatePlay：用于机制一致性生成的状态感知游戏世界模型
StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation
浏览论文内容
中文总结 AI 辅助
本文提出StatePlay，一种状态感知游戏世界模型，采用混合Transformer架构联合预测视觉内容与游戏状态，经实验验证可提升游戏生成的机制保真度。
中文摘要 AI 辅助
现有的游戏世界模型可基于玩家动作生成视觉逼真且具交互性的环境，但游戏并非仅由像素定义，其受显式机制（即控制生命值减少、技能激活、游戏终止的状态依赖规则）支配。这些机制依赖生命值、技能条、计时器等精确内部状态，与视觉观测紧密耦合并决定游戏玩法的演变。若不建模这些状态动态，现有游戏世界模型可能生成视觉合理的滚动序列，却违反底层游戏规则。本文提出StatePlay，一种新型状态感知游戏世界模型，联合预测视觉内容与游戏状态以促进机制一致性生成。StatePlay采用混合Transformer（MoT）风格架构，保留专门的视觉与状态表示，同时支持跨模态交互，使预测状态能引导帧生成；各分支还采用适配其模态的不同目标进行优化。实验表明，StatePlay的状态预测平均归一化L1距离低于0.06，且与无显式状态建模的模型相比，所提方法将生成游戏滚动序列的机制保真度提升了18.6%。总体而言，本研究凸显了状态感知游戏世界建模的重要性，推动了从像素级逼真度向完整且机制忠实的游戏生成的进步。
英文摘要
Recent game world models can generate visually realistic and interactive environments conditioned on player actions. However, games are not defined by pixels alone; they are governed by explicit mechanics, namely state-dependent rules that control health reduction, skill activation, and game termination. These mechanics depend on precise internal states, such as health points, skill meters, and timers, which are tightly coupled with visual observations and determine how gameplay evolves. Without modeling these state dynamics, existing game world models may generate visually plausible rollouts but violate the underlying game rules. In this paper, we propose StatePlay, a novel state-aware game world model that jointly predicts visual content and game states to promote mechanics-consistent generation. StatePlay adopts a mixture-of-transformers (MoT)-style architecture that preserves specialized visual and state representations while enabling cross-modal interaction, allowing predicted states to guide frame generation. Each branch is further optimized with a distinct objective suited to its modality. Experiments show that StatePlay achieves an average normalized L1 distance below 0.06 for state prediction. Furthermore, compared with models without explicit state modeling, our method improves mechanics fidelity in generated game rollouts by 18.6%. Overall, our work highlights the importance of state-aware game world modeling and advances beyond pixel-level realism toward complete and mechanically faithful game generation.
发表机构
- Tencent（腾讯）
机构由 AI 辅助整理，请以论文原文为准。
