发表机构
Alaya Lab（Alaya实验室）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
提出PROWBench基准，含170个程序化情节和600个代理视频，通过可重放世界记录和双VLM指标评估视频模型对程序指定事件、实体控制及长时记忆的视觉遵循度。
AI 中文摘要
可编程世界模型将可执行的动力学与视觉生成分离，为下一代游戏引擎提供了有前景的基础。然而，它们对显式规则和交互的视觉遵循程度仍未得到充分评估。现有基准评估视觉质量、可控性以及指令或物理遵循性，但很少测试对细粒度、程序指定的世界事件的忠实度。我们引入了PROWBench，包含170个程序化构建的情节和600个代理视频，涵盖多样化的场景和交互。PROWBench将实体状态和时间戳事件（包括摄像机视野之外的事件）记录为可重放的世界记录，并从中渲染同步视图和代理表示。这使得生成的视频能够对照程序执行的可观察结果进行检查。一个可扩展的框架构建场景、控制行为，并可以以不同表示（如粗略3D和边界框）渲染每个摄像机视图。该基准涵盖第一人称和第三人称视角，并为部分情节提供同步多视图观察。基于这些记录，PROWBench评估实体控制、长时记忆，并通过两个基于VLM的指标——逻辑渲染对齐和交互成功率——来评估对规定时间线的遵循以及时间戳引擎记录事件的视觉实现。
英文摘要
Programmable world models separate executable dynamics from visual generation, offering a promising foundation for next-generation game engines. However, their visual adherence to explicit rules and interactions remains insufficiently evaluated. Existing benchmarks assess visual quality, controllability, and instruction or physical adherence, but rarely test fidelity to fine-grained, program-specified world events. We introduce PROWBench, comprising 170 programmatically constructed episodes and 600 proxy videos covering diverse scenes and interactions. PROWBench logs entity states and timestamped events, including those outside the camera's field of view, as replayable world records, from which it renders synchronized views and proxy representations. This enables generated videos to be checked against the observable consequences of program execution. An extensible framework constructs scenes, controls behaviors, and can render each camera view in different representations, such as coarse 3D, and bounding boxes. The benchmark covers first- and third-person perspectives, with synchronized multi-view observations available for a subset of episodes. Grounded in these records, PROWBench evaluates entity control, long-horizon memory, and, with two VLM-based metrics, Logic-Render Alignment and Interaction Success Rate, adherence to the prescribed timeline and the visual realization of timestamped engine-recorded events.
CommentsProject page: https://alaya-lab.github.io/PROWBench
