PhiZero：基于物理语言构建的世界模型
PhiZero: A World Model Built Around Physical Language
浏览论文内容
中文总结 AI 辅助
该研究提出围绕物理语言构建的PhiZero世界模型，采用先推理再渲染的范式，经实验验证其可建模物理连贯的世界演化，还具备交互式世界建模等应用潜力。
中文摘要 AI 辅助
我们提出PhiZero，这是一种围绕物理语言构建的物理世界模型，物理语言是一种紧凑的离散表示，用于表征世界状态的转换。现有的物理世界模型通常直接在像素空间中预测未来视频，将潜在的世界动力学隐含在高维视觉预测器中。受人类从视觉经验中抽象预测结构并将其组织成自然语言以进行显式推理的能力启发，我们通过自监督从野外视频中学习物理语言，并利用它显式推理物理世界的演化方式。因此，PhiZero采用“先推理再渲染”的范式：它首先将未来世界演化推断为物理语言序列，然后将推断出的转换渲染为视频。在生成和理解基准上进行的大量实验验证了PhiZero对物理上连贯的世界演化进行建模的能力。我们进一步展示了其在逼真交互式世界建模、细粒度动作条件模拟以及零样本运动迁移方面的潜力。
英文摘要
We introduce PhiZero, a physical world model built around physical language, a compact discrete representation of world-state transitions. Existing physical world models typically predict future videos directly in pixel space, leaving the underlying world dynamics implicit within high-dimensional visual predictors. Motivated by humans' ability to abstract predictive structure from visual experience and organize it in natural language for explicit reasoning, we learn physical language from in-the-wild videos through self-supervision and use it to explicitly reason about how the physical world evolves. Accordingly, PhiZero adopts a reason-then-render paradigm: it first infers future world evolution as a physical-language sequence and then renders the inferred transitions into videos. Extensive experiments across generation and understanding benchmarks validate the ability of PhiZero to model physically coherent world evolution. We further show its potential for realistic and interactive world modeling, fine-grained action-conditioned simulation, and zero-shot motion transfer.
发表机构
- NLPR, Institute of Automation, Chinese Academy of Sciences (CASIA)（中国科学院自动化研究所NLPR）
机构由 AI 辅助整理，请以论文原文为准。
