发表机构
KAIST AI（韩国科学技术院人工智能）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本文提出世界观察者，通过联合生成演员与全景观察者解耦观察与行动，实现持久世界建模，显著提升视野外动态，同时保持视觉保真度与3D一致性。
AI 中文摘要
世界模型如何持续观察演员当前视野之外的区域？视频世界模型模拟环境如何根据智能体的动作演变，但仍然是演员中心的。一旦物体离开演员的视野，它们就失去了对其演变的直接证据，往往在重新进入时无法保留其状态和动态。为了解决这个问题，我们引入了世界观察者，它通过联合生成一个用于智能体中心视图的透视演员和一个或多个观察选定世界区域的全景观察者，将观察与行动解耦。这使得离开演员视野的物体能够在观察者中持续视觉演变，因此当它们重新进入时，其更新状态得以反映。我们通过从共享的全景源进行扭曲来为演员和观察者提供明确的几何对应关系，并引入一个高分辨率透视参考的观察者汇，以在重新进入时恢复精细外观。由于观察者与演员解耦，它们可以自由放置在场景中，扩展到多个位置以实现更广泛的覆盖，并由控制信号驱动以引导视野外的演变。为了评估视野外的演变，我们进一步引入了世界空间指标和一个涵盖真实和合成场景的基准。世界观察者显著改善了视野外的动态，同时在视觉保真度、相机控制和3D一致性方面保持竞争力。
英文摘要
How can a world model continuously observe regions beyond the actor's current view? Video world models simulate how an environment evolves from an agent's actions, yet remain actor-centric. Once an object leaves the actor's view, they lose direct evidence of its evolution, often failing to preserve its state and dynamics upon re-entry. To address this, we introduce World Observer, which decouples observing from acting by jointly generating a perspective actor for the agent-centric view with one or more panoramic observers that watch selected world regions. This allows objects that leave the actor's view to remain visually evolving in an observer, so their updated states are reflected when they re-enter. We ground the actor and observers by warping from a shared panoramic source for explicit geometric correspondence, and introduce an Observer Sink of high-resolution perspective references to restore fine appearance upon re-entry. Since the observers are decoupled from the actor, they can be placed freely across the scene, extended to multiple locations for broader coverage, and driven by control signals to steer out-of-view evolution. To evaluate out-of-view evolution, we further introduce world-space metrics and a benchmark spanning real and synthetic scenes. World Observer substantially improves out-of-view dynamics while remaining competitive in visual fidelity, camera control, and 3D adherence.
