StoryBlender: 具有时空动态的跨镜头一致且可编辑的3D分镜
StoryBlender: Inter-Shot Consistent and Editable 3D Storyboard with Spatial-temporal Dynamics
AI总结：
StoryBlender通过三阶段流程实现跨镜头一致性和可编辑性，结合语义空间接地、资产材料化和时空动态，提升3D分镜生成的连续性和编辑精度。
摘要：
分镜是电影、动画和游戏视觉叙事的核心技能。然而，自动化该过程需要同时满足跨镜头一致性和显式可编辑性，而现有方法难以兼顾。本文提出StoryBlender，基于故事中心的反射方案，通过语义空间接地、资产材料化和时空动态三阶段流程，构建连续性记忆图以实现长周期一致性，通过统一坐标空间实例化实体以保持视觉身份，并利用视觉指标实现布局设计和电影演进。通过在验证循环中分层协调多个代理，StoryBlender通过引擎验证反馈迭代修正空间幻觉。生成的原生3D场景支持直接精确编辑相机和视觉资产，同时保持多镜头连续性。实验表明，StoryBlender在扩散模型和3D基础线性基线中显著提升了一致性和可编辑性。代码、数据和演示视频将在https://engineeringai-lab.github.io/StoryBlender/上提供。
英文摘要：
Storyboarding is a core skill in visual storytelling for film, animation, and games. However, automating this process requires a system to achieve two properties that current approaches rarely satisfy simultaneously: inter-shot consistency and explicit editability. While 2D diffusion-based generators produce vivid imagery, they often suffer from identity drift along with limited geometric control; conversely, traditional 3D animation workflows are consistent and editable but require expert-heavy, labor-intensive authoring. We present StoryBlender, a grounded 3D storyboard generation framework governed by a Story-centric Reflection Scheme. At its core, we propose the StoryBlender system, which is built on a three-stage pipeline: (1) Semantic-Spatial Grounding, to construct a continuity memory graph to decouple global assets from shot-specific variables for long-horizon consistency; (2) Canonical Asset Materialization, to instantiate entities in a unified coordinate space to maintain visual identity; and (3) Spatial-Temporal Dynamics, to achieve layout design and cinematic evolution through visual metrics. By orchestrating multiple agents in a hierarchical manner within a verification loop, StoryBlender iteratively self-corrects spatial hallucinations via engine-verified feedback. The resulting native 3D scenes support direct, precise editing of cameras and visual assets while preserving unwavering multi-shot continuity. Experiments demonstrate that StoryBlender significantly improves consistency and editability over both diffusion-based and 3D-grounded baselines. Code, data, and demonstration video are available on https://engineeringai-lab.github.io/StoryBlender/
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
