StreamStudio:探索基于流式自回归生成的视频创作
StreamStudio: Exploring Video Authoring with Streaming Autoregressive Generation
AI总结:
StreamStudio是一款即插即用的原型系统,提出将创作控制权从生成后修改转移到与流式视频生成过程持续交互的新范式,可与兼容模型配合,助力更灵活可控的视频创作。
摘要:
我们提出了StreamStudio,这是一个探索流式视频创作新范式的原型系统。创作者无需输入提示词并等待完整视频生成后再进行修改,而是可以在生成过程中与内容交互:引导后续生成内容、返回早期片段、探索不同的延续内容。通过这种方式,StreamStudio将创作控制权从生成后修改转移到与生成过程的持续交互。我们的核心贡献在于这一创作范式以及使流式生成可直接操控的交互机制。StreamStudio被设计为即插即用的界面,可与兼容的生成和编辑模型配合使用,使其交互模型能随底层视频模型的进步而演进。随着未来流式模型变得更快、更易控制,此类界面可能支持更灵活、可控的视频创作,包括生成过程中更丰富的编辑和多模态干预。
英文摘要:
We present StreamStudio, a prototype system that explores a new authoring paradigm for streaming video generation. Instead of entering a prompt and waiting for a complete video before making changes, creators can interact with the generation as it unfolds: steering what comes next, returning to earlier moments, and exploring different continuations. In this way, StreamStudio shifts creative control from post-generation revision to continuous interaction with the generative process. Our contribution centers on this authoring paradigm and the interaction mechanisms that make streaming generation directly manipulable. StreamStudio is designed as a plug-and-play interface that can work with compatible generation and editing models, allowing its interaction model to evolve alongside advances in underlying video models. As streaming models become faster and easier to control in the future, such an interface may support more flexible and controllable video creation, including richer edits and multimodal interventions during generation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。