arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.06028cs.CV

上下文强制:通过长上下文实现一致的自回归视频生成

Context Forcing: Consistent Autoregressive Video Generation with Long Context

Department of EECS, University of California, Merced, USA(加州大学梅尔塞德斯分校电子工程与计算机科学系);University of Waterloo, Canada(滑铁卢大学)

Shuo Chen, Cong Wei, Sun Sun, Ping Nie, Kai Zhou, Ge Zhang, Ming-Hsuan Yang, Wenhu Chen

AI总结:

Context Forcing通过长上下文教师训练学生,解决长视频生成中的学生-教师不匹配问题,实现更长的上下文长度和更一致的生成质量。

摘要:

最近的实时长视频生成方法通常采用流式调优策略,试图通过短上下文(无记忆)教师训练长上下文的学生。在这些框架中,学生执行长步长但只能从限制在5秒窗口内的教师获得监督。这种结构上的不一致导致了关键的

英文摘要:

Recent approaches to real-time long video generation typically employ streaming tuning strategies, attempting to train a long-context student using a short-context (memoryless) teacher. In these frameworks, the student performs long rollouts but receives supervision from a teacher limited to short 5-second windows. This structural discrepancy creates a critical \textbf{student-teacher mismatch}: the teacher's inability to access long-term history prevents it from guiding the student on global temporal dependencies, effectively capping the student's context length. To resolve this, we propose \textbf{Context Forcing}, a novel framework that trains a long-context student via a long-context teacher. By ensuring the teacher is aware of the full generation history, we eliminate the supervision mismatch, enabling the robust training of models capable of long-term consistency. To make this computationally feasible for extreme durations (e.g., 2 minutes), we introduce a context management system that transforms the linearly growing context into a \textbf{Slow-Fast Memory} architecture, significantly reducing visual redundancy. Extensive results demonstrate that our method enables effective context lengths exceeding 20 seconds -- 2 to 10 times longer than state-of-the-art methods like LongLive and Infinite-RoPE. By leveraging this extended context, Context Forcing preserves superior consistency across long durations, surpassing state-of-the-art baselines on various long video evaluation metrics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑