arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.06331cs.CV

WorldCache: 通过异构令牌缓存免费加速世界模型

WorldCache: Accelerating World Models for Free via Heterogeneous Token Caching

University of Science and Technology of China(中国科学技术大学)

Weilun Feng, Guoxin Fan, Haotong Qin, Mingqiang Wu, Yuqi Li, Xiangqi Li, Zhulin An, Libo Huang, Dingrui Wang, Longlong Liao, Michele Magno, Yongjun Xu, Chuanguang Yang

AI总结:

针对扩散世界模型中令牌异质性和非均匀时间动态导致的推理慢问题,提出基于曲率引导的异构令牌预测和混沌优先自适应跳过的缓存框架WorldCache,实现高达3.7倍加速并保持98%的推出质量。

摘要:

基于扩散的世界模型在统一世界模拟方面显示出巨大潜力,但迭代去噪对于交互式使用和长程推出而言仍然过于昂贵。虽然特征缓存可以在无需训练的情况下加速推理,但我们发现,为单模态扩散设计的策略由于两个世界模型特有的障碍而难以迁移到世界模型:来自多模态耦合和空间变化的\emph{令牌异质性},以及\emph{非均匀时间动态},其中一小部分困难令牌驱动误差增长,使得均匀跳过要么不稳定,要么过于保守。我们提出了 extbf{WorldCache},一个为扩散世界模型量身定制的缓存框架。我们引入了 extit{曲率引导的异构令牌预测},它使用基于物理的曲率分数来估计令牌可预测性,并对具有突变方向变化的混沌令牌应用Hermite引导的阻尼预测器。我们还设计了 extit{混沌优先的自适应跳过},它累积一个曲率归一化、无量纲的漂移信号,并且仅在瓶颈令牌开始漂移时重新计算。在扩散世界模型上的实验表明,WorldCache实现了高达 extbf{3.7$ imes$}的端到端加速,同时保持了 extbf{98\%}的推出质量,展示了WorldCache在资源受限场景中的巨大优势和实用性。我们的代码发布在https://github.com/FofGofx/WorldCache。

英文摘要:

Diffusion-based world models have shown strong potential for unified world simulation, but the iterative denoising remains too costly for interactive use and long-horizon rollouts. While feature caching can accelerate inference without training, we find that policies designed for single-modal diffusion transfer poorly to world models due to two world-model-specific obstacles: \emph{token heterogeneity} from multi-modal coupling and spatial variation, and \emph{non-uniform temporal dynamics} where a small set of hard tokens drives error growth, making uniform skipping either unstable or overly conservative. We propose \textbf{WorldCache}, a caching framework tailored to diffusion world models. We introduce \textit{Curvature-guided Heterogeneous Token Prediction}, which uses a physics-grounded curvature score to estimate token predictability and applies a Hermite-guided damped predictor for chaotic tokens with abrupt direction changes. We also design \textit{Chaotic-prioritized Adaptive Skipping}, which accumulates a curvature-normalized, dimensionless drift signal and recomputes only when bottleneck tokens begin to drift. Experiments on diffusion world models show that WorldCache delivers up to \textbf{3.7$\times$} end-to-end speedups while maintaining \textbf{98\%} rollout quality, demonstrating the vast advantages and practicality of WorldCache in resource-constrained scenarios. Our code is released in https://github.com/FofGofx/WorldCache.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑