arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.18993cs.CV
收藏

SeaCache: 基于频谱演化的缓存加速扩散模型

SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion Models

Sungkyunkwan University(顺天乡大学);NAVER Cloud(NAVER云)

Jiwoo Chung, Sangeek Hyun, MinKyu Lee, Byeongju Han, Geonho Cha, Dongyoon Wee, Youngjun Hong, Jae-Pil Heo

AI总结:

本文提出SeaCache缓存机制,通过频谱对齐表示提升扩散模型推理效率,实验证明其在延迟与质量之间取得最优平衡。

摘要:

扩散模型是视觉生成的强大基础,但其固有的序列去噪过程导致推理缓慢。先前方法通过缓存和重用中间输出加速采样,但现有缓存策略依赖于相邻时间步之间的特征差异,容易混淆内容与噪声。本文引入Spectral-Evolution-Aware Cache (SeaCache),一种无需训练的缓存调度方法,基于频谱对齐的表示进行重用决策。通过理论和实证分析,我们推导出一个Spectral-Evolution-Aware (SEA)滤波器,保留内容相关成分并抑制噪声。利用SEA滤波后的输入特征估计冗余,得到动态调度方案,适应内容并尊重扩散模型下的频谱先验。在多种视觉生成模型和基线上的广泛实验表明,SeaCache在延迟与质量之间取得最佳平衡。

英文摘要:

Diffusion models are a strong backbone for visual generation, but their inherently sequential denoising process leads to slow inference. Previous methods accelerate sampling by caching and reusing intermediate outputs based on feature distances between adjacent timesteps. However, existing caching strategies typically rely on raw feature differences that entangle content and noise. This design overlooks spectral evolution, where low-frequency structure appears early and high-frequency detail is refined later. We introduce Spectral-Evolution-Aware Cache (SeaCache), a training-free cache schedule that bases reuse decisions on a spectrally aligned representation. Through theoretical and empirical analysis, we derive a Spectral-Evolution-Aware (SEA) filter that preserves content-relevant components while suppressing noise. Employing SEA-filtered input features to estimate redundancy leads to dynamic schedules that adapt to content while respecting the spectral priors underlying the diffusion model. Extensive experiments on diverse visual generative models and the baselines show that SeaCache achieves state-of-the-art latency-quality trade-offs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑