FastFlow: 通过多臂老虎机推断加速生成流匹配模型
FastFlow: Accelerating The Generative Flow Matching Models with Bandit Inference
AI总结:
FastFlow通过多臂老虎机推断方法,实现流匹配模型生成过程的加速,同时保持生成质量。
摘要:
流匹配模型在图像和视频生成中实现了最先进的保真度,但内在的去噪过程使其运行较慢。现有的加速方法如知识蒸馏、轨迹截断和一致性方法都是静态的,需要重新训练,且往往无法跨任务泛化。我们提出FastFlow,这是一种即插即用的自适应推断框架,用于加速流匹配模型的生成。FastFlow识别出只产生微小调整的去噪步骤,并利用先前预测的有限差分速度估计来高效地外推未来状态,从而在零计算成本下加速去噪路径的进展。这使得可以在中间步骤跳过计算。我们将如何安全地决定在需要完整模型计算之前跳过多少步骤视为一个多臂老虎机问题。老虎机学习最优的跳过步骤以在速度和性能之间取得平衡。FastFlow能够无缝集成到现有流程中,并在图像生成、视频生成和编辑任务中实现泛化。实验表明,FastFlow在保持高质量输出的同时实现了超过2.6倍的加速。本工作的源代码可在https://github.com/Div290/FastFlow找到。
英文摘要:
Flow-matching models deliver state-of-the-art fidelity in image and video generation, but the inherent sequential denoising process renders them slower. Existing acceleration methods like distillation, trajectory truncation, and consistency approaches are static, require retraining, and often fail to generalize across tasks. We propose FastFlow, a plug-and-play adaptive inference framework that accelerates generation in flow matching models. FastFlow identifies denoising steps that produce only minor adjustments to the denoising path and approximates them without using the full neural network models used for velocity predictions. The approximation utilizes finite-difference velocity estimates from prior predictions to efficiently extrapolate future states, enabling faster advancements along the denoising path at zero compute cost. This enables skipping computation at intermediary steps. We model the decision of how many steps to safely skip before requiring a full model computation as a multi-armed bandit problem. The bandit learns the optimal skips to balance speed with performance. FastFlow integrates seamlessly with existing pipelines and generalizes across image generation, video generation, and editing tasks. Experiments demonstrate a speedup of over 2.6x while maintaining high-quality outputs. The source code for this work can be found at https://github.com/Div290/FastFlow.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。