MixFlow:混合源分布改进修正流
MixFlow: Mixed Source Distributions Improve Rectified Flows
AI总结:
本文提出MixFlow,通过混合固定无条件分布与基于κ-FC的分布,减少生成路径曲率,提升采样效率和生成质量,实验显示在FID上比标准修正流提升12%。
摘要:
扩散模型及其变种,如修正流,能够生成多样且高质量的图像,但受限于生成路径高度弯曲导致的采样缓慢。本文通过引入κ-FC和MixFlow策略,改进源分布与数据分布的对齐,减少生成路径曲率,提升采样效率。实验表明,与标准修正流相比,生成质量在FID上提升12%,在固定采样预算下比先前基线提升7%。代码已发布在https://github.com/NazirNayal8/MixFlow。
英文摘要:
Diffusion models and their variations, such as rectified flows, generate diverse and high-quality images, but they are still hindered by slow iterative sampling caused by the highly curved generative paths they learn. An important cause of high curvature, as shown by previous work, is independence between the source distribution (standard Gaussian) and the data distribution. In this work, we tackle this limitation by two complementary contributions. First, we attempt to break away from the standard Gaussian assumption by introducing $κ\texttt{-FC}$, a general formulation that conditions the source distribution on an arbitrary signal $κ$ that aligns it better with the data distribution. Then, we present MixFlow, a simple but effective training strategy that reduces the generative path curvatures and considerably improves sampling efficiency. MixFlow trains a flow model on linear mixtures of a fixed unconditional distribution and a $κ\texttt{-FC}$-based distribution. This simple mixture improves the alignment between the source and data, provides better generation quality with less required sampling steps, and accelerates the training convergence considerably. On average, our training procedure improves the generation quality by 12\% in FID compared to standard rectified flow and 7\% compared to previous baselines under a fixed sampling budget. Code available at: $\href{https://github.com/NazirNayal8/MixFlow}{https://github.com/NazirNayal8/MixFlow}$
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。