arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.14949cs.LGstat.ML
收藏

关于校正流的收敛性与直线性

On the Convergence and Straightness of Rectified Flow

Department of Statistics and Data Sciences, UT Austin(统计与数据科学系,德克萨斯大学奥斯汀分校)

Vansh Bansal, Saptarshi Roy, Alessandro Rinaldo, Purnamrita Sarkar

AI总结:

本文提出Piecewise Straightness参数γ₂,T,建立首个流模型离散误差与γ₂,T的Wasserstein收敛界,证明最小曲率是实现高保真单步采样的关键,同时为RF的直线性分析提供了理论框架。

摘要:

本文提出Piecewise Straightness参数γ₂,T,建立首个流模型离散误差与γ₂,T的Wasserstein收敛界,证明最小曲率是实现高保真单步采样的关键,同时为RF的直线性分析提供了理论框架。

英文摘要:

Flow Matching has become a cornerstone of modern generative models like Stable Diffusion 3, largely due to the efficiency of its Rectified Flow (RF) variant. The success of RF hinges on iteratively learning straight trajectories, pushing generation towards fewer sampling steps. However, the theoretical link between path geometry and sampling efficiency has been underexplored. This paper fills this gap by introducing a novel \textit{Piecewise Straightness} parameter, $γ_{2,T}$. We establish the first Wasserstein convergence bound that explicitly links the discretization error of \textit{any} general flow-model to $γ_{2,T}$, proving that minimizing curvature is the key to achieving high-fidelity, one-step sampling. Building on this theory, we establish the first theoretical framework to analyze the straightness of RF. We begin by offering intuitive geometric arguments for simple cases before identifying sufficient conditions under which a single rectification step (1-RF) yields a perfectly straight or even a Monge optimal coupling. While whether these sufficient conditions are met depends on the problem geometry, they enable the first concrete proofs in this area. Critically, fulfilling these conditions makes the subsequent flow (2-RF) perfectly straight ($γ_{2,T}=0$). This eliminates the discretization error in our bound and makes flawless, single-step sampling possible.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑