arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.22486stat.MLcs.LGmath.STstat.TH
收藏

流匹配适应于流形结构

Flow Matching is Adaptive to Manifold Structures

Booth School of Business, University of Chicago(芝加哥大学布斯商学院);Department of Statistics, University of Michigan(密歇根大学统计系);Department of Mathematics, University of Maryland, College Park(马里兰大学帕克分校数学系)

Shivam Kumar, Yixin Wang, Lizhen Lin

AI总结:

本文研究流匹配在流形支持下的收敛性,证明其在高维数据中适应数据几何并避免维度灾难。

摘要:

流匹配作为一种无需模拟的生成建模替代方法,通过求解一个时间依赖的速度场ODE来生成样本,该速度场在简单源分布与目标数据分布之间进行插值。流基方法通常具有更高的训练稳定性,并在高维设置中表现出色,特别是在数据集中在低维流形的情况,如文本到图像合成、视频生成和分子结构生成。尽管取得成功,现有理论分析假设目标分布具有光滑的全维密度,未能解释其在流形支持下的有效性。为此,本文理论分析了线性插值的流匹配,当目标分布支持于光滑流形时,建立了学习速度场的非渐近收敛保证,并通过ODE传播估计误差以获得隐式密度估计器的统计一致性。所得收敛率接近最小最大最优,仅依赖于内在维度,并反映了流形和目标分布的光滑性。这些结果为流匹配如何适应数据几何并避免维度灾难提供了原理性解释。

英文摘要:

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source distribution (e.g., a standard normal) and a target data distribution. Flow-based methods often exhibit greater training stability and have achieved strong empirical performance in high-dimensional settings where data concentrate near a low-dimensional manifold, such as text-to-image synthesis, video generation, and molecular structure generation. Despite this success, existing theoretical analyses of flow matching assume target distributions with smooth, full-dimensional densities, leaving its effectiveness in manifold-supported settings largely unexplained. To this end, we theoretically analyze flow matching with linear interpolation when the target distribution is supported on a smooth manifold. We establish a non-asymptotic convergence guarantee for the learned velocity field, and then propagate this estimation error through the ODE to obtain statistical consistency of the implicit density estimator induced by the flow-matching objective. The resulting convergence rate is near minimax-optimal, depends only on the intrinsic dimension, and reflects the smoothness of both the manifold and the target distribution. Together, these results provide a principled explanation for how flow matching adapts to intrinsic data geometry and circumvents the curse of dimensionality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑