We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for training CNFs based on regressing vector fields of fixed conditional probability paths. Flow Matching is compatible with a general family of Gaussian probability paths for transforming between noise and data samples -- which subsumes existing diffusion paths as specific instances. Interestingly, we find that employing FM with diffusion paths results in a more robust and stable alternative for training diffusion models. Furthermore, Flow Matching opens the door to training CNFs with other, non-diffusion probability paths. An instance of particular interest is using Optimal Transport (OT) displacement interpolation to define the conditional probability paths. These paths are more efficient than diffusion paths, provide faster training and sampling, and result in better generalization. Training CNFs using Flow Matching on ImageNet leads to consistently better performance than alternative diffusion-based methods in terms of both likelihood and sample quality, and allows fast and reliable sample generation using off-the-shelf numerical ODE solvers.
University of Toronto(多伦多大学);Canadian Institute for Advanced Research(加拿大高等研究院)
我们考虑从数据中学习深度生成模型的问题。我们制定了一种方法,该方法通过多层感知器的单次前馈来生成独立样本,如最近提出的生成对抗网络(Goodfellow et al.,2014年)。然而,训练一个生成对抗网络需要仔细优化一个困难的极小极大程序。相反,我们利用了一种被称为最大平均差异(MMD)的统计假设检验技术,这导致了一个简单的目标,可以被解释为匹配数据集和模型样本之间的所有统计阶数,并且可以通过反向传播进行训练。我们通过将我们的生成网络与自动编码器网络相结合,使用MMD来学习生成代码,然后可以解码生成样本,从而进一步提高了这种方法的性能。我们表明,这些技术的组合产生优秀的生成模型相比,MNIST和多伦多人脸数据库上测量的基线方法。
A Theoretical Analysis of Discrete Flow Matching Generative Models
Center for Foundation Models and Generative AI, Northwestern University, Evanston, IL 60208, USA(基础模型与生成式人工智能中心,西北大学,伊利诺伊州埃文斯顿,60208,美国);Department of Computer Science, Northwestern University, Evanston, IL 60208, USA(计算机科学系,西北大学,伊利诺伊州埃文斯顿,60208,美国);University of California, Berkeley, Berkeley, CA 94720, USA(加州大学伯克利分校,伯克利,加利福尼亚州,94720,美国);Ensemble AI, San Francisco, CA 94133, USA(Ensemble AI,旧金山,加利福尼亚州,94133,美国);Department of Statistics and Data Science, Northwestern University, Evanston, IL 60208, USA(统计与数据科学系,西北大学,伊利诺伊州埃文斯顿,60208,美国)
H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology(哈里·米尔顿·斯图尔特工业与系统工程学院,佐治亚理工学院);Department of Mathematics, Duke University(杜克大学数学系)
Force Matching with Relativistic Constraints: A Physics-Inspired Approach to Stable and Efficient Generative Modeling
Wyoming Seminary(怀俄明神学院);Middle Tennessee State University(中田纳西州立大学);Stevens Institute of Technology(斯蒂文斯理工学院);The University of Hong Kong(香港大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);Tsinghua University(清华大学);Simons Institute for the Theory of Computing, University of California, Berkeley(加州大学伯克利分校西蒙斯理论计算研究所);Anhui University(安徽大学)
University of California, Irvine(加州大学伊万斯堡分校);University of Virginia(弗吉尼亚大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校);Northeastern University(东北大学)
Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Stevens Institute of Technology(史蒂文斯理工学院);The University of Hong Kong(香港大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);South China University of Technology(华南理工大学);The Simons Institute for the Theory of Computing(西蒙斯理论计算研究所)
Generative Modeling of Quantum Distribution with Functional Flow Matching
Graduate School of Data Science, Seoul National University, Seoul, Korea(首尔国立大学数据科学研究生院);Department of Statistics and Data Science, Yonsei University, Seoul, Korea(延世大学统计与数据科学系);Department of Applied Statistics, Yonsei University, Seoul, Korea(延世大学应用统计系);Google Research, Mountain View, California, United States(谷歌研究)
FluidFlow: a flow-matching generative model for fluid dynamics surrogates on unstructured meshes
ETSIAE-UPM-School of Aeronautics, Universidad Politécnica de Madrid(马德里理工大学航空学院);Institute for Cross-Disciplinary Physics and Complex Systems (IFISC, CSIC-UIB)(跨学科物理与复杂系统研究所(IFISC,CSIC-UIB));Center for Computational Simulation, Universidad Politécnica de Madrid(马德里理工大学计算模拟中心)
University of North Carolina Charlotte(北卡罗来纳大学夏洛特分校);Montreal Institute for Learning Algorithms(蒙特利尔学习算法研究所);Carnegie Mellon University(卡内基梅隆大学);University of Maryland College Park(马里兰大学学院公园分校);Korea University(高丽大学);IIIT Delhi(德里印度理工学院);Electronics and Telecommunications Research Institute(电子与电信研究院)