Continuous normalizing flows (CNFs) can model data distributions with expressive infinite-length architectures. But this modeling involves computationally expensive process of solving an ordinary differential equation (ODE) during maximum likelihood training. Recently proposed flow matching (FM) framework allows to substantially simplify the training phase using a regression objective with the interpolated forward vector field. In this paper, we propose an interpolant-free dual flow matching (DFM) approach without explicit assumptions about the modeled vector field. DFM optimizes the forward and, additionally, a reverse vector field model using a novel objective that facilitates bijectivity of the forward and reverse transformations. Our experiments with the SMAP unsupervised anomaly detection show advantages of DFM when compared to the CNF trained with either maximum likelihood or FM objectives with the state-of-the-art performance metrics.
Multi-Objective-Guided Discrete Flow Matching for Controllable Biological Sequence Design
Department of Biomedical Engineering, Duke University(杜克大学生物医学工程系);Department of Computer Science, Fudan University(复旦大学计算机科学系);Center of Computational Biology, Duke-NUS Medical School(杜克-新加坡国立大学医学学校计算生物学中心);Management and Technology Program, University of Pennsylvania(宾夕法尼亚大学管理与技术项目);Department of Computer Science, Duke University(杜克大学计算机科学系);Department of Biostatistics and Bioinformatics, Duke University(杜克大学生物统计与生物信息学系)
提出 MOG-DFM 框架,通过混合秩方向分数和自适应超锥滤波引导预训练离散流匹配模型,实现多目标帕累托高效的肽与增强子 DNA 序列设计。
A Theoretical Analysis of Discrete Flow Matching Generative Models
Center for Foundation Models and Generative AI, Northwestern University, Evanston, IL 60208, USA(基础模型与生成式人工智能中心,西北大学,伊利诺伊州埃文斯顿,60208,美国);Department of Computer Science, Northwestern University, Evanston, IL 60208, USA(计算机科学系,西北大学,伊利诺伊州埃文斯顿,60208,美国);University of California, Berkeley, Berkeley, CA 94720, USA(加州大学伯克利分校,伯克利,加利福尼亚州,94720,美国);Ensemble AI, San Francisco, CA 94133, USA(Ensemble AI,旧金山,加利福尼亚州,94133,美国);Department of Statistics and Data Science, Northwestern University, Evanston, IL 60208, USA(统计与数据科学系,西北大学,伊利诺伊州埃文斯顿,60208,美国)
University of California, Irvine(加州大学伊万斯堡分校);University of Virginia(弗吉尼亚大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校);Northeastern University(东北大学)
SplineFlow: Flow Matching for Dynamical Systems with B-Spline Interpolants
CISPA Helmholtz Center for Information Security(CISPA海德堡信息安全研究中心);Department of Computer Science and Technology(计算机科学与技术系);University of Cambridge(剑桥大学)
Gumbel-Softmax Flow Matching with Straight-Through Guidance for Controllable Biological Sequence Generation
Duke University(杜克大学);University of Pennsylvania(宾夕法尼亚大学);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Mila, Quebec AI Institute(米拉魁北克人工智能研究所);Université de Montréal(蒙特利尔大学)
BoltzNCE: Learning Likelihoods for Boltzmann Generation with Stochastic Interpolants and Noise Contrastive Estimation
CMU-Pitt Computational Biology Dept. of Computational & Systems Biology University of Pittsburgh(卡内基梅隆大学-匹兹堡计算生物学系,计算与系统生物学系,匹兹堡大学);Machine Learning Dept. Dept. of Mathematical Sciences Carnegie Mellon University(机器学习系,数学科学系,卡内基梅隆大学);Dept. of Computational & Systems Biology University of Pittsburgh(计算与系统生物学系,匹兹堡大学)
Open Materials Generation with Stochastic Interpolants
Center for Soft Matter Research, Department of Physics, New York University, New York 10003, USA;Simons Center for Computational Physical Chemistry, Department of Chemistry, New York University, New York 10003, USA;Department of Aerospace Engineering;Mechanics, University of Minnesota, Minneapolis, MN 55455, USA;Department of Computer Science \& Engineering, University of Minnesota, Minneapolis, MN 55455, USA;Department of Physics, University of Florida, Gainesville, FL 32611, USA;Quantum Theory Project, University of Florida, Gainesville, FL 32611, USA;Department of Chemistry, University of Florida, Gainesville, FL 32611, USA;Department of Physics \& Astronomy, Brigham Young University, Provo, UT 84602, USA;Department of Materials Science \& Engineering, University of Florida, Gainesville, FL 32611, USA;Courant Institute of Mathematical Sciences, New York University, New York 10003, USA;Center for Neural Science, New York University, New York 10003, USA
DisRFM: Polar Riemannian Flow Matching for Structure-Preserving Graph Domain Adaptation
The Chinese University of Hong Kong(香港中文大学);National University of Defense Technology(国防科学技术大学);Hebei University of Technology(河北工业大学);City University of Hong Kong(香港城市大学)
MGD: Moment Guided Diffusion for Maximum Entropy Generation
Département d’informatique, ENS, Université PSL(信息学院,巴黎高等师范学院,巴黎国立高等科学研究院);Capital Fund Management(资本基金管理公司);Collège de France(法兰西学院);Flatiron Institute(Flatiron研究所);Courant Institute of Mathematical Sciences, New York University(纽约大学应用数学科学学院);ML Lab, Capital Fund Management(资本基金管理公司的机器学习实验室)
Scale-Adaptive Generative Flows for Multiscale Scientific Data
Department of Mathematics, University of California, Los Angeles(加州大学洛杉矶分校数学系);Machine Learning Lab, Capital Fund Management(资本基金管理有限公司机器学习实验室);Courant Institute, New York University(纽约大学柯朗研究所)
Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions
The Oskar Klein Centre, Department of Physics, Stockholm University, AlbaNova University Centre(奥斯卡·克莱因中心,物理系,斯德哥尔摩大学,阿尔瓦纳大学中心);Center for Computational Astrophysics, Flatiron Institute(计算天体物理学中心,Flatiron研究所)