Generative Modeling via Kernelized Stochastic Interpolants
CCM, Flatiron Institute, New York, USA(CCM,Flatiron研究所,纽约,美国);Courant Institute of Mathematical Sciences, New York University, New York, USA(数学科学学院,纽约大学,纽约,美国)
Florentin Coeurdoux, Etienne Lempereur, Nathanaël Cuvelle-Magar, Stéphane Mallat, Eric Vanden-Eijnden
We develop a kernel method for generative modeling within the stochastic interpolant framework, replacing neural network training with linear systems. The drift of the generative SDE is $\hat b_t(x) = \nablaϕ(x)^\topη_t$, where $η_t \in \mathbb{R}^P$ solves a $P\times P$ system computable from data, with $P$ independent of the data dimension $d$. Since estimates are inexact, the diffusion coefficient $D_t$ affects sample quality; the optimal $D_t^*$ from Girsanov diverges at $t=0$, but this poses no difficulty and we develop an integrator that handles it seamlessly. The framework accommodates diverse feature maps: scattering transforms, pretrained generative models, etc, enabling generation and model combination without neural network training. We demonstrate the approach on financial time series, turbulence, and image generation.
Benchmarking Stochastic Interpolants for Modeling Physical Systems
Department of Mechanical Engineering(机械工程系);Carnegie Mellon University(卡内基梅隆大学);Department of Geophysical Sciences Committee on Computational and Applied Mathematics(地球科学系计算与应用数学委员会);University of Chicago(芝加哥大学);LMD/IPSL, CNRS, ENS, Université PSL École Polytechnique, Institut Polytechnique de Paris, Sorbonne Université(LMD/IPSL、CNRS、ENS、Université PSL 工程学院、巴黎理工学院、索邦大学);Réseau de Transport d’Électricité (RTE)(电力传输网络(RTE))
Multimarginal generative modeling with stochastic interpolants
Center for Cosmology and Particle Physics(宇宙学与粒子物理中心);New York University(纽约大学);Courant Institute of Mathematical Sciences(库朗数学科学研究所);University of California, Berkeley(加州大学伯克利分校)
Xaurora: Generative Weather Forecasting with Denoising Stochastic Interpolants from a Foundation Model Prior
Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Amsterdam(阿姆斯特丹大学);Delft University of Technology(代尔夫特理工大学);Centrum Wiskunde & Informatica(数学与计算机科学中心)
Capital Fund Management(资本基金管理公司);Society of Fellows, Harvard University(哈佛大学 fellows 会);Machine Learning Lab(机器学习实验室);Courant Institute of Mathematical Sciences, New York University(纽约大学应用数学科学研究所)
Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
Center for Cosmology and Particle Physics New York University(纽约大学宇宙与粒子物理中心);Courant Institute of Mathematical Sciences New York University(纽约大学数学科学学院)
Stochastic interpolants with data-dependent couplings
Center for Cosmology and Particle Physics, New York University(纽约大学宇宙学与粒子物理中心);Courant Institute of Mathematical Sciences, New York University(纽约大学柯朗数学科学研究所);Center for Data Science, New York University(纽约大学数据科学中心)
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);University of Chinese Academy of Sciences(中国科学院大学);School of Mathematics and Statistics, Fujian Normal University(福建师范大学数学与统计学学院);Beijing Institute of Technology(北京理工大学)
Open Materials Generation with Stochastic Interpolants
Center for Soft Matter Research, Department of Physics, New York University, New York 10003, USA;Simons Center for Computational Physical Chemistry, Department of Chemistry, New York University, New York 10003, USA;Department of Aerospace Engineering;Mechanics, University of Minnesota, Minneapolis, MN 55455, USA;Department of Computer Science \& Engineering, University of Minnesota, Minneapolis, MN 55455, USA;Department of Physics, University of Florida, Gainesville, FL 32611, USA;Quantum Theory Project, University of Florida, Gainesville, FL 32611, USA;Department of Chemistry, University of Florida, Gainesville, FL 32611, USA;Department of Physics \& Astronomy, Brigham Young University, Provo, UT 84602, USA;Department of Materials Science \& Engineering, University of Florida, Gainesville, FL 32611, USA;Courant Institute of Mathematical Sciences, New York University, New York 10003, USA;Center for Neural Science, New York University, New York 10003, USA
FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilation
University of Michigan(密歇根大学);Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Peking University(北京大学);Department of Physics(物理系);National Biomedical Imaging Center(国家生物医学成像中心)
BoltzNCE: Learning Likelihoods for Boltzmann Generation with Stochastic Interpolants and Noise Contrastive Estimation
CMU-Pitt Computational Biology Dept. of Computational & Systems Biology University of Pittsburgh(卡内基梅隆大学-匹兹堡计算生物学系,计算与系统生物学系,匹兹堡大学);Machine Learning Dept. Dept. of Mathematical Sciences Carnegie Mellon University(机器学习系,数学科学系,卡内基梅隆大学);Dept. of Computational & Systems Biology University of Pittsburgh(计算与系统生物学系,匹兹堡大学)
Jarzynski Reweighting and Sampling Dynamics for Training Energy-Based Models: Theoretical Analysis of Different Transition Kernels
Dipartimento di Scienze Matematiche, Politecnico di Torino, Italy(都灵理工大学数学科学系);Istituto Nazionale di Fisica Nucleare, Sezione di Torino, Italy(意大利国家核物理研究所都灵分部);Laboratoire de Physique de l’École normale supérieure, ENS, Université PSL, France(法国高等科学研究所物理实验室)
Scale-Adaptive Generative Flows for Multiscale Scientific Data
Department of Mathematics, University of California, Los Angeles(加州大学洛杉矶分校数学系);Machine Learning Lab, Capital Fund Management(资本基金管理有限公司机器学习实验室);Courant Institute, New York University(纽约大学柯朗研究所)
Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions
The Oskar Klein Centre, Department of Physics, Stockholm University, AlbaNova University Centre(奥斯卡·克莱因中心,物理系,斯德哥尔摩大学,阿尔瓦纳大学中心);Center for Computational Astrophysics, Flatiron Institute(计算天体物理学中心,Flatiron研究所)
The University of Tokyo(东京大学);Hasso Plattner Institute for Digital Engineering(哈索·普拉特纳数字工程研究所);Institute of Statistical Mathematics(统计数学研究所);RIKEN Centre for Advanced Intelligence Project (AIP)(理化学研究所高级智能项目中心)
Variational Optimality of Föllmer Processes in Generative Diffusions
Department of Mathematics, University of California, Los Angeles, CA, USA(加州大学洛杉矶分校数学系);Machine Learning Lab, Capital Fund Management, Paris, France(Capital Fund Management机器学习实验室);Courant Institute, New York University, NY, USA(纽约大学Courant研究所)