Matching objectives underpin the success of modern generative models and rely on constructing conditional paths that transform a source distribution into a target distribution. Despite being a fundamental building block, conditional paths have been designed principally under the assumption of Euclidean geometry, resulting in straight interpolations. However, this can be particularly restrictive for tasks such as trajectory inference, where straight paths might lie outside the data manifold, thus failing to capture the underlying dynamics giving rise to the observed marginals. In this paper, we propose Metric Flow Matching (MFM), a novel simulation-free framework for conditional flow matching where interpolants are approximate geodesics learned by minimizing the kinetic energy of a data-induced Riemannian metric. This way, the generative model matches vector fields on the data manifold, which corresponds to lower uncertainty and more meaningful interpolations. We prescribe general metrics to instantiate MFM, independent of the task, and test it on a suite of challenging problems including LiDAR navigation, unpaired image translation, and modeling cellular dynamics. We observe that MFM outperforms the Euclidean baselines, particularly achieving SOTA on single-cell trajectory prediction.
Video Latent Flow Matching: Optimal Polynomial Projections for Video Interpolation and Extrapolation
Wyoming Seminary(怀俄明神学院);Simons Institute for the Theory of Computing, University of California, Berkeley(加州大学伯克利分校西蒙斯理论计算研究所);Sun Yat-sen University(中山大学)
本文提出 Video Latent Flow Matching (VLFM),利用预训练图像生成模型和 HiPPO 最优多项式投影建模潜在块流,实现任意帧率的视频插值与外推生成,并具备理论逼近误差和时间尺度鲁棒性优势。
Booth School of Business, University of Chicago(芝加哥大学布斯商学院);Department of Statistics, University of Michigan(密歇根大学统计系);Department of Mathematics, University of Maryland, College Park(马里兰大学帕克分校数学系)
KTH Royal Institute of Technology(皇家理工学院);University of Amsterdam(阿姆斯特丹大学);University of Cambridge(剑桥大学);University of California, Los Angeles(加州大学洛杉矶分校);Delft University of Technology(代尔夫特理工大学)
Smooth image-to-image translations with latent space interpolations
University of Trento(特伦托大学);Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会);University of Modena and Reggio Emilia(摩德纳-雷焦艾米利亚大学);Shanghai Jiao Tong University(上海交通大学);Tencent AI Lab(腾讯人工智能实验室)
Autoencoding Low-Resolution MRI for Semantically Smooth Interpolation of Anisotropic MRI
Amsterdam University Medical Centers(阿姆斯特丹大学医学中心);University of Amsterdam(阿姆斯特丹大学);Amsterdam Cardiovascular Sciences(阿姆斯特丹心血管科学研究所);Informatics Institute, University of Amsterdam(阿姆斯特丹大学信息学研究所)