arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.18534cs.LG
收藏

基于欧氏距离的流匹配

Euclidean Distance-Based Flow Matching

Saarland University(萨尔大学)

Paul-Henrik Heilmann, Peter Ochs

AI总结:

针对标准流匹配对数据污染敏感的问题,提出基于欧氏距离的流匹配,通过将回归目标的平方欧氏距离替换为欧氏距离提升分布稳健性,在CIFAR-10严重污染样本场景中表现出明显优势。

摘要:

流匹配作为一种生成建模技术近来受到广泛关注,已在诸多领域得到应用。在标准流匹配的框架中,我们将向量场视为最小二乘回归问题的解,而该方法对数据污染较为敏感。因此,我们利用稳健统计学的视角,将回归目标中的平方欧氏距离替换为欧氏距离。这一看似微小的改动,却对流匹配的特性产生了显著影响。我们对新的回归目标给出了概率解释,将其视为条件几何中位数,并利用这一特性研究基于欧氏距离的流匹配的分布稳健性。我们分析了该改动后目标的数学性质,以及受污染的目标分布对相关条件速度分布的影响。我们探讨了直接刻画该方法诱导分布的挑战,并在特定污染场景下从理论上证明,该方法在严重污染情况下能取得性能提升。最后,我们在CIFAR-10图像数据集上开展了数值实验,其中部分样本被污染。实验结果表明,在目标分布遭受严重污染的场景中,我们提出的基于欧氏距离的流匹配具有明显优势。

英文摘要:

Flow Matching has recently become popular as a technique for generative modeling with applications in many domains. In the standard Flow Matching formulation, we interpret the vector field as the solution of a least-squares regression problem, which is known to be sensitive to contamination. Therefore we leverage the viewpoint of robust statistics and replace the squared Euclidean distance with the Euclidean distance as a regression objective. This seemingly minor change strongly affects the properties of Flow Matching. We provide a probabilistic interpretation of the new regression target as a conditional geometric median and use this characterization to study distributional robustness of the Euclidean Distance-based Flow Matching. We analyze the mathematical properties of this changed objective and the effect of a contaminated target distribution on the involved conditional velocity distributions. We discuss the challenge of directly characterizing the distribution that our method induces. In specific contamination settings we show theoretically that our method yields an improvement for severe contamination. Finally, we present numerical experiments conducted on the CIFAR-10 image dataset where a proportion of the samples has been contaminated. Our Euclidean distance-based Flow Matching shows a clear advantage in scenarios of severe contamination of the target distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑