arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.12366cs.LG
收藏

Sinkhorn漂动生成模型

Sinkhorn-Drifting Generative Models

Vanderbilt University(范德堡大学);University of California, Davis(加州大学戴维斯分校);Purdue University(普渡大学)

Ping He, Om Khangaonkar, Hamed Pirsiavash, Yikun Bai, Soheil Kolouri

AI总结:

本文研究了Sinkhorn漂动生成模型与Sinkhorn散度梯度流的理论联系,提出漂动生成模型可作为Sinkhorn散度梯度流的替代方案,通过熵最优传输耦合解决可识别性问题,并在实验中验证其在生成质量与稳定性上的优势。

摘要:

我们建立了最近提出的'漂动'生成动态与由Sinkhorn散度诱导的梯度流之间的理论联系。在粒子离散化中,漂动场具有交叉减自的分解:一个指向目标分布的吸引项和一个指向当前模型的排斥/自校正项,两者均通过单侧归一化Gibbs核表达。我们证明Sinkhorn散度具有类似的交叉减自结构,但每个术语由通过双侧Sinkhorn缩放获得的熵最优传输耦合定义(即强制双侧边际)。这提供了漂动作为Sinkhorn散度梯度流替代方案的精确意义,介于单侧归一化和完整双侧Sinkhorn缩放之间。关键的是,这种联系解决了先前漂动形式中的可识别性缺口:利用Sinkhorn散度的确定性,我们证明零漂动(动态的平衡)意味着模型和目标测度匹配。实验显示,Sinkhorn漂动减少了对核温度的敏感性,并提高了一步生成质量,以额外的训练时间换取更稳定的优化,而无需改变漂动方法所用的推理过程。这些理论收益在实践中转化为强大的低温改进:在FFHQ-ALAE在我们评估的最低温度设置下,Sinkhorn漂动将平均FID从187.7降至37.1,平均潜在EMD从453.3降至144.4,而在MNIST上保持了全类覆盖的温度扫描。项目页面:https://mint-vu.github.io/SinkhornDrifting/

英文摘要:

We establish a theoretical link between the recently proposed "drifting" generative dynamics and gradient flows induced by the Sinkhorn divergence. In a particle discretization, the drift field admits a cross-minus-self decomposition: an attractive term toward the target distribution and a repulsive/self-correction term toward the current model, both expressed via one-sided normalized Gibbs kernels. We show that Sinkhorn divergence yields an analogous cross-minus-self structure, but with each term defined by entropic optimal-transport couplings obtained through two-sided Sinkhorn scaling (i.e., enforcing both marginals). This provides a precise sense in which drifting acts as a surrogate for a Sinkhorn-divergence gradient flow, interpolating between one-sided normalization and full two-sided Sinkhorn scaling. Crucially, this connection resolves an identifiability gap in prior drifting formulations: leveraging the definiteness of the Sinkhorn divergence, we show that zero drift (equilibrium of the dynamics) implies that the model and target measures match. Experiments show that Sinkhorn drifting reduces sensitivity to kernel temperature and improves one-step generative quality, trading off additional training time for a more stable optimization, without altering the inference procedure used by drift methods. These theoretical gains translate to strong low-temperature improvements in practice: on FFHQ-ALAE at the lowest temperature setting we evaluate, Sinkhorn drifting reduces mean FID from 187.7 to 37.1 and mean latent EMD from 453.3 to 144.4, while on MNIST it preserves full class coverage across the temperature sweep. Project page: https://mint-vu.github.io/SinkhornDrifting/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑