arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.01246cs.LGstat.ML
收藏

具有归一化流的两个经验分布之间的最优迁移学习

Learning Optimal Transport Between two Empirical Distributions with Normalizing Flows

University of Toulouse(图卢兹大学);Univ. Lille(里尔大学);CNRS(法国国家科学研究中心);Centrale Lille(里尔中央理工学院)

Florentin Coeurdoux, Nicolas Dobigeon, Pierre Chainais

摘要:

最优运输(OT)提供了有效的工具,比较和映射的概率措施。我们建议利用神经网络的灵活性来学习近似的最优传输图。更确切地说,我们提出了一种新的和原始的方法来解决的问题,运输与第一个潜在的未知分布向另一个有限的一组样本从另一个未知的分布。我们证明了可逆神经网络的一个特殊实例,即归一化流,可以用来近似一对经验分布之间的OT问题的解决方案。为了这个目的,我们建议放松蒙赫制定OT通过替换的平等约束的推进措施的最小化相应的Wasserstein距离。然后,要检索的前推操作符被限制为通过优化所得成本函数来训练的归一化流。这种方法允许将运输图离散化为函数的组合。这些功能中的每一个都与网络的一个子流相关联,其输出提供了原始测量和目标测量之间的传输的中间步骤。这种离散化也产生了一组中间重心之间的两个措施的利益。玩具的例子,以及一个具有挑战性的任务,无监督翻译进行的实验证明了所提出的方法的兴趣。最后,一些实验表明,所提出的方法导致一个很好的近似的真实OT。

英文摘要:

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and original method to address the problem of transporting a finite set of samples associated with a first underlying unknown distribution towards another finite set of samples drawn from another unknown distribution. We show that a particular instance of invertible neural networks, namely the normalizing flows, can be used to approximate the solution of this OT problem between a pair of empirical distributions. To this aim, we propose to relax the Monge formulation of OT by replacing the equality constraint on the push-forward measure by the minimization of the corresponding Wasserstein distance. The push-forward operator to be retrieved is then restricted to be a normalizing flow which is trained by optimizing the resulting cost function. This approach allows the transport map to be discretized as a composition of functions. Each of these functions is associated to one sub-flow of the network, whose output provides intermediate steps of the transport between the original and target measures. This discretization yields also a set of intermediate barycenters between the two measures of interest. Experiments conducted on toy examples as well as a challenging task of unsupervised translation demonstrate the interest of the proposed method. Finally, some experiments show that the proposed approach leads to a good approximation of the true OT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑