Optimal transport (OT) is a popular measure to compare probability distributions. However, OT suffers a few drawbacks such as (i) a high complexity for computation, (ii) indefiniteness which limits its applicability to kernel machines. In this work, we consider probability measures supported on a graph metric space and propose a novel Sobolev transport metric. We show that the Sobolev transport metric yields a closed-form formula for fast computation and it is negative definite. We show that the space of probability measures endowed with this transport distance is isometric to a bounded convex set in a Euclidean space with a weighted $\ell_p$ distance. We further exploit the negative definiteness of the Sobolev transport to design positive-definite kernels, and evaluate their performances against other baselines in document classification with word embeddings and in topological data analysis.
Sobolev Gradient Ascent for Optimal Transport: Barycenter Optimization and Convergence Analysis
Department of ACMS University of Notre Dame(ACMS系,诺特大学);Department of Mathematics University of California(数学系,加州大学);Department of Mathematics University of Southern California(数学系,南加州大学)
On Scalable and Efficient Computation of Large Scale Optimal Transport
Georgia Institute of Technology(佐治亚理工学院)
最优传输(OT)自然出现在许多机器学习应用中,但沉重的计算负担限制了它的广泛应用。为了解决可扩展性问题,我们提出了一个基于隐式生成学习的框架,称为SPOT(Scalable Push-forward of Optimal Transport)。具体来说,我们近似的最优运输计划的推进的参考分布,并铸造的最优运输问题成一个极大极小问题。然后,我们可以有效地解决OT问题使用原始对偶随机梯度型算法。我们还表明,我们可以恢复密度的最佳运输计划,使用神经常微分方程。在模拟数据集和真实数据集上的数值实验表明,SPOT算法具有良好的收敛性和鲁棒性。SPOT还使我们能够从最佳传输计划中高效地进行采样,这有利于下游应用,如领域自适应。
DeepLight: A Sobolev-trained Image-to-Image Surrogate Model for Light Transport in Tissue
Chair of Biological Imaging, Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine and Health & School of Computation, Information and Technology, Technical University of Munich(生物成像教授、转化癌症研究中央研究所(TranslaTUM)、医学与健康学院及计算、信息与技术学院、慕尼黑技术大学);Institute of Biological and Medical Imaging, Bioengineering Center, Helmholtz Zentrum München(生物与医学成像研究所、生物工程中心、海德堡中心慕尼黑);Institute of Computational Biology, Helmholtz Zentrum Munich(计算生物学研究所、海德堡中心慕尼黑);Institute of AI for Health, Helmholtz Zentrum Munich(健康人工智能研究所、海德堡中心慕尼黑);Ludwig-Maximilians-Universität München(路德维希-马克西米利安-慕尼黑大学)