arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1610.04420stat.MLcs.LG
收藏

最优传输域自适应的理论分析

Theoretical Analysis of Domain Adaptation with Optimal Transport

Univ.Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne CNRS, Inserm, CREATIS UMR 5220, U1206(里昂大学,里昂国立应用科学学院,里昂第一大学,圣埃蒂安让·莫内大学,法国国家科学研究中心,法国国家健康与医学研究院,CREATIS实验室);Univ. Lyon, UJM-Saint-Etienne CNRS, Lab. Hubert Curien UMR 5516(里昂大学,圣埃蒂安让·莫内大学,法国国家科学研究中心,于贝尔·居里安实验室)

Ievgen Redko, Amaury Habrard, Marc Sebban

摘要:

领域自适应(DA)是机器学习的一个重要的新兴领域,它解决了训练(源域)和测试(目标域)数据分布相似但不同的问题。目前的理论研究表明,DA算法的效率取决于其最小化源和目标概率分布之间的分歧的能力。在本文中,我们提供了一个理论研究的优势,从最优运输理论借用的概念可以带来DA。特别是,我们表明,Wasserstein度量可以用作分布之间的分歧措施,以获得泛化保证三个不同的学习设置:(i)具有无监督目标数据的经典DA(ii)结合源和目标标记数据的DA,(iii)多源DA。基于所获得的结果,我们提供了一些见解,表明这种分析何时可以比其他现有框架更严格。

英文摘要:

Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. Current theoretical results show that the efficiency of DA algorithms depends on their capacity of minimizing the divergence between source and target probability distributions. In this paper, we provide a theoretical study on the advantages that concepts borrowed from optimal transportation theory can bring to DA. In particular, we show that the Wasserstein metric can be used as a divergence measure between distributions to obtain generalization guarantees for three different learning settings: (i) classic DA with unsupervised target data (ii) DA combining source and target labeled data, (iii) multiple source DA. Based on the obtained results, we provide some insights showing when this analysis can be tighter than other existing frameworks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑