arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.12293cs.LGcs.AI
收藏

基于动态分布适应和流形正则化的有监督异构迁移学习框架

A Framework for Supervised Heterogeneous Transfer Learning using Dynamic Distribution Adaptation and Manifold Regularization

Charles Sturt University(查尔斯特大学);Bangladesh Agricultural University(孟加拉国农业大学)

Md Geaur Rahman, Md Zahidul Islam

摘要:

迁移学习旨在通过从源领域转移知识来学习目标领域的分类器。然而,由于两个主要问题:特征差异和分布差异,迁移学习在实践中可能是一个非常困难的问题。在本文中,我们提出了一个称为TLF的框架,该框架通过从具有许多标记记录的源域转移知识,为只有少量标记训练记录的目标域构建分类器。虽然现有的方法往往侧重于一个问题,而将另一个问题留给进一步的工作,但TLF能够同时处理这两个问题。在TLF中,我们通过识别共享标签分布来缓解特征差异,这些标签分布作为桥接域的枢轴。我们通过同时优化结构风险泛函、域间联合分布和边缘分布的流形一致性来处理分布发散。此外,对于流形的一致性,我们利用其内在的属性,通过识别k个最近的邻居的记录,其中k的值是自动确定的TLF。此外,由于不希望负迁移,我们只考虑在知识转移过程中属于源枢轴的源记录。我们评估TLF七个公开的自然数据集,并比较TLF的性能对十四个国家的最先进的技术的性能。我们还评估了TLF在一些具有挑战性的情况下的有效性。我们的实验结果,包括统计符号测试和Nemenyi测试分析,表明所提出的框架在国家的最先进的技术有明显的优越性。

英文摘要:

Transfer learning aims to learn classifiers for a target domain by transferring knowledge from a source domain. However, due to two main issues: feature discrepancy and distribution divergence, transfer learning can be a very difficult problem in practice. In this paper, we present a framework called TLF that builds a classifier for the target domain having only few labeled training records by transferring knowledge from the source domain having many labeled records. While existing methods often focus on one issue and leave the other one for the further work, TLF is capable of handling both issues simultaneously. In TLF, we alleviate feature discrepancy by identifying shared label distributions that act as the pivots to bridge the domains. We handle distribution divergence by simultaneously optimizing the structural risk functional, joint distributions between domains, and the manifold consistency underlying marginal distributions. Moreover, for the manifold consistency we exploit its intrinsic properties by identifying k nearest neighbors of a record, where the value of k is determined automatically in TLF. Furthermore, since negative transfer is not desired, we consider only the source records that are belonging to the source pivots during the knowledge transfer. We evaluate TLF on seven publicly available natural datasets and compare the performance of TLF against the performance of fourteen state-of-the-art techniques. We also evaluate the effectiveness of TLF in some challenging situations. Our experimental results, including statistical sign test and Nemenyi test analyses, indicate a clear superiority of the proposed framework over the state-of-the-art techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑