arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.12816cs.CL
收藏

基于聚类的Few-Shot分类的归纳无监督领域自适应

Inductive Unsupervised Domain Adaptation for Few-Shot Classification via Clustering

Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Xiaomi Inc.(小米公司)

Xin Cong, Bowen Yu, Tingwen Liu, Shiyao Cui, Hengzhu Tang, Bin Wang

摘要:

当需要适应不同的领域时,Few-Shot分类往往会遇到困难。由于域之间的标签空间不重叠,传统的领域自适应的性能受到限制。以前的工作处理的问题,在一个transductive的方式,通过假设访问的全套测试数据,这是太多的限制,为许多现实世界的应用程序。在本文中,我们着手解决这个问题,通过引入一个归纳框架,DaFeC,通过聚类提高领域自适应性能的Few-Shot分类。我们首先构建一个表示提取器来从目标域中获取未标记数据的特征(不需要测试数据),然后用聚类挖掘器将它们分组。生成的伪标记数据和标记的源域数据被用作监督以更新Few-Shot分类器的参数。为了获得高质量的伪标签,我们提出了一种聚类提升机制,通过相似熵最小化和对抗性分布对齐,结合余弦退火策略,为目标域学习更好的特征。实验在FewRel 2.0数据集上进行。我们的方法优于以前的工作,在四个Few-Shot设置下的绝对增益(分类准确率)分别为4.95%,9.55%,3.99%和11.62%。

英文摘要:

Few-shot classification tends to struggle when it needs to adapt to diverse domains. Due to the non-overlapping label space between domains, the performance of conventional domain adaptation is limited. Previous work tackles the problem in a transductive manner, by assuming access to the full set of test data, which is too restrictive for many real-world applications. In this paper, we set out to tackle this issue by introducing a inductive framework, DaFeC, to improve Domain adaptation performance for Few-shot classification via Clustering. We first build a representation extractor to derive features for unlabeled data from the target domain (no test data is necessary) and then group them with a cluster miner. The generated pseudo-labeled data and the labeled source-domain data are used as supervision to update the parameters of the few-shot classifier. In order to derive high-quality pseudo labels, we propose a Clustering Promotion Mechanism, to learn better features for the target domain via Similarity Entropy Minimization and Adversarial Distribution Alignment, which are combined with a Cosine Annealing Strategy. Experiments are performed on the FewRel 2.0 dataset. Our approach outperforms previous work with absolute gains (in classification accuracy) of 4.95%, 9.55%, 3.99% and 11.62%, respectively, under four few-shot settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑