用于无监督域适应的对比双投影器
Contrastive Bi-Projector for Unsupervised Domain Adaption
AI总结:
本文提出基于对比双投影器的无监督域适应方法CBPUDA,通过双投影器对抗训练结合对比差异损失与梯度缩放方案,生成更精细决策边界,使特征类内紧凑类间可分,在UDA和细粒度任务上优于传统方法。
摘要:
本文提出了一种基于对比双投影器(CBP)的新型无监督域适应(UDA)方法,能够改进现有的UDA方法。该方法在此被称为CBPUDA,它有效促使特征提取器(FEs)减少用于分类和域适应的模糊特征的生成。CBP不同于传统的基于双分类器的方法,它将这两个分类器替换为两个投影器,执行从输入特征到两个不同特征的映射。CBPUDA中的这两个投影器和FEs可以进行对抗训练,以获得更精细的决策边界,从而具备强大的分类性能。本文分析了所提出损失函数的两个性质。第一个性质是推导联合预测熵的上界,用于形成所提出的损失函数,即对比差异(CD)损失。CD损失结合了对比学习和双分类器的优势。第二个性质是分析CD损失的梯度,进而克服CD损失的缺陷。第二个性质的结果被用于本文中梯度缩放(GS)方案的开发。由于训练CBPUDA需要同时使用对比学习和对抗学习,GS方案可用于解决CD损失的不稳定问题。因此,将CD损失与GS方案结合使用克服了上述问题,使特征在类内更紧凑,在类间更具区分性。实验结果表明,在本文所考虑的UDA和细粒度UDA任务中,CBPUDA优于传统的UDA方法。
英文摘要:
This paper proposes a novel unsupervised domain adaption (UDA) method based on contrastive bi-projector (CBP), which can improve the existing UDA methods. It is called CBPUDA here, which effectively promotes the feature extractors (FEs) to reduce the generation of ambiguous features for classification and domain adaption. The CBP differs from traditional bi-classifier-based methods at that these two classifiers are replaced with two projectors of performing a mapping from the input feature to two distinct features. These two projectors and the FEs in the CBPUDA can be trained adversarially to obtain more refined decision boundaries so that it can possess powerful classification performance. Two properties of the proposed loss function are analyzed here. The first property is to derive an upper bound of joint prediction entropy, which is used to form the proposed loss function, contrastive discrepancy (CD) loss. The CD loss takes the advantages of the contrastive learning and the bi-classifier. The second property is to analyze the gradient of the CD loss and then overcome the drawback of the CD loss. The result of the second property is utilized in the development of the gradient scaling (GS) scheme in this paper. The GS scheme can be exploited to tackle the unstable problem of the CD loss because training the CBPUDA requires using contrastive learning and adversarial learning at the same time. Therefore, using the CD loss with the GS scheme overcomes the problem mentioned above to make features more compact for intra-class and distinguishable for inter-class. Experimental results express that the CBPUDA is superior to conventional UDA methods under consideration in this paper for UDA and fine-grained UDA tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。