arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.11202cs.LGcs.CVstat.ML
收藏

基于非线性校正的无监督领域自适应

Unsupervised Domain Adaptation via Calibrating Uncertainties

Rutgers University(罗格斯大学);Carnegie Mellon University(卡内基梅隆大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Ligong Han, Yang Zou, Ruijiang Gao, Lezi Wang, Dimitris Metaxas

摘要:

无监督领域自适应(UDA)的目的是在给定相关标记源数据集的情况下,为未标记的目标领域推断类别标记。直觉上,在源域上训练的模型通常会对看不见的数据产生更高的不确定性。在这项工作中,我们建立在这一假设的基础上,并提出通过校准其预测不确定性来适应从源域到目标域。不确定性被量化为Renyi熵,我们提出了一个通用的Renyi熵正则化(RER)框架。我们进一步采用变分贝叶斯学习可靠的不确定性估计。此外,校准网络参数的样本方差作为一个插件正则化训练。我们讨论了所提出的方法的理论特性,并证明了其有效性的三个域适应任务。

英文摘要:

Unsupervised domain adaptation (UDA) aims at inferring class labels for unlabeled target domain given a related labeled source dataset. Intuitively, a model trained on source domain normally produces higher uncertainties for unseen data. In this work, we build on this assumption and propose to adapt from source to target domain via calibrating their predictive uncertainties. The uncertainty is quantified as the Renyi entropy, from which we propose a general Renyi entropy regularization (RER) framework. We further employ variational Bayes learning for reliable uncertainty estimation. In addition, calibrating the sample variance of network parameters serves as a plug-in regularizer for training. We discuss the theoretical properties of the proposed method and demonstrate its effectiveness on three domain-adaptation tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑