arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.15796cs.CVcs.LG
收藏

现实世界领域泛化的自适应方法

Adaptive Methods for Real-World Domain Generalization

MIT(麻省理工学院);Facebook AI

Abhimanyu Dubey, Vignesh Ramanathan, Alex Pentland, Dhruv Mahajan

摘要:

不变量方法在解决领域泛化问题方面取得了显著的成功,其中目标是对与训练中使用的数据分布不同的数据分布进行推断。在我们的工作中,我们调查是否有可能利用域信息从看不见的测试样本本身。我们提出了一种域自适应方法,包括两个步骤:a)我们首先从无监督的训练样本中学习一个判别域嵌入,b)使用该域嵌入作为补充信息来构建一个域自适应模型,该模型在进行预测时考虑了输入及其域。对于看不见的域,我们的方法简单地使用一些未标记的测试示例来构造域嵌入。这使得能够在任何看不见的域上进行自适应分类。我们的方法在各种领域泛化基准测试中达到了最先进的性能。此外,我们介绍了第一个真实世界的,大规模的领域泛化基准,Geo-YFCC,包含超过40个训练,7个验证和15个测试域,数量级大于以前的工作1.1 M样本。我们发现,现有的方法要么不能扩展到这个数据集,要么与在所有训练域的数据联合上训练模型的简单基线相比表现不佳。相比之下,我们的方法实现了显着的改善。

英文摘要:

Invariant approaches have been remarkably successful in tackling the problem of domain generalization, where the objective is to perform inference on data distributions different from those used in training. In our work, we investigate whether it is possible to leverage domain information from the unseen test samples themselves. We propose a domain-adaptive approach consisting of two steps: a) we first learn a discriminative domain embedding from unsupervised training examples, and b) use this domain embedding as supplementary information to build a domain-adaptive model, that takes both the input as well as its domain into account while making predictions. For unseen domains, our method simply uses few unlabelled test examples to construct the domain embedding. This enables adaptive classification on any unseen domain. Our approach achieves state-of-the-art performance on various domain generalization benchmarks. In addition, we introduce the first real-world, large-scale domain generalization benchmark, Geo-YFCC, containing 1.1M samples over 40 training, 7 validation, and 15 test domains, orders of magnitude larger than prior work. We show that the existing approaches either do not scale to this dataset or underperform compared to the simple baseline of training a model on the union of data from all training domains. In contrast, our approach achieves a significant improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑