尊重领域关系：领域泛化的假设不变性
Respecting Domain Relations: Hypothesis Invariance for Domain Generalization
摘要：
在领域泛化中，训练过程中可以使用多个带标签的非独立且非同分布的源域，而目标域的数据和标签都不可用。目前，学习领域不变表示（DIR）是领域泛化的主流方法。在这项工作中，我们定义了现有的作品中采用的概率术语的DIR，并表明，通过学习DIR，过于严格的要求施加有关的不变性。具体地，DIR旨在完美地对齐不同域的表示，即它们的输入分布。然而，这对于良好地推广到目标域是不必要的，并且甚至可能处理有价值的分类信息。我们建议学习所谓的假设不变表示（HIR），它通过仅仅对齐后验而不是对齐表示来放松不变性假设。我们报告了在公共领域泛化数据集上的实验结果，表明学习HIR比学习DIR更有效。事实上，我们的方法甚至可以与使用领域先验知识的方法竞争。
英文摘要：
In domain generalization, multiple labeled non-independent and non-identically distributed source domains are available during training while neither the data nor the labels of target domains are. Currently, learning so-called domain invariant representations (DIRs) is the prevalent approach to domain generalization. In this work, we define DIRs employed by existing works in probabilistic terms and show that by learning DIRs, overly strict requirements are imposed concerning the invariance. Particularly, DIRs aim to perfectly align representations of different domains, i.e. their input distributions. This is, however, not necessary for good generalization to a target domain and may even dispose of valuable classification information. We propose to learn so-called hypothesis invariant representations (HIRs), which relax the invariance assumptions by merely aligning posteriors, instead of aligning representations. We report experimental results on public domain generalization datasets to show that learning HIRs is more effective than learning DIRs. In fact, our approach can even compete with approaches using prior knowledge about domains.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
