arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.14284cs.CVcs.LG
收藏

具有生成最近邻的领域泛化中的离散极小化

Discrepancy Minimization in Domain Generalization with Generative Nearest Neighbors

IIT Delhi(印度理工学院德里分校)

Prashant Pandey, Mrigank Raman, Sumanth Varambally, Prathosh AP

摘要:

领域泛化(DG)处理在多个源域上训练的机器学习模型在具有不同统计数据的目标域上不能很好地泛化的域移位问题。已经提出了多种方法来解决领域泛化的问题,通过学习跨源域的域不变表示,其不能保证在移位的目标域上的泛化。我们提出了一种基于生成最近邻的离散最小化(GNNDM)方法,它提供了一个理论上的保证,在标记过程中的目标的误差上界。我们采用了一个域离散最小化网络(DDMN),学习域不可知的功能,以产生一个单一的源域,同时保留数据点的类标签。使用生成模型学习从该源域提取的特征,该生成模型的潜在空间用作采样器以检索目标数据点的最近邻居。与现有方法相比,所提出的方法不需要访问域标签(更现实的场景)。经验上,我们证明了我们的方法在两个数据集上的有效性:PACS和VLCS。通过大量的实验,我们证明了所提出的方法,优于几个国家的最先进的DG方法的有效性。

英文摘要:

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed to solve the problem of domain generalization by learning domain invariant representations across the source domains that fail to guarantee generalization on the shifted target domain. We propose a Generative Nearest Neighbor based Discrepancy Minimization (GNNDM) method which provides a theoretical guarantee that is upper bounded by the error in the labeling process of the target. We employ a Domain Discrepancy Minimization Network (DDMN) that learns domain agnostic features to produce a single source domain while preserving the class labels of the data points. Features extracted from this source domain are learned using a generative model whose latent space is used as a sampler to retrieve the nearest neighbors for the target data points. The proposed method does not require access to the domain labels (a more realistic scenario) as opposed to the existing approaches. Empirically, we show the efficacy of our method on two datasets: PACS and VLCS. Through extensive experimentation, we demonstrate the effectiveness of the proposed method that outperforms several state-of-the-art DG methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑