arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.15241cs.LGstat.ML
收藏

基于部分特征去相关的分布外泛化

Out-of-distribution Generalization via Partial Feature Decorrelation

Zhejiang University(浙江大学);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院)

Xin Guo, Zhengxu Yu, Chao Xiang, Zhongming Jin, Jianqiang Huang, Deng Cai, Xiaofei He, Xian-Sheng Hua

摘要:

大多数基于深度学习的图像分类方法假设所有样本都是在独立同分布(IID)设置下生成的。然而,分布外(OOD)泛化在实践中更常见,这意味着训练和测试环境之间的不可知上下文分布偏移。为了解决这个问题,我们提出了一种新的部分特征解相关学习(PFDL)算法,它联合优化的特征分解网络和目标图像分类模型。特征分解网络将特征嵌入分解为独立部分和相关部分,从而突出特征之间的相关性。然后,相关的特征有助于学习一个稳定的特征表示,通过解相关的突出显示的相关性,同时优化图像分类模型。我们在一个合成数据集上验证了特征分解网络的相关建模能力。在真实数据集上的实验表明,该方法可以提高骨干模型在面向对象图像分类数据集上的分类精度。

英文摘要:

Most deep-learning-based image classification methods assume that all samples are generated under an independent and identically distributed (IID) setting. However, out-of-distribution (OOD) generalization is more common in practice, which means an agnostic context distribution shift between training and testing environments. To address this problem, we present a novel Partial Feature Decorrelation Learning (PFDL) algorithm, which jointly optimizes a feature decomposition network and the target image classification model. The feature decomposition network decomposes feature embeddings into the independent and the correlated parts such that the correlations between features will be highlighted. Then, the correlated features help learn a stable feature representation by decorrelating the highlighted correlations while optimizing the image classification model. We verify the correlation modeling ability of the feature decomposition network on a synthetic dataset. The experiments on real-world datasets demonstrate that our method can improve the backbone model's accuracy on OOD image classification datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑