arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.08557cs.CV
收藏

DICS:为分布外泛化寻找域不变且类别特定的特征

DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization

Zhejiang University(浙江大学)

Qiaowei Miao, Yawei Luo, Yi Yang

AI总结:

针对分布外泛化中现有方法忽略域不变特征类别特异性的问题,提出含域不变性测试和类别特异性测试的DICS模型,缓解混淆因素的虚假关联,实验验证其有效性。

摘要:

尽管深度神经网络在各类视觉任务中已取得显著进展,但在分布外(OOD)场景下测试时,其性能通常会出现下降。许多OOD方法聚焦于提取域不变特征,却忽略了这些特征是否为每个类别所独有。即便部分特征具备域不变性,若它们在不同类别间共享,也无法作为核心分类依据。在OOD任务中,域相关特征与类别共享特征都会作为混淆因素阻碍泛化。本文提出DICS模型以提取域不变且类别特定的特征,该模型包含域不变性测试(DIT)和类别特异性测试(CST),可缓解混淆因素引入的虚假关联影响。DIT学习每个源域的域相关特征,并将其从输入中移除,以分离出域不变的类别相关特征;DIT通过对齐不同域间的同类特征来确保域不变性。随后,CST通过将这些特征与前序步骤学习到的特征进行对比,计算其软标签。我们优化软标签与真实标签之间的交叉熵,以此增强同类相似性与异类差异性,从而强化类别特异性。在常用基准上开展的大量实验证明了所提算法的有效性。额外的可视化结果进一步表明,DICS能有效识别目标域中每个类别的关键特征。

英文摘要:

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features but neglect whether these features are unique to each class. Even if some features are domain-invariant, they cannot serve as key classification criteria if shared across different classes. In OOD tasks, both domain-related and class-shared features act as confounders that hinder generalization. In this paper, we propose a DICS model to extract Domain-Invariant and Class-Specific features, including Domain Invariance Testing (DIT) and Class Specificity Testing (CST), which mitigate the effects of spurious correlations introduced by confounders. DIT learns domain-related features of each source domain and removes them from inputs to isolate domain-invariant class-related features. DIT ensures domain invariance by aligning same-class features across different domains. Then, CST calculates soft labels for those features by comparing them with features learned in previous steps. We optimize the cross-entropy between the soft labels and their true labels, which enhances same-class similarity and different-class distinctiveness, thereby reinforcing class specificity. Extensive experiments on widely-used benchmarks demonstrate the effectiveness of our proposed algorithm. Additional visualizations further demonstrate that DICS effectively identifies the key features of each class in target domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑