arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2112.07517cs.CVcs.AIcs.LG
收藏

一种面向领域泛化的风格和语义记忆机制

A Style and Semantic Memory Mechanism for Domain Generalization

University of Science and Technology of China(中国科学技术大学);JD AI Research(京东人工智能研究院)

Yang Chen, Yu Wang, Yingwei Pan, Ting Yao, Xinmei Tian, Tao Mei

摘要:

主流的领域泛化算法倾向于优先考虑跨领域语义不变性的假设。与此同时,固有的域内风格不变性通常被低估和搁置。在本文中,我们发现,利用域内风格不变性也是至关重要的,在提高领域泛化的效率。我们验证了这是至关重要的网络是什么领域的特征是不变的,并在实例之间共享的信息,使网络锐化其理解,提高其语义判别能力。相应地,我们还提出了一种新的“陪审团”机制,这是特别有效的学习领域之间有用的语义特征的共性。我们的完整模型STEAM可以被解释为一种新的概率图模型,其实现需要两种存储体的方便的构造:语义特征库和风格特征库。实证结果表明,我们提出的框架超越了国家的最先进的方法明显的利润率。

英文摘要:

Mainstream state-of-the-art domain generalization algorithms tend to prioritize the assumption on semantic invariance across domains. Meanwhile, the inherent intra-domain style invariance is usually underappreciated and put on the shelf. In this paper, we reveal that leveraging intra-domain style invariance is also of pivotal importance in improving the efficiency of domain generalization. We verify that it is critical for the network to be informative on what domain features are invariant and shared among instances, so that the network sharpens its understanding and improves its semantic discriminative ability. Correspondingly, we also propose a novel "jury" mechanism, which is particularly effective in learning useful semantic feature commonalities among domains. Our complete model called STEAM can be interpreted as a novel probabilistic graphical model, for which the implementation requires convenient constructions of two kinds of memory banks: semantic feature bank and style feature bank. Empirical results show that our proposed framework surpasses the state-of-the-art methods by clear margins.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑