arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.12339cs.CV
收藏

广义域条件自适应网络

Generalized Domain Conditioned Adaptation Network

School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);Department of Automation, Tsinghua University(清华大学自动化系)

Shuang Li, Binhui Xie, Qiuxia Lin, Chi Harold Liu, Gao Huang, Guoren Wang

摘要:

领域自适应(DA)试图将在标记的源领域中学习到的知识转移到未标记但相关的目标领域,而不需要大量的目标监督。DA的最新进展主要通过对齐源和靶分布来进行。尽管取得了显著的成功,但当源域和目标域遇到较大的分布差异时,自适应性能仍然会相应下降。我们认为这种限制可能归因于对领域专用特征的探索不足,因为大多数研究仅仅集中在特定任务层的领域通用特征学习,并集成完全共享的卷积网络(convnets)来生成两个领域的共同特征。在本文中,我们放松了以前的DA方法所采用的完全共享的convnets假设,并提出域条件自适应网络(DCAN),它引入了域条件信道注意模块与多路径结构,分别激发每个域的信道激活。这样一个部分共享的convnets模块允许适当地探索低级别的领域专用功能。此外,鉴于知识的可转移性随着卷积层的变化而变化,我们开发了广义域条件适应网络(GDCAN)来自动确定是否应该在每个注意力模块中单独建模域通道激活。然后,根据领域统计差距自适应地提取关键领域专业知识。据我们所知,这是第一个单独探索深度DA网络的域卷积信道激活的工作。此外,为了有效地匹配跨域的高级特征分布,我们考虑在特定于任务的层之后部署特征适配块,这可以显式地减轻域差异。

英文摘要:

Domain Adaptation (DA) attempts to transfer knowledge learned in the labeled source domain to the unlabeled but related target domain without requiring large amounts of target supervision. Recent advances in DA mainly proceed by aligning the source and target distributions. Despite the significant success, the adaptation performance still degrades accordingly when the source and target domains encounter a large distribution discrepancy. We consider this limitation may attribute to the insufficient exploration of domain-specialized features because most studies merely concentrate on domain-general feature learning in task-specific layers and integrate totally-shared convolutional networks (convnets) to generate common features for both domains. In this paper, we relax the completely-shared convnets assumption adopted by previous DA methods and propose Domain Conditioned Adaptation Network (DCAN), which introduces domain conditioned channel attention module with a multi-path structure to separately excite channel activation for each domain. Such a partially-shared convnets module allows domain-specialized features in low-level to be explored appropriately. Further, given the knowledge transferability varying along with convolutional layers, we develop Generalized Domain Conditioned Adaptation Network (GDCAN) to automatically determine whether domain channel activations should be separately modeled in each attention module. Afterward, the critical domain-specialized knowledge could be adaptively extracted according to the domain statistic gaps. As far as we know, this is the first work to explore the domain-wise convolutional channel activations separately for deep DA networks. Additionally, to effectively match high-level feature distributions across domains, we consider deploying feature adaptation blocks after task-specific layers, which can explicitly mitigate the domain discrepancy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑