arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.06112cs.CV

Spectral Unsupervised Domain Adaptation for Visual Recognition

S-lab(S实验室);Nanyang Technological University(南洋理工大学)

Jingyi Zhang, Jiaxing Huang, Zichen Tian, Shijian Lu

英文摘要:

Though unsupervised domain adaptation (UDA) has achieved very impressive progress recently, it remains a great challenge due to missing target annotations and the rich discrepancy between source and target distributions. We propose Spectral UDA (SUDA), an effective and efficient UDA technique that works in the spectral space and can generalize across different visual recognition tasks. SUDA addresses the UDA challenges from two perspectives. First, it introduces a spectrum transformer (ST) that mitigates inter-domain discrepancies by enhancing domain-invariant spectra while suppressing domain-variant spectra of source and target samples simultaneously. Second, it introduces multi-view spectral learning that learns useful unsupervised representations by maximizing mutual information among multiple ST-generated spectral views of each target sample. Extensive experiments show that SUDA achieves superior accuracy consistently across different visual tasks in object detection, semantic segmentation and image classification. Additionally, SUDA also works with the transformer-based network and achieves state-of-the-art performance on object detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑