arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.14105cs.CV
收藏

学习跨域语义-视觉关系以用于直推式零样本学习

Learning Cross-domain Semantic-Visual Relationships for Transductive Zero-Shot Learning

Southwest Jiaotong University(西南交通大学);University of Electronic Science and Technology of China(电子科技大学);Chongqing University(重庆大学);Guangzhou University(广州大学)

Fengmao Lv, Jianyang Zhang, Guowu Yang, Lei Feng, Yufeng Yu, Lixin Duan

AI总结:

针对零样本学习中源域与目标域标签空间不相交导致领域自适应难以直接应用的问题,提出TSVR方法,将图像识别转化为预测语义-视觉对的相似性标签以统一标签空间,并利用特定领域批量归一化对齐领域差异。

摘要:

零样本学习(ZSL)旨在学习能够识别新类别的模型。ZSL的主要挑战之一是由训练和测试数据之间的类别不一致引起的领域差异。领域自适应是解决这一挑战最直观的方法。然而,由于源域和目标域之间的标签空间不相交,现有的领域自适应技术无法直接应用于ZSL。本工作提出了一种面向直推式ZSL的可迁移语义-视觉关系(TSVR)方法。TSVR将图像识别重新定义为预测由类别属性和视觉特征组成的语义-视觉融合的相似性/不相似性标签。经过上述转换,源域和目标域可以拥有相同的标签空间,从而能够量化领域差异。对于重新定义的问题,相似的语义-视觉对的数量明显少于不相似的对。为此,我们进一步提出使用特定领域批量归一化来对齐领域差异。

英文摘要:

Zero-Shot Learning (ZSL) learns models for recognizing new classes. One of the main challenges in ZSL is the domain discrepancy caused by the category inconsistency between training and testing data. Domain adaptation is the most intuitive way to address this challenge. However, existing domain adaptation techniques cannot be directly applied into ZSL due to the disjoint label space between source and target domains. This work proposes the Transferrable Semantic-Visual Relation (TSVR) approach towards transductive ZSL. TSVR redefines image recognition as predicting the similarity/dissimilarity labels for semantic-visual fusions consisting of class attributes and visual features. After the above transformation, the source and target domains can have the same label space, which hence enables to quantify domain discrepancy. For the redefined problem, the number of similar semantic-visual pairs is significantly smaller than that of dissimilar ones. To this end, we further propose to use Domain-Specific Batch Normalization to align the domain discrepancy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑