arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.13151cs.CV
收藏

面向大规模零样本学习的语义增强知识图谱

Semantic Enhanced Knowledge Graph for Large-Scale Zero-Shot Learning

University of Electronic Science and Technology of China(电子科技大学)

Jiwei Wei, Yang Yang, Zeyu Ma, Jingjing Li, Xing Xu, Heng Tao Shen

摘要:

零样本学习一直是视觉和语言领域的研究热点。目前,大多数已有的方法采用结构化知识信息来建模类别之间的显式相关性,并使用深度图卷积网络来传播不同类别之间的信息。然而,很难向现有的结构化知识图谱中添加新的类别,并且深度图卷积网络遭受过平滑问题。在本文中,我们提供了一个新的语义增强的知识图谱,同时包含专家知识和类别的语义相关。我们的语义增强知识图谱可以进一步增强类别之间的相关性,使其易于吸收新的类别。为了在知识图谱上传播信息,提出了一种新的残差图卷积网络(ResGCN),可以有效地缓解过平滑问题.在广泛使用的大规模ImageNet-21 K数据集和AWA 2数据集上进行的实验表明了该方法的有效性,并建立了一种新的零样本学习方法。在大规模ImageNet-21 K上对不同特征提取网络的实验结果表明,该方法具有更好的泛化能力和鲁棒性。

英文摘要:

Zero-Shot Learning has been a highlighted research topic in both vision and language areas. Recently, most existing methods adopt structured knowledge information to model explicit correlations among categories and use deep graph convolutional network to propagate information between different categories. However, it is difficult to add new categories to existing structured knowledge graph, and deep graph convolutional network suffers from over-smoothing problem. In this paper, we provide a new semantic enhanced knowledge graph that contains both expert knowledge and categories semantic correlation. Our semantic enhanced knowledge graph can further enhance the correlations among categories and make it easy to absorb new categories. To propagate information on the knowledge graph, we propose a novel Residual Graph Convolutional Network (ResGCN), which can effectively alleviate the problem of over-smoothing. Experiments conducted on the widely used large-scale ImageNet-21K dataset and AWA2 dataset show the effectiveness of our method, and establish a new state-of-the-art on zero-shot learning. Moreover, our results on the large-scale ImageNet-21K with various feature extraction networks show that our method has better generalization and robustness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑