arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1811.04441cs.AIcs.CL
收藏

用于知识库补全的端到端结构感知卷积网络

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

University of Connecticut(康涅狄格大学);JD AI Research(京东人工智能研究院)

Chao Shang, Yun Tang, Jing Huang, Jinbo Bi, Xiaodong He, Bowen Zhou

摘要:

知识图谱嵌入是知识库补全的一个活跃的研究课题,从最初的transE、transH、DistMult等算法到目前最先进的ConvE算法,知识图谱嵌入技术不断发展。ConvE在嵌入和多层非线性特征上使用2D卷积来建模知识图谱。该模型可以有效地训练和扩展到大型知识图谱。然而,在ConvE的嵌入空间中没有结构强制。最近的图卷积网络(GCN)通过成功地利用图的连通性结构,提供了另一种学习图节点嵌入的方法。在这项工作中,我们提出了一种新的端到端结构感知卷积网络(SACN),它将GCN和ConvE的优点结合在一起。SACN由加权图卷积网络(WGCN)的编码器和称为Conv-TransE的卷积网络的解码器组成。WGCN利用了知识图谱的节点结构、节点属性和边关系类型。它具有可学习的权重,可以适应本地聚合中使用的邻居信息量,从而更准确地嵌入图节点。图中的节点属性表示为WGCN中的附加节点。解码器Conv-TransE使最先进的ConvE能够在实体和关系之间平移,同时保持与ConvE相同的链接预测性能。我们在标准FB 15 k-237和WN 18 RR数据集上证明了所提出的SACN的有效性,并且在HITS@1,HITS@3和HITS@10方面,它比最先进的ConvE相对提高了约10%。

英文摘要:

Knowledge graph embedding has been an active research topic for knowledge base completion, with progressive improvement from the initial TransE, TransH, DistMult et al to the current state-of-the-art ConvE. ConvE uses 2D convolution over embeddings and multiple layers of nonlinear features to model knowledge graphs. The model can be efficiently trained and scalable to large knowledge graphs. However, there is no structure enforcement in the embedding space of ConvE. The recent graph convolutional network (GCN) provides another way of learning graph node embedding by successfully utilizing graph connectivity structure. In this work, we propose a novel end-to-end Structure-Aware Convolutional Network (SACN) that takes the benefit of GCN and ConvE together. SACN consists of an encoder of a weighted graph convolutional network (WGCN), and a decoder of a convolutional network called Conv-TransE. WGCN utilizes knowledge graph node structure, node attributes and edge relation types. It has learnable weights that adapt the amount of information from neighbors used in local aggregation, leading to more accurate embeddings of graph nodes. Node attributes in the graph are represented as additional nodes in the WGCN. The decoder Conv-TransE enables the state-of-the-art ConvE to be translational between entities and relations while keeps the same link prediction performance as ConvE. We demonstrate the effectiveness of the proposed SACN on standard FB15k-237 and WN18RR datasets, and it gives about 10% relative improvement over the state-of-the-art ConvE in terms of HITS@1, HITS@3 and HITS@10.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑