arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.08115cs.AIcs.DBcs.IR
收藏

联合嵌入本体概念的知识库通用表示学习

Universal Representation Learning of Knowledge Bases by Jointly Embedding Instances and Ontological Concepts

University of California, Los Angeles(加利福尼亚大学洛杉矶分校)

Junheng Hao, Muhao Chen, Wenchao Yu, Yizhou Sun, Wei Wang

摘要:

许多大规模的知识库同时表示知识图谱(KG)的两个视图:抽象和常识概念的本体视图,以及从本体概念实例化的特定实体的实例视图。然而,现有的KG嵌入模型仅仅关注于表示两个视图中的一个。在本文中,我们提出了一种新的双视图KG嵌入模型,JOIE,其目标是产生更好的知识嵌入,并实现依赖于多视图知识的新应用程序。JOIE采用跨视图和视图内建模,在知识库的多个方面进行学习。跨视图关联模型被学习以桥接本体概念及其对应的实例视图实体的嵌入。视图内模型被训练以捕获在单独的嵌入空间中的实例和本体视图的结构化知识,其中针对具有层次结构的本体启用层次结构感知编码技术。我们探讨了两个模型组件的多种表示技术,并与九个变种的JOIE调查。我们的模型是在大规模的知识库上训练的,这些知识库由大量的实例及其相应的本体概念组成,这些概念通过一组(小的)跨视图链接连接。在公共数据集上的实验结果表明,JOIE的最佳变体在实例视图三重预测任务和本体视图KG上的本体种群上的性能明显优于以前的模型。此外,我们的模型成功地将KG嵌入的使用扩展到实体类型,具有良好的性能。

英文摘要:

Many large-scale knowledge bases simultaneously represent two views of knowledge graphs (KGs): an ontology view for abstract and commonsense concepts, and an instance view for specific entities that are instantiated from ontological concepts. Existing KG embedding models, however, merely focus on representing one of the two views alone. In this paper, we propose a novel two-view KG embedding model, JOIE, with the goal to produce better knowledge embedding and enable new applications that rely on multi-view knowledge. JOIE employs both cross-view and intra-view modeling that learn on multiple facets of the knowledge base. The cross-view association model is learned to bridge the embeddings of ontological concepts and their corresponding instance-view entities. The intra-view models are trained to capture the structured knowledge of instance and ontology views in separate embedding spaces, with a hierarchy-aware encoding technique enabled for ontologies with hierarchies. We explore multiple representation techniques for the two model components and investigate with nine variants of JOIE. Our model is trained on large-scale knowledge bases that consist of massive instances and their corresponding ontological concepts connected via a (small) set of cross-view links. Experimental results on public datasets show that the best variant of JOIE significantly outperforms previous models on instance-view triple prediction task as well as ontology population on ontologyview KG. In addition, our model successfully extends the use of KG embeddings to entity typing with promising performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑