SMiLE:用于知识图谱链接预测的模式增强多级对比学习
SMiLE: Schema-augmented Multi-level Contrastive Learning for Knowledge Graph Link Prediction
AI总结:
针对知识图谱链接预测中上下文信息与实体表示一致性不足的问题,提出SMiLE框架,利用网络模式采样负例并进行多级对比预训练与三元组监督微调,在四个数据集上优于先进基线。
摘要:
链接预测是推断知识图谱中实体之间缺失链接的任务。基于嵌入的方法通过对三元组中的关系模式进行建模,已在解决该问题上展现出有效性。然而,链接预测任务通常需要实体邻域中的上下文信息,而大多数现有基于嵌入的方法无法捕捉这种信息。此外,实体表示在不同上下文中的多样性很少受到关注,这往往会导致错误的预测结果。在这种情况下,我们认为知识图谱的模式包含特定的上下文信息,并且有助于保持实体在不同上下文中的一致性。本文提出了一种新颖的模式增强多级对比学习框架(Schema-augmented Multi-level contrastive LEarning framework,SMiLE),用于开展知识图谱链接预测。具体而言,我们首先利用网络模式作为先验约束来采样负例,并采用多级对比学习方法预训练模型,以同时生成先验模式和上下文信息。随后,我们在单个三元组的监督下对模型进行微调,从而学习更精细的表示以用于链接预测。在四个知识图谱数据集上的大量实验结果以及对每个组件的深入分析表明,与最先进的基线相比,我们提出的框架具有有效性。SMiLE 的实现可在 https://github.com/GKNL/SMiLE 获取。
英文摘要:
Link prediction is the task of inferring missing links between entities in knowledge graphs. Embedding-based methods have shown effectiveness in addressing this problem by modeling relational patterns in triples. However, the link prediction task often requires contextual information in entity neighborhoods, while most existing embedding-based methods fail to capture it. Additionally, little attention is paid to the diversity of entity representations in different contexts, which often leads to false prediction results. In this situation, we consider that the schema of knowledge graph contains the specific contextual information, and it is beneficial for preserving the consistency of entities across contexts. In this paper, we propose a novel Schema-augmented Multi-level contrastive LEarning framework (SMiLE) to conduct knowledge graph link prediction. Specifically, we first exploit network schema as the prior constraint to sample negatives and pre-train our model by employing a multi-level contrastive learning method to yield both prior schema and contextual information. Then we fine-tune our model under the supervision of individual triples to learn subtler representations for link prediction. Extensive experimental results on four knowledge graph datasets with thorough analysis of each component demonstrate the effectiveness of our proposed framework against state-of-the-art baselines. The implementation of SMiLE is available at https://github.com/GKNL/SMiLE.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。