arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.19095cs.AIcs.LG
收藏

PathE:利用实体无关路径实现参数高效的知识图谱嵌入

PathE: Leveraging Entity-Agnostic Paths for Parameter-Efficient Knowledge Graph Embeddings

King’s College London(伦敦国王学院);University of Liverpool(利物浦大学)

Ioannis Reklos, Jacopo de Berardinis, Elena Simperl, Albert Meroño-Peñuela

AI总结:

PathE模型通过仅为关系分配嵌入表并利用实体-关系路径计算实体嵌入,解决了大规模知识图谱嵌入的计算可扩展性问题,在减少参数的同时保持了竞争性能。

摘要:

知识图谱(KGs)以实体(节点)和关系的形式存储人类知识,被广泛应用于各种应用中。知识图谱嵌入是解决知识发现、链接预测和推理等任务的有效方法。这通常通过为所有或部分实体分配并学习嵌入表来实现。由于该方法在计算上随实体数量呈线性增长,在拥有数百万节点的真实世界知识图谱中学习嵌入模型在计算上可能变得不可行。为了解决这一可扩展性问题,我们的模型PathE仅为关系(通常比实体少几个数量级)分配嵌入表,且所需参数量不到以往参数高效方法的25%。我们不再存储实体嵌入,而是通过利用多条实体-关系路径来计算实体嵌入,从而在三元组中对单个实体进行上下文化处理。在四个基准上进行评估,PathE在关系预测中实现了最先进的性能,并在消费级硬件上训练时,在路径丰富的知识图谱上的链接预测中保持竞争力。我们进行了消融实验以测试我们的设计选择,并分析了模型对关键超参数的敏感性。PathE对于现实应用中常见的关系多样且连接良好的知识图谱是高效且具有成本效益的。

英文摘要:

Knowledge Graphs (KGs) store human knowledge in the form of entities (nodes) and relations, and are used extensively in various applications. KG embeddings are an effective approach to addressing tasks like knowledge discovery, link prediction, and reasoning. This is often done by allocating and learning embedding tables for all or a subset of the entities. As this scales linearly with the number of entities, learning embedding models in real-world KGs with millions of nodes can be computationally intractable. To address this scalability problem, our model, PathE, only allocates embedding tables for relations (which are typically orders of magnitude fewer than the entities) and requires less than 25% of the parameters of previous parameter efficient methods. Rather than storing entity embeddings, we learn to compute them by leveraging multiple entity-relation paths to contextualise individual entities within triples. Evaluated on four benchmarks, PathE achieves state-of-the-art performance in relation prediction, and remains competitive in link prediction on path-rich KGs while training on consumer-grade hardware. We perform ablation experiments to test our design choices and analyse the sensitivity of the model to key hyper-parameters. PathE is efficient and cost-effective for relationally diverse and well-connected KGs commonly found in real-world applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑