arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.07544cs.LGcs.AI
收藏

知识图谱中基于秩的链接预测评价算法的统一框架

A Unified Framework for Rank-based Evaluation Metrics for Link Prediction in Knowledge Graphs

Harvard Medical School(哈佛医学院);LMU Munich(慕尼黑大学);Mila(米拉研究所);McGill University(麦吉尔大学);Siemens AG(西门子股份公司)

Charles Tapley Hoyt, Max Berrendorf, Mikhail Galkin, Volker Tresp, Benjamin M. Gyori

摘要:

在训练数据中没有显式负三元组的知识图谱上的链接预测任务促使使用基于秩的度量。在这里,我们回顾现有的排名为基础的指标,并提出改进的指标,以解决缺乏解释性和现有指标的可比性,不同大小和属性的数据集的必要条件。我们介绍了一个简单的理论框架,基于排名的指标,我们调查两种途径,通过替代聚合函数和概率论的概念,以改善现有的指标。最后,我们提出了几个新的排名为基础的指标,更容易解释和比较伴随着示范他们的使用基准的知识图谱嵌入模型。

英文摘要:

The link prediction task on knowledge graphs without explicit negative triples in the training data motivates the usage of rank-based metrics. Here, we review existing rank-based metrics and propose desiderata for improved metrics to address lack of interpretability and comparability of existing metrics to datasets of different sizes and properties. We introduce a simple theoretical framework for rank-based metrics upon which we investigate two avenues for improvements to existing metrics via alternative aggregation functions and concepts from probability theory. We finally propose several new rank-based metrics that are more easily interpreted and compared accompanied by a demonstration of their usage in a benchmarking of knowledge graph embedding models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑