arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.10293cs.CLcs.AI
收藏

一种用于Zero-Shot链接预测的层次N-Gram框架

A Hierarchical N-Gram Framework for Zero-Shot Link Prediction

Georgia State University(佐治亚州立大学);University of Sheffield(谢菲尔德大学);Beihang University(北京航空航天大学)

Mingchen Li, Junfan Chen, Samuel Mensah, Nikolaos Aletras, Xiulong Yang, Yang Ye

摘要:

由于知识图谱的不完备性,旨在预测知识图中未观测关系的zero-shot链接预测(zero-shot prediction,简称ZLP)近年来引起了研究者的兴趣。一种常见的解决方案是使用关系的文本特征(例如,表面名称或文本描述)作为辅助信息,以弥合可见和不可见关系之间的差距。目前的方法学习文本中每个单词标记的嵌入。这些方法缺乏鲁棒性,因为它们遭受词汇表外(OOV)问题。同时,建立在字符n-gram上的模型具有生成OOV词的表达表示的能力。因此,在本文中,我们提出了一个层次的N-Gram框架Zero-Shot链接预测(HNGRAM LP),它考虑了字符之间的依赖关系表面名称的NGRAM LP。我们的方法首先在表面名称上构建一个层次化的n-gram图,以模拟导致表面名称的n-gram的组织结构。在Transformer的基础上,提出了一个GramTransformer模型,对层次n-gram图进行建模,从而构造了基于层次n-gram图的关系嵌入。实验结果表明,所提出的HNNLP实现了国家的最先进的性能在两个CNOLP数据集。

英文摘要:

Due to the incompleteness of knowledge graphs (KGs), zero-shot link prediction (ZSLP) which aims to predict unobserved relations in KGs has attracted recent interest from researchers. A common solution is to use textual features of relations (e.g., surface name or textual descriptions) as auxiliary information to bridge the gap between seen and unseen relations. Current approaches learn an embedding for each word token in the text. These methods lack robustness as they suffer from the out-of-vocabulary (OOV) problem. Meanwhile, models built on character n-grams have the capability of generating expressive representations for OOV words. Thus, in this paper, we propose a Hierarchical N-Gram framework for Zero-Shot Link Prediction (HNZSLP), which considers the dependencies among character n-grams of the relation surface name for ZSLP. Our approach works by first constructing a hierarchical n-gram graph on the surface name to model the organizational structure of n-grams that leads to the surface name. A GramTransformer, based on the Transformer is then presented to model the hierarchical n-gram graph to construct the relation embedding for ZSLP. Experimental results show the proposed HNZSLP achieved state-of-the-art performance on two ZSLP datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑