arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.09366cs.CLcs.AI
收藏

LOKE:面向自动化知识图谱构建的链接开放知识抽取

LOKE: Linked Open Knowledge Extraction for Automated Knowledge Graph Construction

Rensselaer Polytechnic Institute(伦斯勒理工学院)

Jamie McCusker

AI总结:

针对开放信息抽取与知识图谱对齐不足的问题,提出LOKE方法,利用GPT模型和提示工程结合实体链接,在OKE任务上优于OpenIE 4,抽取结果适用于半自动知识图谱构建。

摘要:

尽管开放信息抽取(Open IE)在知识图谱构建(KGC)方面的潜力看似可观,我们发现开放信息抽取结果与现有知识图谱的对齐并不充分。大型语言模型(LLMs)的出现,尤其是商业可用的OpenAI模型,重新设定了人们对深度学习模型可能性的期望,并催生了一个名为提示工程的新领域。我们研究了GPT模型和提示工程在Wikidata知识图谱上的知识图谱构建应用,以解决与开放信息抽取类似的问题,我们称之为开放知识抽取(OKE),采用的方法称为链接开放知识抽取器(LOKE,发音类似“Loki”)。我们认为实体链接任务对于构建真实世界知识图谱至关重要。我们将CaRB基准评分方法与TekGen数据集的数据合并用于LOKE任务。随后我们证明,一个精心设计的提示,配合一种朴素的实体链接方法(我们称之为LOKE-GPT),在OKE任务上优于AllenAI的OpenIE 4实现,尽管由于TekGen集合中三元组总体稀缺,它相比参考集过度生成了三元组。通过对CaRB数据集中实体可链接性的分析,以及OpenIE 4和LOKE-GPT的输出,我们看到LOKE-GPT和“银标准”TekGen三元组表明该任务在内容上与OIE显著不同,即使结构上未必如此。通过这一分析以及对所有方法句子抽取的定性分析,我们发现LOKE-GPT的抽取结果对KGC任务具有高实用性,适用于半自动抽取设置。

英文摘要:

While the potential of Open Information Extraction (Open IE) for Knowledge Graph Construction (KGC) may seem promising, we find that the alignment of Open IE extraction results with existing knowledge graphs to be inadequate. The advent of Large Language Models (LLMs), especially the commercially available OpenAI models, have reset expectations for what is possible with deep learning models and have created a new field called prompt engineering. We investigate the use of GPT models and prompt engineering for knowledge graph construction with the Wikidata knowledge graph to address a similar problem to Open IE, which we call Open Knowledge Extraction (OKE) using an approach we call the Linked Open Knowledge Extractor (LOKE, pronounced like "Loki"). We consider the entity linking task essential to construction of real world knowledge graphs. We merge the CaRB benchmark scoring approach with data from the TekGen dataset for the LOKE task. We then show that a well engineered prompt, paired with a naive entity linking approach (which we call LOKE-GPT), outperforms AllenAI's OpenIE 4 implementation on the OKE task, although it over-generates triples compared to the reference set due to overall triple scarcity in the TekGen set. Through an analysis of entity linkability in the CaRB dataset, as well as outputs from OpenIE 4 and LOKE-GPT, we see that LOKE-GPT and the "silver" TekGen triples show that the task is significantly different in content from OIE, if not structure. Through this analysis and a qualitative analysis of sentence extractions via all methods, we found that LOKE-GPT extractions are of high utility for the KGC task and suitable for use in semi-automated extraction settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑