arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.14846cs.CL
收藏

ProVe:一种针对文本源的知识图谱自动出处验证流水线

ProVe: A Pipeline for Automated Provenance Verification of Knowledge Graphs against Textual Sources

King’s College London(伦敦国王学院)

Gabriel Amaral, Odinaldo Rodrigues, Elena Simperl

摘要:

知识图谱是以语义三元组的形式从多个领域和来源收集数据的信息库,作为现代网络环境中各种关键应用程序的结构化数据源,从维基百科信息框到搜索引擎。这些图表主要作为信息的第二来源,并依赖于记录良好和可核实的出处,以确保其可信度和可用性。然而,他们系统地评估和确保这种来源的质量的能力,最重要的是它是否正确地支持图的信息,主要依赖于不随大小而扩展的手动过程。ProVe旨在弥补这一点,包括一个流水线的方法,自动验证是否知识图谱三元组是从其记录出处提取的文本支持。ProVe旨在帮助信息管理员,包括四个主要步骤,涉及基于规则的方法和机器学习模型:文本提取,三重语言化,句子选择和声明验证。ProVe在Wikidata数据集上进行了评估,在检测来源支持的二进制分类任务上取得了令人鼓舞的整体结果和出色的性能,在文本丰富的源上具有87.5%的准确率和82.9%的F1宏。本文中使用的评估数据和脚本可在GitHub和Figshare上获得。

英文摘要:

Knowledge Graphs are repositories of information that gather data from a multitude of domains and sources in the form of semantic triples, serving as a source of structured data for various crucial applications in the modern web landscape, from Wikipedia infoboxes to search engines. Such graphs mainly serve as secondary sources of information and depend on well-documented and verifiable provenance to ensure their trustworthiness and usability. However, their ability to systematically assess and assure the quality of this provenance, most crucially whether it properly supports the graph's information, relies mainly on manual processes that do not scale with size. ProVe aims at remedying this, consisting of a pipelined approach that automatically verifies whether a Knowledge Graph triple is supported by text extracted from its documented provenance. ProVe is intended to assist information curators and consists of four main steps involving rule-based methods and machine learning models: text extraction, triple verbalisation, sentence selection, and claim verification. ProVe is evaluated on a Wikidata dataset, achieving promising results overall and excellent performance on the binary classification task of detecting support from provenance, with 87.5% accuracy and 82.9% F1-macro on text-rich sources. The evaluation data and scripts used in this paper are available on GitHub and Figshare.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑