arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.09556cs.CLcs.AI
收藏

WikiGraphs:维基百科文本-知识图谱配对数据集

WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset

DeepMind(深度思维)

Luyu Wang, Yujia Li, Ozlem Aslan, Oriol Vinyals

摘要:

我们提出了一个新的维基百科文章的数据集,每个与一个知识图谱配对,以促进条件文本生成,图生成和图表示学习的研究。现有的图-文本配对数据集通常包含小图和短文本(1个或几个句子),从而限制了模型可以在数据上学习的能力。我们的新数据集WikiGraphs是通过将来自已建立的WikiText-103基准的每个维基百科文章配对来收集的(Merity等人,2016)与来自Freebase知识图谱的子图(Bollacker等人,2008年)。这使得它很容易与其他最先进的文本生成模型进行基准测试,这些模型能够生成长段落的连贯文本。与先前的图形-文本配对数据集相比,图形和文本数据都具有显著更大的规模。我们在我们的数据集上为3个任务提供了基线图神经网络和Transformer模型结果:图->文本生成,图->文本检索和文本->图检索。我们表明,更好的调节图提供收益的生成和检索质量,但仍然有很大的改进空间。

英文摘要:

We present a new dataset of Wikipedia articles each paired with a knowledge graph, to facilitate the research in conditional text generation, graph generation and graph representation learning. Existing graph-text paired datasets typically contain small graphs and short text (1 or few sentences), thus limiting the capabilities of the models that can be learned on the data. Our new dataset WikiGraphs is collected by pairing each Wikipedia article from the established WikiText-103 benchmark (Merity et al., 2016) with a subgraph from the Freebase knowledge graph (Bollacker et al., 2008). This makes it easy to benchmark against other state-of-the-art text generative models that are capable of generating long paragraphs of coherent text. Both the graphs and the text data are of significantly larger scale compared to prior graph-text paired datasets. We present baseline graph neural network and transformer model results on our dataset for 3 tasks: graph -> text generation, graph -> text retrieval and text -> graph retrieval. We show that better conditioning on the graph provides gains in generation and retrieval quality but there is still large room for improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑