arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.11003cs.CL
收藏

基于知识图谱的文本生成全局和局部节点上下文建模

Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphs

Westlake University(西湖大学);CNRS(法国国家科学研究中心);LORIA(洛林计算机科学及其应用实验室);Technische Universität Darmstadt(达姆施塔特工业大学)

Leonardo F. R. Ribeiro, Yue Zhang, Claire Gardent, Iryna Gurevych

摘要:

最近的图形到文本模型使用全局或局部聚合来学习节点表示,从基于图形的数据生成文本。全局节点编码允许两个远程节点之间的显式通信,从而忽略了所有节点直接连接的图形拓扑。相比之下,局部节点编码考虑了捕获图结构的相邻节点之间的关系,但它可能无法捕获远程关系。在这项工作中,我们收集了两种编码策略,提出了新的神经模型,它结合全局和局部节点上下文对输入图进行编码,以便学习更好的上下文化节点嵌入。在我们的实验中,我们证明了我们的方法在两个图形到文本数据集上实现了显着的改进,在AGENDA数据集上实现了18.01的BLEU得分,在WebNLG数据集上实现了63.69的可见类别,分别比最先进的模型高出3.7和3.1分。

英文摘要:

Recent graph-to-text models generate text from graph-based data using either global or local aggregation to learn node representations. Global node encoding allows explicit communication between two distant nodes, thereby neglecting graph topology as all nodes are directly connected. In contrast, local node encoding considers the relations between neighbor nodes capturing the graph structure, but it can fail to capture long-range relations. In this work, we gather both encoding strategies, proposing novel neural models which encode an input graph combining both global and local node contexts, in order to learn better contextualized node embeddings. In our experiments, we demonstrate that our approaches lead to significant improvements on two graph-to-text datasets achieving BLEU scores of 18.01 on AGENDA dataset, and 63.69 on the WebNLG dataset for seen categories, outperforming state-of-the-art models by 3.7 and 3.1 points, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑