arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.01623cs.CL
收藏

基于预训练语言模型的Few-Shot知识图谱文本生成

Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models

Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(大数据管理与分析方法北京市重点实验室);Huawei Cloud(华为云);School of Information, Renmin University of China(中国人民大学信息学院);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院)

Junyi Li, Tianyi Tang, Wayne Xin Zhao, Zhicheng Wei, Nicholas Jing Yuan, Ji-Rong Wen

摘要:

本文研究了如何在知识图谱中自动生成描述事实的自然语言文本。考虑到Few-Shot设置,我们利用预训练的语言模型(PLM)在语言理解和生成方面的出色能力。我们做了三个主要的技术贡献,即表示对齐弥合KG编码和PLM之间的语义差距,关系偏向KG线性化,以获得更好的输入表示,和多任务学习学习KG和文本之间的对应关系。在三个基准数据集上的大量实验证明了该模型在KG到文本生成任务上的有效性。特别是,我们的模型在全监督和Few-Shot设置上都优于所有比较方法。我们的代码和数据集可以在https://github.com/RUCAIBox/Few-Shot-KG2Text上找到。

英文摘要:

This paper studies how to automatically generate a natural language text that describes the facts in knowledge graph (KG). Considering the few-shot setting, we leverage the excellent capacities of pretrained language models (PLMs) in language understanding and generation. We make three major technical contributions, namely representation alignment for bridging the semantic gap between KG encodings and PLMs, relation-biased KG linearization for deriving better input representations, and multi-task learning for learning the correspondence between KG and text. Extensive experiments on three benchmark datasets have demonstrated the effectiveness of our model on KG-to-text generation task. In particular, our model outperforms all comparison methods on both fully-supervised and few-shot settings. Our code and datasets are available at https://github.com/RUCAIBox/Few-Shot-KG2Text.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑