arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.02707cs.CL
收藏

文本到表格:一种新的信息抽取方法

Text-to-Table: A New Way of Information Extraction

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);ByteDance(字节跳动)

Xueqing Wu, Jiacheng Zhang, Hang Li

摘要:

我们研究了一种新的信息抽取问题集,称为文本到表格。在文本到表格中,给定一个文本,创建一个或多个表格来表达文本的主要内容,而模型是从文本-表格对数据中学习的。问题设置与IE的现有方法不同。首先,可以从长文本到具有复杂结构的大表格进行提取。其次,提取完全是数据驱动的,不需要显式地定义模式。据我们所知,还没有以前的工作,研究这个问题。在这项工作中,我们将文本到表形式化为序列到序列(seq 2seq)问题。我们首先采用从预训练的语言模型微调的seq 2seq模型来执行任务。我们还开发了一种新的方法seq 2seq的方法,利用表生成中的两个额外的技术:表约束和表关系嵌入。我们认为文本到表作为一个逆问题的研究表到文本,并利用现有的四个表到文本数据集在我们的实验文本到表。实验结果表明,香草seq 2seq模型可以优于基线方法使用关系抽取和命名实体提取。结果还表明,我们的方法可以进一步提高vanilla seq 2seq模型的性能。我们进一步讨论了拟议任务的主要挑战。代码和数据可在https://github.com/shirley-wu/text_to_table上获得。

英文摘要:

We study a new problem setting of information extraction (IE), referred to as text-to-table. In text-to-table, given a text, one creates a table or several tables expressing the main content of the text, while the model is learned from text-table pair data. The problem setting differs from those of the existing methods for IE. First, the extraction can be carried out from long texts to large tables with complex structures. Second, the extraction is entirely data-driven, and there is no need to explicitly define the schemas. As far as we know, there has been no previous work that studies the problem. In this work, we formalize text-to-table as a sequence-to-sequence (seq2seq) problem. We first employ a seq2seq model fine-tuned from a pre-trained language model to perform the task. We also develop a new method within the seq2seq approach, exploiting two additional techniques in table generation: table constraint and table relation embeddings. We consider text-to-table as an inverse problem of the well-studied table-to-text, and make use of four existing table-to-text datasets in our experiments on text-to-table. Experimental results show that the vanilla seq2seq model can outperform the baseline methods of using relation extraction and named entity extraction. The results also show that our method can further boost the performances of the vanilla seq2seq model. We further discuss the main challenges of the proposed task. The code and data are available at https://github.com/shirley-wu/text_to_table.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑