arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.09468cs.CL
收藏

学习拆分和重组-维基百科,自由的百科全书

Learning To Split and Rephrase From Wikipedia Edit History

Google AI Language(谷歌AI语言部门)

Jan A. Botha, Manaal Faruqui, John Alex, Jason Baldridge, Dipanjan Das

摘要:

拆分和重组是将一个句子分解成更短的句子,这些句子在一起传达相同的意思。我们通过挖掘维基百科的编辑历史为这项任务提取了一个丰富的新数据集:WikiSplit包含100万个自然发生的句子重写,提供了比Narayan等人(2017)引入的WebSplit语料库多60倍的不同分裂示例和90倍的词汇量。将WikiSplit作为训练数据生成的模型具有质量更好的预测,其得分比WebSplit基准测试的先前最佳结果高出32个BLEU点。

英文摘要:

Split and rephrase is the task of breaking down a sentence into shorter ones that together convey the same meaning. We extract a rich new dataset for this task by mining Wikipedia's edit history: WikiSplit contains one million naturally occurring sentence rewrites, providing sixty times more distinct split examples and a ninety times larger vocabulary than the WebSplit corpus introduced by Narayan et al. (2017) as a benchmark for this task. Incorporating WikiSplit as training data produces a model with qualitatively better predictions that score 32 BLEU points above the prior best result on the WebSplit benchmark.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑