proScript:基于预训练语言模型的部分有序序列生成
proScript: Partially Ordered Scripts Generation via Pre-trained Language Models
摘要:
描述典型日常活动的标准化事件序列-已被证明有助于通过提供期望,解决歧义和填写未陈述的信息来理解叙述。然而,到目前为止,它们已经被证明很难作者或从文本中提取。在这项工作中,我们首次证明了预先训练的神经语言模型(LM)可以被微调,以不同的粒度水平生成高质量的脚本,用于各种日常场景(例如,烤蛋糕)。为了做到这一点,我们收集了一个大型(6.4k),众包部分有序的脚本(名为proScript),这是大大大于以前的数据集,并开发了模型,生成脚本结合语言生成和结构预测。我们定义了两个互补的任务:(i)边缘预测:给定一个场景和无序事件,将事件组织成一个有效的(可能是偏序的)脚本,以及(ii)脚本生成:只给定一个场景,生成事件并将它们组织成一个(可能是偏序的)脚本。我们的实验表明,我们的模型表现良好(例如,F1=75.7(在任务(i)中),说明了一种克服以前收集脚本障碍的新方法。我们还表明,人类水平的性能仍有很大的改进空间。我们的任务、数据集和模型为学习脚本知识提供了新的研究方向。
英文摘要:
Scripts - standardized event sequences describing typical everyday activities - have been shown to help understand narratives by providing expectations, resolving ambiguity, and filling in unstated information. However, to date they have proved hard to author or extract from text. In this work, we demonstrate for the first time that pre-trained neural language models (LMs) can be be finetuned to generate high-quality scripts, at varying levels of granularity, for a wide range of everyday scenarios (e.g., bake a cake). To do this, we collected a large (6.4k), crowdsourced partially ordered scripts (named proScript), which is substantially larger than prior datasets, and developed models that generate scripts with combining language generation and structure prediction. We define two complementary tasks: (i) edge prediction: given a scenario and unordered events, organize the events into a valid (possibly partial-order) script, and (ii) script generation: given only a scenario, generate events and organize them into a (possibly partial-order) script. Our experiments show that our models perform well (e.g., F1=75.7 in task (i)), illustrating a new approach to overcoming previous barriers to script collection. We also show that there is still significant room for improvement toward human level performance. Together, our tasks, dataset, and models offer a new research direction for learning script knowledge.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。