arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1905.10486cs.CL
收藏

神经表面实现的符号化中间表示设计

Designing a Symbolic Intermediate Representation for Neural Surface Realization

ADAPT Centre(ADAPT中心);Dublin City University(都柏林城市大学);Autodesk, inc.(欧特克公司)

Henry Elder, Jennifer Foster, James Barry, Alexander O'Connor

摘要:

从神经NLG系统生成的输出通常包含错误,如幻觉,重复或矛盾。这项工作的重点是设计一个象征性的中间表示,用于多阶段的神经生成的意图,以减少失败的输出的频率。我们表明,从这个中间表示的表面实现是高质量的,当整个系统应用于E2E数据集,它优于E2E挑战的赢家。此外,通过将表面实现步骤从典型的端到端神经系统中分离出来,我们还为非神经内容选择和规划系统提供了一个框架,以潜在地利用神经表面实现模型的半监督预训练。

英文摘要:

Generated output from neural NLG systems often contain errors such as hallucination, repetition or contradiction. This work focuses on designing a symbolic intermediate representation to be used in multi-stage neural generation with the intention of reducing the frequency of failed outputs. We show that surface realization from this intermediate representation is of high quality and when the full system is applied to the E2E dataset it outperforms the winner of the E2E challenge. Furthermore, by breaking out the surface realization step from typically end-to-end neural systems, we also provide a framework for non-neural content selection and planning systems to potentially take advantage of semi-supervised pretraining of neural surface realization models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑