arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1705.09207cs.CLcs.AI
收藏

学习结构化文本表示

Learning Structured Text Representations

Institute for Language, Cognition and Computation(语言、认知与计算研究所);School of Informatics, University of Edinburgh(爱丁堡大学信息学院)

Yang Liu, Mirella Lapata

摘要:

在本文中,我们专注于学习结构感知的文档表示数据,而不求助于话语解析器或额外的注释。从最近的努力赋予神经网络的结构偏差的灵感,我们提出了一个模型,可以编码的文档,同时自动诱导丰富的结构依赖。具体来说,我们嵌入一个可微的非投射解析算法到神经模型,并使用注意力机制,以纳入结构的偏见。在不同的任务和数据集上的实验评估表明,该模型在文档建模任务上实现了最先进的结果,同时诱导了可解释和有意义的中间结构。

英文摘要:

In this paper, we focus on learning structure-aware document representations from data without recourse to a discourse parser or additional annotations. Drawing inspiration from recent efforts to empower neural networks with a structural bias, we propose a model that can encode a document while automatically inducing rich structural dependencies. Specifically, we embed a differentiable non-projective parsing algorithm into a neural model and use attention mechanisms to incorporate the structural biases. Experimental evaluation across different tasks and datasets shows that the proposed model achieves state-of-the-art results on document modeling tasks while inducing intermediate structures which are both interpretable and meaningful.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑