arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1808.10503cs.CL
收藏

可解释序列分类的迭代递归注意模型

Iterative Recursive Attention Model for Interpretable Sequence Classification

Faculty of Electrical Engineering and Computing, University of Zagreb(萨格勒布大学电气工程与计算学院)

Martin Tutek, Jan Šnajder

摘要:

自然语言处理从注意力机制的引入中受益匪浅。然而,标准的注意力模型是有限的可解释性的任务,涉及一系列的推理步骤。我们描述了一个迭代递归注意力模型,该模型通过重用先前计算的查询结果来构造输入数据的增量表示。我们在情感分类数据集上训练我们的模型,并展示了它以易于解释的方式识别和组合输入的不同方面的能力,同时获得接近最先进水平的性能。

英文摘要:

Natural language processing has greatly benefited from the introduction of the attention mechanism. However, standard attention models are of limited interpretability for tasks that involve a series of inference steps. We describe an iterative recursive attention model, which constructs incremental representations of input data through reusing results of previously computed queries. We train our model on sentiment classification datasets and demonstrate its capacity to identify and combine different aspects of the input in an easily interpretable manner, while obtaining performance close to the state of the art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑