可解释序列分类的迭代递归注意模型
Iterative Recursive Attention Model for Interpretable Sequence Classification
摘要:
自然语言处理从注意力机制的引入中受益匪浅。然而,标准的注意力模型是有限的可解释性的任务,涉及一系列的推理步骤。我们描述了一个迭代递归注意力模型,该模型通过重用先前计算的查询结果来构造输入数据的增量表示。我们在情感分类数据集上训练我们的模型,并展示了它以易于解释的方式识别和组合输入的不同方面的能力,同时获得接近最先进水平的性能。
英文摘要:
Natural language processing has greatly benefited from the introduction of the attention mechanism. However, standard attention models are of limited interpretability for tasks that involve a series of inference steps. We describe an iterative recursive attention model, which constructs incremental representations of input data through reusing results of previously computed queries. We train our model on sentiment classification datasets and demonstrate its capacity to identify and combine different aspects of the input in an easily interpretable manner, while obtaining performance close to the state of the art.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。