arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.11605cs.CL
收藏

情感态度提取任务中的注意模型研究

Studying Attention Models in Sentiment Attitude Extraction Task

Bauman Moscow State Technical University(鲍曼莫斯科国立技术大学);Lomonosov Moscow State University(罗蒙诺索夫莫斯科国立大学)

Nicolay Rusnachenko, Natalia Loukachevitch

摘要:

在情感态度提取任务中,目标是识别<attitudes>文本中提到的实体之间的&lt; &gt;-情感关系。在本文中,我们提供了一个基于注意力的上下文编码器在情感态度提取任务的研究。为了完成这项任务,我们采用了两种类型的专注上下文编码器:(i)基于特征的;(ii)基于自我的。我们对俄罗斯分析文本RuSentRel语料库的实验表明,使用专注编码器训练的模型优于没有它们训练的模型,并实现了1.5-5.9%的F1增长。我们还提供了依赖于术语类型的注意权重分布的分析。

英文摘要:

In the sentiment attitude extraction task, the aim is to identify <<attitudes>> -- sentiment relations between entities mentioned in text. In this paper, we provide a study on attention-based context encoders in the sentiment attitude extraction task. For this task, we adapt attentive context encoders of two types: (i) feature-based; (ii) self-based. Our experiments with a corpus of Russian analytical texts RuSentRel illustrate that the models trained with attentive encoders outperform ones that were trained without them and achieve 1.5-5.9% increase by F1. We also provide the analysis of attention weight distributions in dependence on the term type.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑