arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1902.09314cs.CL
收藏

用于目标情感分类的注意力编码器网络

Attentional Encoder Network for Targeted Sentiment Classification

Sun Yat-sen University(中山大学)

Youwei Song, Jiahai Wang, Tao Jiang, Zhiyue Liu, Yanghui Rao

摘要:

有针对性的情感分类旨在确定对特定目标的情感倾向。以前的大多数方法都是用RNN和注意力来建模上下文和目标词。然而,RNN很难并行化,并且通过时间截断的反向传播在记住长期模式方面带来了困难。为了解决这个问题,本文提出了一种注意编码器网络(AEN),它避免了递归,并采用基于注意的编码器的上下文和目标之间的建模。我们提出了标签不可靠性问题,并引入标签平滑正则化。我们还将预训练的BERT应用于此任务,并获得了新的最先进的结果。实验和分析表明,我们的模型的有效性和轻量级。

英文摘要:

Targeted sentiment classification aims at determining the sentimental tendency towards specific targets. Most of the previous approaches model context and target words with RNN and attention. However, RNNs are difficult to parallelize and truncated backpropagation through time brings difficulty in remembering long-term patterns. To address this issue, this paper proposes an Attentional Encoder Network (AEN) which eschews recurrence and employs attention based encoders for the modeling between context and target. We raise the label unreliability issue and introduce label smoothing regularization. We also apply pre-trained BERT to this task and obtain new state-of-the-art results. Experiments and analysis demonstrate the effectiveness and lightweight of our model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑