arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.01766cs.CL
收藏

基于关系模型的信息传播增强神经机器翻译

Information-Propogation-Enhanced Neural Machine Translation by Relation Model

Wen Zhang, Jiawei Hu, Yang Feng, Qun Liu

摘要:

尽管序列到序列神经机器翻译(NMT)模型在近几年取得了很好的性能,但递归神经网络(RNN)单元很难捕获长距离的状态信息,即随着序列的变长,RNN很难发现具有长期依赖性的特征,这一点受到了广泛关注。同样,最近,卷积神经网络(CNN)被引入到NMT中以加速,然而,CNN专注于捕捉序列的局部特征;为了缓解这个问题,我们将关系网络纳入标准的编码器-解码器框架中,以增强神经网络中的信息传播,确保源语句的信息能够充分流入解码器。实验表明,该框架在两个不同尺度的数据集上的性能明显优于统计MT模型和最新的NMT模型。

英文摘要:

Even though sequence-to-sequence neural machine translation (NMT) model have achieved state-of-art performance in the recent fewer years, but it is widely concerned that the recurrent neural network (RNN) units are very hard to capture the long-distance state information, which means RNN can hardly find the feature with long term dependency as the sequence becomes longer. Similarly, convolutional neural network (CNN) is introduced into NMT for speeding recently, however, CNN focus on capturing the local feature of the sequence; To relieve this issue, we incorporate a relation network into the standard encoder-decoder framework to enhance information-propogation in neural network, ensuring that the information of the source sentence can flow into the decoder adequately. Experiments show that proposed framework outperforms the statistical MT model and the state-of-art NMT model significantly on two data sets with different scales.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑