arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1503.00107cs.CLcs.NE
收藏

统计机器翻译的非线性学习

Non-linear Learning for Statistical Machine Translation

Shujian Huang, Huadong Chen, Xinyu Dai, Jiajun Chen

摘要:

现代统计机器翻译(SMT)系统通常使用特征的线性组合来对每个翻译假设的质量进行建模。线性组合假设所有特征都处于线性关系,并约束每个特征以线性方式与其余特征交互,这可能限制模型的表达能力,并导致当前数据上的欠拟合模型。在本文中,我们提出了一种基于神经网络的翻译假设质量的非线性建模,它允许特征之间更复杂的交互。提出了一种用于训练非线性模型的学习框架。我们还讨论了在设计网络结构,这可能会提高非线性学习性能可能的算法。实验结果表明,与基于层次短语的机器翻译系统的基本特征,我们的方法产生的翻译是优于线性模型。

英文摘要:

Modern statistical machine translation (SMT) systems usually use a linear combination of features to model the quality of each translation hypothesis. The linear combination assumes that all the features are in a linear relationship and constrains that each feature interacts with the rest features in an linear manner, which might limit the expressive power of the model and lead to a under-fit model on the current data. In this paper, we propose a non-linear modeling for the quality of translation hypotheses based on neural networks, which allows more complex interaction between features. A learning framework is presented for training the non-linear models. We also discuss possible heuristics in designing the network structure which may improve the non-linear learning performance. Experimental results show that with the basic features of a hierarchical phrase-based machine translation system, our method produce translations that are better than a linear model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑