arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1704.05415cs.CL
收藏

NMT语际嵌入及其在并列句识别中的应用

An Empirical Analysis of NMT-Derived Interlingual Embeddings and their Use in Parallel Sentence Identification

DFKI(德国人工智能研究中心);University of Saarland(萨尔大学)

Cristina España-Bonet, Ádám Csaba Varga, Alberto Barrón-Cedeño, Josef van Genabith

摘要:

端到端神经机器翻译在某些语言对的翻译质量方面已经超过了统计机器翻译,特别是那些具有大量并行数据的语言对。除了这种明显的改进,神经网络还提供了几个新的特性。一个系统可以被训练成在多种语言之间进行翻译,除了训练时间之外几乎没有额外的成本。此外,网络学习的内部表征作为单词或句子的新语义表征,与标准的词嵌入不同,它是在基本上双语甚至多语言的背景下学习的。鉴于这些属性,本工作的贡献是双重的。首先,我们系统地研究了NMT上下文向量,即编码器的输出,以及它们作为句子的中间语言表示的能力。我们通过测量翻译之间的相似性,以及语义相关和语义不相关的句子对来评估它们的质量和有效性。其次,作为第一点的外在评价,我们在可比语料库中识别出平行句子,当仅使用NMT上下文向量时,从共享任务的数据中获得F1=98.2%。使用上下文向量与相似性度量F1联合达到98.9%。

英文摘要:

End-to-end neural machine translation has overtaken statistical machine translation in terms of translation quality for some language pairs, specially those with large amounts of parallel data. Besides this palpable improvement, neural networks provide several new properties. A single system can be trained to translate between many languages at almost no additional cost other than training time. Furthermore, internal representations learned by the network serve as a new semantic representation of words -or sentences- which, unlike standard word embeddings, are learned in an essentially bilingual or even multilingual context. In view of these properties, the contribution of the present work is two-fold. First, we systematically study the NMT context vectors, i.e. output of the encoder, and their power as an interlingua representation of a sentence. We assess their quality and effectiveness by measuring similarities across translations, as well as semantically related and semantically unrelated sentence pairs. Second, as extrinsic evaluation of the first point, we identify parallel sentences in comparable corpora, obtaining an F1=98.2% on data from a shared task when using only NMT context vectors. Using context vectors jointly with similarity measures F1 reaches 98.9%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑