神经机器翻译中的课程学习和小批量分桶
Curriculum Learning and Minibatch Bucketing in Neural Machine Translation
摘要：
我们研究了句子对的特殊排序对神经机器翻译（NMT）在线训练的影响。我们专注于两种类型的排序：（1）确保每个minibatch包含在某些方面相似的句子和（2）逐渐包括一些句子类型的培训进展（所谓的“课程学习“）。在我们的英语到捷克语的实验中，小批量的内部同质性对训练没有影响，但我们的一些“课程”在基线上有了小的改进。
英文摘要：
We examine the effects of particular orderings of sentence pairs on the on-line training of neural machine translation (NMT). We focus on two types of such orderings: (1) ensuring that each minibatch contains sentences similar in some aspect and (2) gradual inclusion of some sentence types as the training progresses (so called "curriculum learning"). In our English-to-Czech experiments, the internal homogeneity of minibatches has no effect on the training but some of our "curricula" achieve a small improvement over the baseline.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
