SAO WMT19测试套件：审计报告的机器翻译
SAO WMT19 Test Suite: Machine Translation of Audit Reports
摘要：
本文介绍了一个机器翻译测试集的文件，从审计领域和它的使用作为一个“测试套件”在WMT 19新闻翻译任务的翻译方向，涉及捷克语，英语和德语。我们的评估表明，目前的MT系统优化的一般新闻领域可以执行得很好，即使在特定的域的审计报告。然而，详细的手动评估表明，对该领域的深入实际知识是必要的。对于非专家的肉眼来说，许多系统的翻译似乎几乎是完美的，并且具有一个参考的自动MT评估对于考虑这些细节实际上是无用的。此外，我们展示了一个样本文件，从域的协议，即使是最好的系统完全失败，在保留语义的协议，即各方的身份。
英文摘要：
This paper describes a machine translation test set of documents from the auditing domain and its use as one of the "test suites" in the WMT19 News Translation Task for translation directions involving Czech, English and German. Our evaluation suggests that current MT systems optimized for the general news domain can perform quite well even in the particular domain of audit reports. The detailed manual evaluation however indicates that deep factual knowledge of the domain is necessary. For the naked eye of a non-expert, translations by many systems seem almost perfect and automatic MT evaluation with one reference is practically useless for considering these details. Furthermore, we show on a sample document from the domain of agreements that even the best systems completely fail in preserving the semantics of the agreement, namely the identity of the parties.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
