Simultaneous interpretation, translation of the spoken word in real-time, is both highly challenging and physically demanding. Methods to predict interpreter confidence and the adequacy of the interpreted message have a number of potential applications, such as in computer-assisted interpretation interfaces or pedagogical tools. We propose the task of predicting simultaneous interpreter performance by building on existing methodology for quality estimation (QE) of machine translation output. In experiments over five settings in three language pairs, we extend a QE pipeline to estimate interpreter performance (as approximated by the METEOR evaluation metric) and propose novel features reflecting interpretation strategy and evaluation measures that further improve prediction accuracy.
Lost in Interpretation: Predicting Untranslated Terminology in Simultaneous Interpretation
Language Technologies Institute(语言技术研究所);Carnegie Mellon University(卡内基梅隆大学)
同声传译,即实时地将一种语言翻译成另一种语言,是一项固有的困难和艰巨的任务。口译员面临的最大挑战之一是准确翻译专有名词,数字或其他实体等困难术语。智能计算机辅助口译(CAI)工具可以分析口语并检测口译员可能未翻译的术语,从而减少翻译错误并提高口译员的表现。在本文中,我们提出了一个任务,预测哪些术语同传译员将留下未翻译的,并检查方法,执行这项任务,使用监督序列标签。我们描述了一些特定于任务的功能,明确设计,以表明当一个口译员可能会努力翻译一个词。在新注释版本的NAIST同声传译语料库上的实验结果(Shimizu et al.,2014)表明我们提出的方法的承诺。
Improving Simultaneous Machine Translation with Monolingual Data
JD Explore Academy(京东探索研究院)
同步机器翻译(SiMT)通常通过从整句神经机器翻译(NMT)模型中提取序列级知识(Seq-KD)来完成。然而,NMT和SiMT之间仍然存在显著的性能差距。在这项工作中,我们建议利用单语数据来改进SiMT,该SiMT学生将Seq-KD提取的双语数据和外部单语数据相结合。在En-Zh和En-Ja新闻领域语料库上的初步实验表明,单语数据可以显着提高翻译质量(例如,+3.15 BLEU on En-Zh)。受同声传译人员行为的启发,我们提出了一种新的SiMT单语采样策略,同时考虑块长度和单调性。实验结果表明,该采样策略避免了SiMT的关键问题--幻觉,性能优于随机采样策略(以及其他传统的典型NMT单语采样策略),并具有更好的可扩展性。我们在En-Zh和En-Ja上实现了平均+0.72 BLEU改进。数据和代码可以在https://github.com/hexuandeng/Mono4SiMT上找到。
Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Models
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China(认知与决策智能复杂系统重点实验室,自动化研究所,中国科学院,北京,中国);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification
The Chinese University of Hong Kong(香港中文大学);Nanjing University(南京大学);University of Science and Technology of China(中国科学技术大学);Tsinghua University(清华大学);City University of Hong Kong(香港城市大学);Changsha University of Science and Technology(长沙理工大学);Tufts University(塔夫茨大学)