Inferring evaluation scores based on human judgments is invaluable compared to using current evaluation metrics which are not suitable for real-time applications e.g. post-editing. However, these judgments are much more expensive to collect especially from expert translators, compared to evaluation based on indicators contrasting source and translation texts. This work introduces a novel approach for quality estimation by combining learnt confidence scores from a probabilistic inference model based on human judgments, with selective linguistic features-based scores, where the proposed inference model infers the credibility of given human ranks to solve the scarcity and inconsistency issues of human judgments. Experimental results, using challenging language-pairs, demonstrate improvement in correlation with human judgments over traditional evaluation metrics.
Lost in Interpretation: Predicting Untranslated Terminology in Simultaneous Interpretation
Language Technologies Institute(语言技术研究所);Carnegie Mellon University(卡内基梅隆大学)
同声传译,即实时地将一种语言翻译成另一种语言,是一项固有的困难和艰巨的任务。口译员面临的最大挑战之一是准确翻译专有名词,数字或其他实体等困难术语。智能计算机辅助口译(CAI)工具可以分析口语并检测口译员可能未翻译的术语,从而减少翻译错误并提高口译员的表现。在本文中,我们提出了一个任务,预测哪些术语同传译员将留下未翻译的,并检查方法,执行这项任务,使用监督序列标签。我们描述了一些特定于任务的功能,明确设计,以表明当一个口译员可能会努力翻译一个词。在新注释版本的NAIST同声传译语料库上的实验结果(Shimizu et al.,2014)表明我们提出的方法的承诺。
STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);ByteDance AI Lab(字节跳动人工智能实验室);University of Chinese Academy of Sciences(中国科学院大学);University of California, Santa Barbara(加州大学圣巴巴拉分校)
9th Workshop on Sign Language Translation and Avatar Technologies (SLTAT 2025)
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);University of Augsburg(奥格斯堡大学);Institute for Language and Speech Processing(语言与语音处理研究所);Athena RC(雅典RC);DePaul University(德保罗大学);Université Paris-Saclay(巴黎-萨克雷大学);University of Hamburg(汉堡大学)