Agent-SiMT: Agent-assisted Simultaneous Machine Translation with Large Language Models
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Soochow University(苏州大学);Key Laboratory of AI Safety, Chinese Academy of Sciences(中国科学院人工智能安全重点实验室)
Shoutao Guo, Shaolei Zhang, Zhengrui Ma, Min Zhang, Yang Feng
备注:
18 pages, 8 figures, 7 tables. v2 of arXiv:2402.13036
Simultaneous Machine Translation (SiMT) generates target translations while reading the source sentence. It relies on a policy to determine the optimal timing for reading sentences and generating translations. Existing SiMT methods generally adopt the traditional Transformer architecture, which concurrently determines the policy and generates translations. While they excel at determining policies, their translation performance is suboptimal. Conversely, Large Language Models (LLMs), trained on extensive corpora, possess superior generation capabilities, but it is difficult for them to acquire translation policy through the training methods of SiMT. Therefore, we introduce Agent-SiMT, a framework combining the strengths of LLMs and traditional SiMT methods. Agent-SiMT contains the policy-decision agent and the translation agent. The policy-decision agent is managed by a SiMT model, which determines the translation policy using partial source sentence and translation. The translation agent, leveraging an LLM, generates translation based on the partial source sentence. The two agents collaborate to accomplish SiMT. Experiments demonstrate that Agent-SiMT attains state-of-the-art performance.
SiLLM: Large Language Models for Simultaneous Machine Translation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Soochow University(苏州大学)
On the Hallucination in Simultaneous Machine Translation
Institute of Computing and Intelligence, Harbin Institute of Technology(哈尔滨工业大学计算与智能学院);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)
Improving Simultaneous Machine Translation with Monolingual Data
JD Explore Academy(京东探索研究院)
同步机器翻译(SiMT)通常通过从整句神经机器翻译(NMT)模型中提取序列级知识(Seq-KD)来完成。然而,NMT和SiMT之间仍然存在显著的性能差距。在这项工作中,我们建议利用单语数据来改进SiMT,该SiMT学生将Seq-KD提取的双语数据和外部单语数据相结合。在En-Zh和En-Ja新闻领域语料库上的初步实验表明,单语数据可以显着提高翻译质量(例如,+3.15 BLEU on En-Zh)。受同声传译人员行为的启发,我们提出了一种新的SiMT单语采样策略,同时考虑块长度和单调性。实验结果表明,该采样策略避免了SiMT的关键问题--幻觉,性能优于随机采样策略(以及其他传统的典型NMT单语采样策略),并具有更好的可扩展性。我们在En-Zh和En-Ja上实现了平均+0.72 BLEU改进。数据和代码可以在https://github.com/hexuandeng/Mono4SiMT上找到。
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline
Xiamen University(厦门大学);Tongyi Lab(通义实验室);Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan (Xiamen University), Ministry of Culture and Tourism(文化和旅游部闽台非物质文化遗产数字化保护与智能处理重点实验室(厦门大学))
PsFuture: A Pseudo-Future-based Zero-Shot Adaptive Policy for Simultaneous Machine Translation
South China University of Technology(华南理工大学);Shien-Ming Wu School of Intelligent Engineering(史维智能工程学院);Hong Kong Polytechnic University(香港理工大学);Research Centre for Data Science & Artificial Intelligence(数据科学与人工智能研究中心)
Decoder-only Streaming Transformer for Simultaneous Translation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Key Laboratory of AI Safety, Chinese Academy of Sciences(中国科学院人工智能安全重点实验室)
Self-Modifying State Modeling for Simultaneous Machine Translation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Fanyu AI Laboratory, Zhongke Fanyu Technology Co., Ltd(中科范宇科技有限公司范宇人工智能实验室)
SimulPL: Aligning Human Preferences in Simultaneous Machine Translation
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Graduate School of Translation and Interpretation, Beijing Foreign Studies University(北京外国语大学高级翻译学院)
Non-autoregressive Streaming Transformer for Simultaneous Translation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Soochow University(苏州大学)