arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.07970cs.CL
收藏

通过机器翻译质量估计引导大语言模型的上下文学习

Guiding In-Context Learning of LLMs through Quality Estimation for Machine Translation

Tilburg University(蒂尔堡大学)

Javad Pourmostafa Roshan Sharami, Dimitar Shterionov, Pieter Spronck

AI总结:

针对大语言模型机器翻译中上下文示例选择依赖参考译文或人工判断的问题,提出由领域特定质量估计引导搜索的上下文学习方法,借助XGLM无需参考译文选示例,性能优于现有ICL方法及微调的mBART-50。

摘要:

大语言模型(LLM)的输出质量,尤其是在机器翻译(MT)任务中,与查询(即待翻译文本)附带的上下文示例(ICEs)的质量密切相关。这些ICEs的有效性受多种因素影响,例如源文本的领域、ICEs的呈现顺序、示例数量以及所使用的提示模板。自然地,选择最具影响力的ICEs需要理解它们如何影响最终的翻译质量,而这最终依赖于翻译参考译文或人工判断。本文提出了一种新颖的上下文学习(ICL)方法,该方法依赖于由领域特定质量估计(QE)引导的搜索算法。借助XGLM模型,我们的方法无需翻译参考译文即可估计最终的翻译质量,为机器翻译任务选择有效的ICEs以最大化翻译质量。我们的结果表明,该方法相比现有的ICL方法有显著提升,并且与微调预训练语言模型(PLM)——具体为mBART-50——相比,翻译性能更高。

英文摘要:

The quality of output from large language models (LLMs), particularly in machine translation (MT), is closely tied to the quality of in-context examples (ICEs) provided along with the query, i.e., the text to translate. The effectiveness of these ICEs is influenced by various factors, such as the domain of the source text, the order in which the ICEs are presented, the number of these examples, and the prompt templates used. Naturally, selecting the most impactful ICEs depends on understanding how these affect the resulting translation quality, which ultimately relies on translation references or human judgment. This paper presents a novel methodology for in-context learning (ICL) that relies on a search algorithm guided by domain-specific quality estimation (QE). Leveraging the XGLM model, our methodology estimates the resulting translation quality without the need for translation references, selecting effective ICEs for MT to maximize translation quality. Our results demonstrate significant improvements over existing ICL methods and higher translation performance compared to fine-tuning a pre-trained language model (PLM), specifically mBART-50.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑