arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.05781cs.CLcs.AI

使用语言模型消解翻译中的词汇选择歧义

Using Language Models to Disambiguate Lexical Choices in Translation

University of California, Berkeley(加州大学伯克利分校)

Josh Barua, Sanjay Subramanian, Kayo Yin, Alane Suhr

AI总结:

本研究创建跨语言词汇变异数据集DTAiLS,评估LLM与NMT系统,并利用语言模型生成词汇规则,显著提升较弱模型的翻译准确率,部分场景超越GPT-4。

摘要:

在翻译中,源语言中由单个单词表示的概念在目标语言中可能有多种变体。词汇选择任务要求利用上下文来确定哪种变体最适合源文本。我们与九种语言的母语者合作,创建了DTAiLS数据集,该数据集包含1,377对句子,展示了从英语翻译时出现的跨语言概念变异。我们在DTAiLS上评估了最新的LLM和神经机器翻译系统,其中表现最佳的模型GPT-4在不同语言上的准确率在67%至85%之间。最后,我们使用语言模型生成描述目标语言概念变异的英语规则。为较弱的模型提供高质量的词汇规则可显著提高准确率,在某些情况下达到或超过GPT-4的水平。

英文摘要:

In translation, a concept represented by a single word in a source language can have multiple variations in a target language. The task of lexical selection requires using context to identify which variation is most appropriate for a source text. We work with native speakers of nine languages to create DTAiLS, a dataset of 1,377 sentence pairs that exhibit cross-lingual concept variation when translating from English. We evaluate recent LLMs and neural machine translation systems on DTAiLS, with the best-performing model, GPT-4, achieving from 67 to 85% accuracy across languages. Finally, we use language models to generate English rules describing target-language concept variations. Providing weaker models with high-quality lexical rules improves accuracy substantially, in some cases reaching or outperforming GPT-4.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑