arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.00331cs.IR
收藏

合成跨语言信息检索训练数据

Synthetic Cross-language Information Retrieval Training Data

James Mayfield, Eugene Yang, Dawn Lawrie, Samuel Barham, Orion Weller, Marc Mason, Suraj Nair, Scott Miller

AI总结:

针对神经跨语言信息检索训练数据匮乏及翻译数据存在的固有缺陷,提出JH-POLO方法,借助大语言模型基于原生非英文文本生成可定制规模、体裁与领域的训练数据,推动CLIR模型训练发展。

摘要:

神经跨语言信息检索(CLIR)系统的一个核心障碍是训练数据的匮乏。MS MARCO单语训练集的出现推动了神经单语检索领域的技术水平取得显著进展。通过机器翻译将MS MARCO文档翻译成其他语言,这一资源已能为CLIR领域所用,但这类翻译存在诸多问题:MS MARCO虽规模庞大,但其体量固定、语篇体裁与领域固定,且翻译后的文档并非母语使用者的自然表达,而是带有翻译腔。为解决这些问题,本文提出JH-POLO CLIR训练集构建方法。该方法首先选取一对非英文文本段落,随后使用生成式大语言模型生成一条英文查询,使得第一段文本与该查询相关,第二段则不相关。通过重复这一过程,可构建任意规模、符合MS MARCO格式的训练集,且所用文档为任意目标体裁与语篇领域下的自然原生文本。本文详细阐述了该方法,展示了其在构建新型CLIR训练集方面的应用,并介绍了利用新构建训练数据开展的实验。

英文摘要:

A key stumbling block for neural cross-language information retrieval (CLIR) systems has been the paucity of training data. The appearance of the MS MARCO monolingual training set led to significant advances in the state of the art in neural monolingual retrieval. By translating the MS MARCO documents into other languages using machine translation, this resource has been made useful to the CLIR community. Yet such translation suffers from a number of problems. While MS MARCO is a large resource, it is of fixed size; its genre and domain of discourse are fixed; and the translated documents are not written in the language of a native speaker of the language, but rather in translationese. To address these problems, we introduce the JH-POLO CLIR training set creation methodology. The approach begins by selecting a pair of non-English passages. A generative large language model is then used to produce an English query for which the first passage is relevant and the second passage is not relevant. By repeating this process, collections of arbitrary size can be created in the style of MS MARCO but using naturally-occurring documents in any desired genre and domain of discourse. This paper describes the methodology in detail, shows its use in creating new CLIR training sets, and describes experiments using the newly created training data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑