arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.03462cs.CLcs.AIcs.HCcs.LG
收藏

开源大语言模型作为多语言众包工作者:在目标语言无示例且无机器翻译的情况下合成多种语言的开放域对话

Open-Source Large Language Models as Multilingual Crowdworkers: Synthesizing Open-Domain Dialogues in Several Languages With No Examples in Targets and No Machine Translation

Laboratoire Inforamitque d’Avignon (LIA)(阿维尼翁信息学实验室);Avignon Université(阿维尼翁大学)

Ahmed Njifenjou, Virgile Sucal, Bassam Jabaian, Fabrice Lefèvre

AI总结:

针对开放域对话数据集以英语为主且多语言众包成本高昂的问题,提出利用开源大语言模型在无目标语言示例且无机器翻译的情况下合成多语言对话数据的流水线,并应用于PersonaChat数据集以提升对话开放性。

摘要:

开放域对话智能体领域的主流范式主要聚焦于英语语言,涵盖模型与数据集。此外,为微调而众包此类数据集所需的资金与时间投入十分巨大,尤其是在涉及多种语言时。幸运的是,大语言模型(LLMs)的进步在多样化任务中展现出大量可能性。具体而言,指令微调使LLMs能够基于自然语言指令执行任务,偶尔甚至超越人类众包工作者的表现。此外,这些模型具备在单一线程中使用多种语言运作的能力。因此,为了在不同语言中生成新样本,我们提出利用这些能力来复刻数据收集过程。我们引入了一条使用LLMs在多种目标语言中生成开放域对话数据的流水线,并在唯一的源语言中提供示例。通过在该方法中摒弃显式的机器翻译,我们增强了对特定语言细微差别的遵循。我们将该方法应用于PersonaChat数据集。为了提升生成对话的开放性并模拟真实生活场景,我们加入了语音事件的概念,对应于说话者所参与的对话类型,同时加入了代表对话前提的共同基础概念。

英文摘要:

The prevailing paradigm in the domain of Open-Domain Dialogue agents predominantly focuses on the English language, encompassing both models and datasets. Furthermore, the financial and temporal investments required for crowdsourcing such datasets for finetuning are substantial, particularly when multiple languages are involved. Fortunately, advancements in Large Language Models (LLMs) have unveiled a plethora of possibilities across diverse tasks. Specifically, instruction-tuning has enabled LLMs to execute tasks based on natural language instructions, occasionally surpassing the performance of human crowdworkers. Additionally, these models possess the capability to function in various languages within a single thread. Consequently, to generate new samples in different languages, we propose leveraging these capabilities to replicate the data collection process. We introduce a pipeline for generating Open-Domain Dialogue data in multiple Target Languages using LLMs, with demonstrations provided in a unique Source Language. By eschewing explicit Machine Translation in this approach, we enhance the adherence to language-specific nuances. We apply this methodology to the PersonaChat dataset. To enhance the openness of generated dialogues and mimic real life scenarii, we added the notion of speech events corresponding to the type of conversation the speakers are involved in and also that of common ground which represents the premises of a conversation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑