DaNetQA:一个面向俄语的是/否问答数据集
DaNetQA: a yes/no Question Answering Dataset for the Russian Language
AI总结:
本文构建俄语是/否问答数据集 DaNetQA,给出可复现的构建流程,并通过 Paraphraser、XNLI 俄语部分和 SberQUAD 的任务迁移,以及英译俄翻译与多语言微调的语言迁移来评估模型效果。
摘要:
DaNetQA 是一个新的问答语料库,遵循 Clark 等人(2019)的设计:它由自然的是/否问题组成。每个问题都配有一段来自 Wikipedia 的段落以及一个从该段落推导出的答案。该任务以问题和段落二者作为输入,并给出是/否答案,即产生一个二元输出。在本文中,我们提出了一种可复现的 DaNetQA 构建方法,并研究用于任务迁移和语言迁移的迁移学习方法。对于任务迁移,我们利用三个相似的句子建模任务:1)释义语料库 Paraphraser;2)一项 NLI 任务,我们使用 XNLI 的俄语部分;3)另一项问答任务 SberQUAD。对于语言迁移,我们使用英译俄翻译以及多语言语言微调。
英文摘要:
DaNetQA, a new question-answering corpus, follows (Clark et. al, 2019) design: it comprises natural yes/no questions. Each question is paired with a paragraph from Wikipedia and an answer, derived from the paragraph. The task is to take both the question and a paragraph as input and come up with a yes/no answer, i.e. to produce a binary output. In this paper, we present a reproducible approach to DaNetQA creation and investigate transfer learning methods for task and language transferring. For task transferring we leverage three similar sentence modelling tasks: 1) a corpus of paraphrases, Paraphraser, 2) an NLI task, for which we use the Russian part of XNLI, 3) another question answering task, SberQUAD. For language transferring we use English to Russian translation together with multilingual language fine-tuning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。