arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1912.02145cs.CL
收藏

面向领域无关问答的数据增强和采样技术研究

An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering

Apple Inc.(苹果公司)

Shayne Longpre, Yi Lu, Zhucheng Tu, Chris DuBois

摘要:

为了为机器阅读问答(MRQA)2019共享任务生成一个与领域无关的问答模型,我们研究了大型预训练语言模型、各种数据采样策略以及通过反向翻译生成的查询和上下文释义的相对优势。我们发现一种简单的负采样技术特别有效,即使它通常用于包含无法回答的问题的数据集,例如SQuAD 2.0。当与每域采样结合应用时,我们的XLNet(Yang等人,2019)-在MRQA排行榜比赛中,基于提交的作品获得了第二好的精确匹配和F1。

英文摘要:

To produce a domain-agnostic question answering model for the Machine Reading Question Answering (MRQA) 2019 Shared Task, we investigate the relative benefits of large pre-trained language models, various data sampling strategies, as well as query and context paraphrases generated by back-translation. We find a simple negative sampling technique to be particularly effective, even though it is typically used for datasets that include unanswerable questions, such as SQuAD 2.0. When applied in conjunction with per-domain sampling, our XLNet (Yang et al., 2019)-based submission achieved the second best Exact Match and F1 in the MRQA leaderboard competition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑