arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.01611cs.CLcs.FLcs.LG
收藏

当有疑问时,问:生成可回答和不可回答的问题,无监督

When in Doubt, Ask: Generating Answerable and Unanswerable Questions, Unsupervised

Stanford University(斯坦福大学)

Liubov Nikolenko, Pouya Rezazadeh Kalehbasti

摘要:

问答(QA)是实现人机之间可靠通信的关键。用于QA的现代语言模型在几个基本任务中已经超过了人类的表现;然而,这些模型需要大量的人工生成的训练数据,这是昂贵和耗时的创建。本文研究用合成数据扩充人工数据集作为克服这一问题的一种方法。一个基于深度Transformers的最先进的模型被用来检查使用合成的可回答和不可回答的问题来补充一个众所周知的人造数据集的影响。结果表明,在混合数据集上训练的语言模型(以F1和EM分数衡量)的性能有了明显的改善。具体来说,无法回答的问题-答案证明在提升模型方面更有效:将可回答、不可回答和组合问题-答案添加到原始数据集的F1得分分别为1.3%、5.0%和6.7%。[Link到Github仓库:https://github.com/lnikolenko/EQA]

英文摘要:

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large amounts of human-generated training data which are costly and time-consuming to create. This paper studies augmenting human-made datasets with synthetic data as a way of surmounting this problem. A state-of-the-art model based on deep transformers is used to inspect the impact of using synthetic answerable and unanswerable questions to complement a well-known human-made dataset. The results indicate a tangible improvement in the performance of the language model (measured in terms of F1 and EM scores) trained on the mixed dataset. Specifically, unanswerable question-answers prove more effective in boosting the model: the F1 score gain from adding to the original dataset the answerable, unanswerable, and combined question-answers were 1.3%, 5.0%, and 6.7%, respectively. [Link to the Github repository: https://github.com/lnikolenko/EQA]

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑