arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.12522cs.CL
收藏

人们在询问关于COVID-19的什么问题?一个问题分类数据集

What Are People Asking About COVID-19? A Question Classification Dataset

ProtagoLabs(普罗塔戈实验室);International Monetary Fund(国际货币基金组织);Dartmouth College(达特茅斯学院)

Jerry Wei, Chengyu Huang, Soroush Vosoughi, Jason Wei

AI总结:

提出COVID-Q数据集,包含1,690个COVID-19问题,标注为15类和207簇,发现常见问题多未被权威FAQ解答,BERT基线分类准确率58.1%,聚类49.5%,可用于系统开发或模型评估。

摘要:

我们提出了COVID-Q,这是一个包含来自13个来源的1,690个关于COVID-19问题的集合,我们将其标注为15个问题类别和207个问题簇。我们数据集中最常见的问题询问了COVID的传播、预防和社会影响,并且我们发现,许多出现在多个来源中的问题并没有被诸如CDC和FDA等声誉卓著组织的任何FAQ网站所回答。我们在https://github.com/JerryWeiAI/COVID-Q上公开发布了我们的数据集。对于将问题分类为15个类别的任务,当每个类别在20个示例上训练时,BERT基线达到了58.1%的准确率;而对于问题聚类任务,BERT + triplet loss基线达到了49.5%的准确率。我们希望COVID-Q能够帮助直接用于开发应用系统,或作为模型评估的特定领域资源。

英文摘要:

We present COVID-Q, a set of 1,690 questions about COVID-19 from 13 sources, which we annotate into 15 question categories and 207 question clusters. The most common questions in our dataset asked about transmission, prevention, and societal effects of COVID, and we found that many questions that appeared in multiple sources were not answered by any FAQ websites of reputable organizations such as the CDC and FDA. We post our dataset publicly at https://github.com/JerryWeiAI/COVID-Q. For classifying questions into 15 categories, a BERT baseline scored 58.1% accuracy when trained on 20 examples per category, and for a question clustering task, a BERT + triplet loss baseline achieved 49.5% accuracy. We hope COVID-Q can help either for direct use in developing applied systems or as a domain-specific resource for model evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑