arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.08232cs.CL
收藏

WNUT-2020任务2:识别信息性COVID-19英语推文

WNUT-2020 Task 2: Identification of Informative COVID-19 English Tweets

VinAI Research;Australian e-Health Research Centre, CSIRO(澳大利亚电子健康研究中心(CSIRO));Oracle Digital Assistant, Oracle(Oracle数字助手(Oracle公司));The University of Queensland(昆士兰大学);Oracle(Oracle公司)

Dat Quoc Nguyen, Thanh Vu, Afshin Rahimi, Mai Hoang Dao, Linh The Nguyen, Long Doan

摘要:

在本文中,我们概述了WNUT-2020关于识别信息性COVID-19英语推文的共享任务。我们描述了我们如何构建一个语料库的10 K推文,并组织开发和评估阶段,这项任务。此外,我们还简要总结了55个团队提交的最终系统评估结果,发现(i)许多系统获得了非常高的性能,高达0.91 F1分数,(ii)大多数提交的结果比基线fastText高得多(Joulin等人,2017),以及(iii)在相关语言数据上微调预训练的语言模型,然后进行监督训练,在这项任务中表现良好。

英文摘要:

In this paper, we provide an overview of the WNUT-2020 shared task on the identification of informative COVID-19 English Tweets. We describe how we construct a corpus of 10K Tweets and organize the development and evaluation phases for this task. In addition, we also present a brief summary of results obtained from the final system evaluation submissions of 55 teams, finding that (i) many systems obtain very high performance, up to 0.91 F1 score, (ii) the majority of the submissions achieve substantially higher results than the baseline fastText (Joulin et al., 2017), and (iii) fine-tuning pre-trained language models on relevant language data followed by supervised training performs well in this task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑