arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.06758cs.CLcs.IR
收藏

使用Bioformer对COVID-19文献进行多标签主题分类

Multi-label topic classification for COVID-19 literature with Bioformer

Children’s Hospital of Philadelphia(费城儿童医院);University of Pennsylvania Perelman School of Medicine(宾夕法尼亚大学佩雷尔曼医学院)

Li Fang, Kai Wang

摘要:

我们描述了Bioformer团队参与COVID-19文献的多标签主题分类任务(BioCreative VII的第5轨道)。使用不同的BERT模型(BioBERT、PubMed BERT和Bioformer)进行主题分类。我们将主题分类任务表述为句子对分类问题,其中标题是第一句,摘要是第二句。我们的研究结果表明,Bioformer在这项任务中优于BioBERT和PubMedBERT。与基线结果相比,我们的最佳模型将微观,宏观和基于实例的F1分数分别提高了8.8%,15.5%,7.4%。Bioformer在这次挑战中获得了最高的微观F1和宏观F1分数。在挑战后的实验中,我们发现对COVID-19文章进行生物成形剂的预训练进一步提高了性能。

英文摘要:

We describe Bioformer team's participation in the multi-label topic classification task for COVID-19 literature (track 5 of BioCreative VII). Topic classification is performed using different BERT models (BioBERT, PubMedBERT, and Bioformer). We formulate the topic classification task as a sentence pair classification problem, where the title is the first sentence, and the abstract is the second sentence. Our results show that Bioformer outperforms BioBERT and PubMedBERT in this task. Compared to the baseline results, our best model increased micro, macro, and instance-based F1 score by 8.8%, 15.5%, 7.4%, respectively. Bioformer achieved the highest micro F1 and macro F1 scores in this challenge. In post-challenge experiments, we found that pretraining of Bioformer on COVID-19 articles further improves the performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑