arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.10652cs.CLcs.SI
收藏

Explorers团队在#SMM4H 2023中的研究:通过知识与模型融合增强面向健康应用的BERT

Explorers at #SMM4H 2023: Enhancing BERT for Health Applications through Knowledge and Model Fusion

Capital University of Economics and Business(首都经济贸易大学);University of Ottawa(渥太华大学)

Xutong Yue, Xilai Wang, Yuxin He, Zhenkun Zhou

AI总结:

本研究针对社交媒体健康数据挖掘需求,提出融合数据预处理、持续预训练、微调优化及W2NER架构的增强BERT方案,在#SMM4H 2023共享任务3中夺冠。

摘要:

越来越多的人愿意在社交媒体上发布状态和观点,这类数据已成为研究人类健康的宝贵资源,社交媒体也已成为当前医疗健康领域的关键研究方向。本文阐述了我们参与#SMM4H 2023共享任务的方法,包括数据预处理、持续预训练和微调优化策略。针对命名实体识别(NER)任务,我们特别采用了名为W2NER的模型架构,有效提升了模型的泛化能力。我们的方法在任务3中取得了第一名。本文已通过同行评审,被#SMM4H 2023 Workshop接收并将进行报告展示。

英文摘要:

An increasing number of individuals are willing to post states and opinions in social media, which has become a valuable data resource for studying human health. Furthermore, social media has been a crucial research point for healthcare now. This paper outlines the methods in our participation in the #SMM4H 2023 Shared Tasks, including data preprocessing, continual pre-training and fine-tuned optimization strategies. Especially for the Named Entity Recognition (NER) task, we utilize the model architecture named W2NER that effectively enhances the model generalization ability. Our method achieved first place in the Task 3. This paper has been peer-reviewed and accepted for presentation at the #SMM4H 2023 Workshop.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑