arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.03452cs.CLcs.LG

AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles

University of Udine(乌迪内大学);University of Naples Federico II(那不勒斯费德里科二世大学);The Hong Kong Polytechnic University(香港理工大学);Bayer Pharmaceuticals(拜耳制药)

Beatrice Portelli, Simone Scaboro, Emmanuele Chersoni, Enrico Santus, Giuseppe Serra

英文摘要:

This paper describes the models developed by the AILAB-Udine team for the SMM4H 22 Shared Task. We explored the limits of Transformer based models on text classification, entity extraction and entity normalization, tackling Tasks 1, 2, 5, 6 and 10. The main take-aways we got from participating in different tasks are: the overwhelming positive effects of combining different architectures when using ensemble learning, and the great potential of generative models for term normalization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑