AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles
University of Udine(乌迪内大学);University of Naples Federico II(那不勒斯费德里科二世大学);The Hong Kong Polytechnic University(香港理工大学);Bayer Pharmaceuticals(拜耳制药)
英文摘要:
This paper describes the models developed by the AILAB-Udine team for the SMM4H 22 Shared Task. We explored the limits of Transformer based models on text classification, entity extraction and entity normalization, tackling Tasks 1, 2, 5, 6 and 10. The main take-aways we got from participating in different tasks are: the overwhelming positive effects of combining different architectures when using ensemble learning, and the great potential of generative models for term normalization.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。