UBC-DLNLP 在 SemEval-2023 任务 12 中的研究:迁移学习对非洲语言情感分析的影响
UBC-DLNLP at SemEval-2023 Task 12: Impact of Transfer Learning on African Sentiment Analysis
AI总结:
本文介绍 UBC-DLNLP 在 AfriSenti-SemEval 中面向 14 种非洲语言的情感分析系统,通过六种语言模型的进一步预训练与微调,验证迁移学习在监督和零样本设置下的效果。
摘要:
我们介绍了对 SemEval 2023 AfriSenti-SemEval 共享任务的贡献,在该任务中,我们处理 14 种不同非洲语言的情感分析任务。我们在完全监督设置(子任务 A 和 B)下开发了单语和多语模型。我们还为零样本设置(子任务 C)开发了模型。我们的方法包括使用六个语言模型进行迁移学习实验,涵盖对其中部分模型的进一步预训练,以及最后的微调阶段。表现最佳的模型在开发数据上取得 70.36 的 F1 分数,在测试数据上取得 66.13 的 F1 分数。不出所料,结果表明迁移学习和微调技术对多语言情感分析是有效的。我们的方法可应用于不同语言和领域的其他情感分析任务。
英文摘要:
We describe our contribution to the SemEVAl 2023 AfriSenti-SemEval shared task, where we tackle the task of sentiment analysis in 14 different African languages. We develop both monolingual and multilingual models under a full supervised setting (subtasks A and B). We also develop models for the zero-shot setting (subtask C). Our approach involves experimenting with transfer learning using six language models, including further pertaining of some of these models as well as a final finetuning stage. Our best performing models achieve an F1-score of 70.36 on development data and an F1-score of 66.13 on test data. Unsurprisingly, our results demonstrate the effectiveness of transfer learning and fine-tuning techniques for sentiment analysis across multiple languages. Our approach can be applied to other sentiment analysis tasks in different languages and domains.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。