Masakhane-Afrisenti 在 SemEval-2023 任务 12:面向低资源非洲语言的 Afro-centric 语言模型与 Adapter 的情感分析
Masakhane-Afrisenti at SemEval-2023 Task 12: Sentiment Analysis using Afro-centric Language Models and Adapters for Low-resource African Languages
AI总结:
本文针对 SemEval-2023 任务 12 中 12 种低资源非洲语言的情感分类,采用 Afro-centric 语言模型、多语微调及参数高效 Adapter 方法,证明其能有效提升单语和零样本情感分析性能。
摘要:
AfriSenti-SemEval 是 SemEval-2023 的共享任务 12。该任务旨在对 12 种非洲语言进行单语情感分类(子任务 A)、多语情感分类(子任务 B)和零样本情感分类(任务 C)。对于子任务 A,我们使用经典机器学习分类器、Afro-centric 语言模型和语言特定模型进行了实验。对于任务 B,我们对支持该任务中多种语言的多语预训练语言模型进行了微调。对于任务 C,我们使用了一种参数高效的 Adapter 方法,该方法利用目标语言的单语文本实现有效的零样本迁移。我们的研究结果表明,使用预训练的 Afro-centric 语言模型能够提升低资源非洲语言的性能。我们还使用 Adapter 进行了零样本任务实验,结果表明,在资源有限的情况下,使用 Adapter 可以获得有前景的结果。
英文摘要:
AfriSenti-SemEval Shared Task 12 of SemEval-2023. The task aims to perform monolingual sentiment classification (sub-task A) for 12 African languages, multilingual sentiment classification (sub-task B), and zero-shot sentiment classification (task C). For sub-task A, we conducted experiments using classical machine learning classifiers, Afro-centric language models, and language-specific models. For task B, we fine-tuned multilingual pre-trained language models that support many of the languages in the task. For task C, we used we make use of a parameter-efficient Adapter approach that leverages monolingual texts in the target language for effective zero-shot transfer. Our findings suggest that using pre-trained Afro-centric language models improves performance for low-resource African languages. We also ran experiments using adapters for zero-shot tasks, and the results suggest that we can obtain promising results by using adapters with a limited amount of resources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。