arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.13634cs.CL

HausaNLP 在 SemEval-2023 任务 12:利用非洲低资源 TweetData 进行情感分析

HausaNLP at SemEval-2023 Task 12: Leveraging African Low Resource TweetData for Sentiment Analysis

Kaduna State University(卡杜纳州立大学);University of Bucharest(布加勒斯特大学);University of Abuja(阿布贾大学);Nile University(尼罗河大学);Universiti Teknologi PETRONAS(马来西亚石油科技大学);Bayero University Kano(卡诺贝罗大学);Shehu Shagari College of Education(谢胡·沙加里教育学院);Ahmadu Bello University, Zaria(扎里亚艾哈迈德·贝罗大学);HausaNLP(豪萨语自然语言处理研究组)
Saheed Abdullahi Salahudeen, Falalu Ibrahim Lawan, Ahmad Mustapha Wali, Amina Abubakar Imam, Aliyu Rabiu Shuaibu, Aliyu Yusuf, Nur Bala Rabiu, Musa Bello, Shams… 展开作者

Saheed Abdullahi Salahudeen, Falalu Ibrahim Lawan, Ahmad Mustapha Wali, Amina Abubakar Imam, Aliyu Rabiu Shuaibu, Aliyu Yusuf, Nur Bala Rabiu, Musa Bello, Shamsuddeen Umaru Adamu, Saminu Mohammad Aliyu, Murja Sani Gadanya, Sanah Abdullahi Muaz, Mahmoud Said Ahmad, Abdulkadir Abdullahi, Abdulmalik Yusuf Jamoh

AI总结:

该研究面向 14 种低资源非洲语言,评估多种预训练语言模型在 SemEval-2023 情感分析三个子任务上的表现,发现 Afro-xlmr-large 整体最优,且数据量更大的 Hausa、Igbo 和 Yoruba 性能更好。

摘要:

我们介绍了 SemEval-2023 任务 12 的研究结果,这是一项使用 Twitter 数据集针对低资源非洲语言开展情感分析的共享任务。该任务包含三个子任务:子任务 A 是单语情感分类,设有 12 个赛道,全部为单语语言;子任务 B 是利用子任务 A 中各赛道进行的多语情感分类;子任务 C 是零样本情感分类。我们给出了子任务 A、B 和 C 的结果与发现,并在 GitHub 上发布了代码。我们的目标是利用低资源推文数据,借助预训练的 Afro-xlmr-large、AfriBERTa-Large、Bert-base-arabic-camelbert-da-sentiment(Arabic-camelbert)、Multilingual-BERT(mBERT)和 BERT 模型,对 14 种非洲语言进行情感分析。这些子任务的数据集由来自这些语言的金标准多类别标注 Twitter 数据集组成。结果表明,Afro-xlmr-large 模型在大多数语言数据集上的表现优于其他模型。同样,尼日利亚语言 Hausa、Igbo 和 Yoruba 相比其他语言取得了更好的性能,这可归因于这些语言拥有更大量的数据。

英文摘要:

We present the findings of SemEval-2023 Task 12, a shared task on sentiment analysis for low-resource African languages using Twitter dataset. The task featured three subtasks; subtask A is monolingual sentiment classification with 12 tracks which are all monolingual languages, subtask B is multilingual sentiment classification using the tracks in subtask A and subtask C is a zero-shot sentiment classification. We present the results and findings of subtask A, subtask B and subtask C. We also release the code on github. Our goal is to leverage low-resource tweet data using pre-trained Afro-xlmr-large, AfriBERTa-Large, Bert-base-arabic-camelbert-da-sentiment (Arabic-camelbert), Multilingual-BERT (mBERT) and BERT models for sentiment analysis of 14 African languages. The datasets for these subtasks consists of a gold standard multi-class labeled Twitter datasets from these languages. Our results demonstrate that Afro-xlmr-large model performed better compared to the other models in most of the languages datasets. Similarly, Nigerian languages: Hausa, Igbo, and Yoruba achieved better performance compared to other languages and this can be attributed to the higher volume of data present in the languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑