KINLP 在 SemEval-2023 任务 12 中:卢旺达语推文情感分析
KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysis
AI总结:
本文提出面向卢旺达语推文情感分析的两层 transformer 语言专用模型,通过多任务掩码形态预测预训练并支持无代码微调,最终在 SemEval-2023 任务 12 的 34 支队伍中获第二名、加权 F1 为 72.50%。
摘要:
本文介绍了作者提交给 SemEval-2023 任务 12“非洲语言情感分析”的系统。该系统聚焦卢旺达语,并使用一种语言专用模型。卢旺达语形态在两层 transformer 架构中建模,并且该 transformer 模型通过多任务掩码形态预测在大型文本语料库上进行预训练。模型部署在一个实验平台上,用户无需编写机器学习代码即可试验预训练语言模型的微调。我们向该共享任务提交的最终系统在竞赛的 34 支队伍中排名第二,取得 72.50% 的加权 F1 分数。我们对评估结果的分析突出了在该任务上实现高准确率所面临的挑战,并确定了可改进的领域。
英文摘要:
This paper describes the system entered by the author to the SemEval-2023 Task 12: Sentiment analysis for African languages. The system focuses on the Kinyarwanda language and uses a language-specific model. Kinyarwanda morphology is modeled in a two tier transformer architecture and the transformer model is pre-trained on a large text corpus using multi-task masked morphology prediction. The model is deployed on an experimental platform that allows users to experiment with the pre-trained language model fine-tuning without the need to write machine learning code. Our final submission to the shared task achieves second ranking out of 34 teams in the competition, achieving 72.50% weighted F1 score. Our analysis of the evaluation results highlights challenges in achieving high accuracy on the task and identifies areas for improvement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。