arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.07269cs.CL

SemEval-2025 任务11:弥合基于文本的情感检测中的差距

SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection

Imperial College London(伦敦帝国学院);Bayero University Kano(卡诺州巴耶罗大学);Cardiff University(卡迪夫大学);University of Pretoria(比勒陀利亚大学);University of Hamburg(汉堡大学);University of Göttingen(哥廷根大学);Uppsala University(乌普萨拉大学);University of Melbourne(墨尔本大学);Instituto Politécnico Nacional(国家理工学院);Wollo University(沃洛大学);Northeastern University(东北大学);IIIT Hyderabad(海得拉巴国际信息技术学院);University of Alberta(阿尔伯塔大学);MILA(米拉研究所);McGill University(麦吉尔大学);MBZUAI(Mohamed bin Zayed 人工智能大学);LIACC(葡萄牙波尔图大学先进计算实验室);FEUP, University of Porto(波尔图大学工程学院);Sailplane AI(Sailplane AI公司);Bahir Dar University(巴赫达尔大学);Santa Clara University(圣克拉拉大学);Skoltech(斯科尔科沃科技学院);AIRI(人工智能研究所);National Research Council Canada(加拿大国家研究委员会)
Shamsuddeen Hassan Muhammad, Nedjma Ousidhoum, Idris Abdulmumin, Seid Muhie Yimam, Jan Philip Wahle, Terry Ruas, Meriem Beloucif, Christine De Kock, Tadesse Des… 展开作者

Shamsuddeen Hassan Muhammad, Nedjma Ousidhoum, Idris Abdulmumin, Seid Muhie Yimam, Jan Philip Wahle, Terry Ruas, Meriem Beloucif, Christine De Kock, Tadesse Destaw Belay, Ibrahim Said Ahmad, Nirmal Surange, Daniela Teodorescu, David Ifeoluwa Adelani, Alham Fikri Aji, Felermino Ali, Vladimir Araujo, Abinew Ali Ayele, Oana Ignat, Alexander Panchenko, Yi Zhou, Saif M. Mohammad

AI总结:

本任务提出多语言(30+语言)文本情感检测共享任务,涵盖多标签、强度与跨语言三轨道,吸引超700参与者,并公开数据集与基线及最佳系统分析。

摘要:

我们提出了关于基于文本的情感检测的共享任务,涵盖来自七个不同语系的30多种语言。这些语言主要为低资源语言,分布于各大洲。数据实例被多标签标注为六种情感类别,另有11种语言的额外数据集标注了情感强度。参与者被要求预测三个轨道的标签:(a)多标签情感检测,(b)情感强度分数检测,以及(c)跨语言情感检测。该任务吸引了超过700名参与者。我们收到了来自200多个团队的最终提交和93篇系统描述论文。我们报告了基线结果,以及关于表现最佳系统、最常见方法和在不同轨道和语言中最有效方法的发现。该任务的数据集公开可用。数据集可在SemEval2025任务11 https://brighter-dataset.github.io 获取。

英文摘要:

We present our shared task on text-based emotion detection, covering more than 30 languages from seven distinct language families. These languages are predominantly low-resource and are spoken across various continents. The data instances are multi-labeled with six emotional classes, with additional datasets in 11 languages annotated for emotion intensity. Participants were asked to predict labels in three tracks: (a) multilabel emotion detection, (b) emotion intensity score detection, and (c) cross-lingual emotion detection. The task attracted over 700 participants. We received final submissions from more than 200 teams and 93 system description papers. We report baseline results, along with findings on the best-performing systems, the most common approaches, and the most effective methods across different tracks and languages. The datasets for this task are publicly available. The dataset is available at SemEval2025 Task 11 https://brighter-dataset.github.io

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑