In this paper, we present the main findings and compare the results of SemEval-2020 Task 10, Emphasis Selection for Written Text in Visual Media. The goal of this shared task is to design automatic methods for emphasis selection, i.e. choosing candidates for emphasis in textual content to enable automated design assistance in authoring. The main focus is on short text instances for social media, with a variety of examples, from social media posts to inspirational quotes. Participants were asked to model emphasis using plain text with no additional context from the user or other design considerations. SemEval-2020 Emphasis Selection shared task attracted 197 participants in the early phase and a total of 31 teams made submissions to this task. The highest-ranked submission achieved 0.823 Matchm score. The analysis of systems submitted to the task indicates that BERT and RoBERTa were the most common choice of pre-trained models used, and part of speech tag (POS) was the most useful feature. Full results can be found on the task's website.
CS-Embed at SemEval-2020 Task 9: The effectiveness of code-switched word embeddings for sentiment analysis
University of Birmingham(伯明翰大学);Birmingham City University(伯明翰城市大学)
社交媒体帖子的情感分析的日益普及和应用自然导致了对以多种语言撰写的帖子的情感分析,这种做法被称为代码切换。虽然最近对代码转换帖子的研究集中在使用多语言词嵌入上,但这些嵌入并没有在代码转换数据上进行训练。在这项工作中,我们提出了在代码切换推文上训练的词嵌入,特别是那些使用西班牙语和英语的推文,称为西班牙式英语。我们探索嵌入空间,以发现它们如何捕捉两种语言中单词的含义。我们通过参加SemEval 2020任务9:~ \emph{Sentiment Analysis on Code-Mixed Social Media Text}来测试这些嵌入的有效性。我们利用它们来训练情感分类器,其F-1得分为0.722。这高于0.656的比赛基线,我们的团队(codalab用户名\emph{francesita})在29个参赛团队中排名第14,击败了基线。
SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection
MBZUAI(穆罕默德·本·扎耶德人工智能大学);TU Darmstadt(达姆施塔特工业大学);University of Cambridge(剑桥大学);Institute of Information Science Technology(信息技术研究所);New York University Abu Dhabi(纽约大学阿布扎比分校)
Sharif-MGTD at SemEval-2024 Task 8: A Transformer-Based Approach to Detect Machine Generated Text
Ferdowsi University of Mashhad(马什哈德费尔多西大学);Amirkabir University of Technology(阿米尔卡比尔理工大学);University of Tehran(德黑兰大学);Sharif University of Technology(谢里夫理工大学)