We present an overview of the second shared task on language identification in code-switched data. For the shared task, we had code-switched data from two different language pairs: Modern Standard Arabic-Dialectal Arabic (MSA-DA) and Spanish-English (SPA-ENG). We had a total of nine participating teams, with all teams submitting a system for SPA-ENG and four submitting for MSA-DA. Through evaluation, we found that once again language identification is more difficult for the language pair that is more closely related. We also found that this year's systems performed better overall than the systems from the previous shared task indicating overall progress in the state of the art for this task.
Overview of PerpectiveArg2024: The First Shared Task on Perspective Argument Retrieval
Institute for Natural Language Processing, University of Stuttgart(斯图加特大学自然语言处理研究所);Lucerne University of Applied Sciences and Arts(卢塞恩应用科学与艺术大学);Technical University of Darmstadt(达姆施塔特工业大学)
Overview of the Problem List Summarization (ProbSum) 2023 Shared Task on Summarizing Patients' Active Diagnoses and Problems from Electronic Health Record Progress Notes
University of Wisconsin(威斯康星大学);Loyola University Chicago(芝加哥洛约拉大学);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School(哈佛医学院)
Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications
University of Mannheim(曼海姆大学);GESIS – Leibniz Institute for the Social Sciences(GESIS——莱布尼茨社会科学研究所);Fraunhofer ISI(弗劳恩霍夫系统与创新研究所);Stuttgart Media University(斯图加特传媒大学)
Overview of GUA-SPA at IberLEF 2023: Guarani-Spanish Code Switching Analysis
Universidad de la República(共和国大学);Universidad de Granada(格拉纳达大学);Fujitsu(富士通);Universidade Tecnologica Federal do Paraná(巴拉那联邦理工大学);Universidad Nacional de Itapúa(伊塔普阿国立大学);University of Houston(休斯顿大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Overview of SCIDOCA 2025 Shared Task on Citation Prediction, Discovery, and Placement
RIKEN Center for Advanced Intelligence Project (AIP), Japan(日本先进情报项目研究所);The Institute of Statistical Mathematics, Japan(日本统计数学研究所);Japan Advanced Institute of Science and Technology(日本先进科学技术研究所)
Overview of the PsyDefDetect Shared Task at BioNLP 2026: Detecting Levels of Psychological Defense Mechanisms in Supportive Conversations
University of Technology Sydney(技术大学悉尼);Xi’an Jiaotong-Liverpool University(西安交通大学-利物浦大学);University of Utah(犹他大学);Harvard University(哈佛大学);The University of Melbourne(墨尔本大学);The University of Manchester(曼彻斯特大学);ELLIS Institute Finland(芬兰ELLIS研究所);University of Turku(图尔库大学)
Overview of the WANLP 2022 Shared Task on Propaganda Detection in Arabic
Qatar Computing Research Institute(卡塔尔计算研究所);Hamad Bin Khalifa University(哈马德·本·哈利法大学);University of Padova(帕多瓦大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021
Instituto Politécnico Nacional (IPN)(国立理工学院);Ronin Institute for Independent Scholarship(罗宁独立学术研究所);Moscow Institute of Physics and Technology(莫斯科物理技术学院)
NFDI4DS Shared Tasks for Scholarly Document Processing
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)(德意志人工智能研究中心有限公司);Leuphana University of Lüneburg(吕贝克大学);TIB Leibniz Information Centre for Science and Technology(科学与技术信息中心);Fraunhofer Institute for Open Communication Systems FOKUS(开放通信系统研究所);GESIS – Leibniz Institute for the Social Sciences(社会科学莱比锡研究所);University Hospital Cologne, University of Cologne, Institute for Biomedical Informatics(科隆大学医院,生物医学信息学研究所);FIZ-Karlsruhe – Leibniz-Institute for Information Infrastructure(信息基础设施莱比锡研究所)
The CL-SciSumm Shared Task 2018: Results and Key Insights
University of Pennsylvania(宾夕法尼亚大学);Yale University(耶鲁大学);National University of Singapore(新加坡国立大学);Smart Systems Institute, National University of Singapore(新加坡国立大学智能系统研究所)
RuNNE-2022 Shared Task: Recognizing Nested Named Entities
HSE University(高等经济大学);Huawei Noah’s Ark lab(华为诺亚方舟实验室);Lomonosov Moscow State University(罗蒙诺索夫莫斯科国立大学);Novosibirsk State University(新西伯利亚国立大学);Innopolis University(Innopolis大学);Kazan Federal University(喀山联邦大学);Sber AI(俄罗斯联邦储蓄银行人工智能实验室)
AGRR-2019: A Corpus for Gapping Resolution in Russian
ABBYY(ABBYY公司);Charles University(查理大学);Moscow Institute of Physics and Technology(莫斯科物理技术学院);Sberbank(俄罗斯联邦储蓄银行);National Research University Higher School of Economics(国家研究型高等经济大学)
SocialNLP EmotionGIF 2020 Challenge Overview: Predicting Reaction GIF Categories on Social Media
Taiwan International Graduate Program(台湾国际研究生学程);Institute of Information Science, Academia Sinica(中央研究院资讯科学研究所);Institute of Service Science, National Tsing Hua University(国立清华大学服务科学研究所)
ArAIEval Shared Task: Propagandistic Techniques Detection in Unimodal and Multimodal Arabic Content
Qatar Computing Research Institute(卡塔尔计算研究所);HBKU(哈迈德·本·哈利法大学);University of New Brunswick(新不伦瑞克大学);Hamad Bin Khalifa University(哈迈德·本·哈利法大学);Northwestern University in Qatar(西北大学卡塔尔分校)
Johns Hopkins University(约翰霍普金斯大学);OpenAI;University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校);Air Force Research Laboratory(空军研究实验室);Human Language Technology Center of Excellence, Johns Hopkins University(约翰霍普金斯大学人类语言技术卓越中心);University of Amsterdam(阿姆斯特丹大学);Huazhong University of Science and Technology(华中科技大学)
Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models
University of Helsinki(赫尔辛基大学);Politecnico di Torino(都灵理工大学);Université Bretagne Sud(南布列塔尼大学);University of Copenhagen(哥本哈根大学);University Grenoble Alpes(格勒诺布尔阿尔卑斯大学);University of Lorraine(洛林大学)