ArabicNLU 2024：首届阿拉伯语自然语言理解共享任务
ArabicNLU 2024: The First Arabic Natural Language Understanding Shared Task
AI总结：
本文介绍了首届ArabicNLU 2024共享任务，涵盖WSD和LMD两个子任务，提供了SALMA和IDRISI-DA等新数据集，并报告了最终评估结果以推动阿拉伯语NLU技术发展。
摘要：
本文概述了阿拉伯语自然语言理解（ArabicNLU 2024）共享任务，重点关注两个子任务：词义消歧（WSD）和位置提及消歧（LMD）。该任务旨在评估自动化系统解决阿拉伯语文本中词汇歧义和识别所提及位置的能力。我们为参与者提供了新颖的数据集，包括用于WSD的词义标注语料库SALMA（包含约34k个标注词元），以及IDRISI-DA数据集（包含3,893条标注和763个唯一位置提及）。这些任务极具挑战性。在注册的38支队伍中，仅3支队伍参与了最终评估阶段，WSD的最高准确率为77.8%，LMD的最高MRR@1为95.0%。该共享任务不仅促进了对不同技术的评估与比较，也为阿拉伯语NLU技术的持续发展提供了宝贵的见解与资源。
英文摘要：
This paper presents an overview of the Arabic Natural Language Understanding (ArabicNLU 2024) shared task, focusing on two subtasks: Word Sense Disambiguation (WSD) and Location Mention Disambiguation (LMD). The task aimed to evaluate the ability of automated systems to resolve word ambiguity and identify locations mentioned in Arabic text. We provided participants with novel datasets, including a sense-annotated corpus for WSD, called SALMA with approximately 34k annotated tokens, and the IDRISI-DA dataset with 3,893 annotations and 763 unique location mentions. These are challenging tasks. Out of the 38 registered teams, only three teams participated in the final evaluation phase, with the highest accuracy being 77.8% for WSD and the highest MRR@1 being 95.0% for LMD. The shared task not only facilitated the evaluation and comparison of different techniques, but also provided valuable insights and resources for the continued advancement of Arabic NLU technologies.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
