NLU-STR 在 SemEval-2024 任务 1:基于生成的增强与基于编码器的评分用于语义文本相关性
NLU-STR at SemEval-2024 Task 1: Generative-based Augmentation and Encoder-based Scoring for Semantic Textual Relatedness
AI总结:
本文提出结合生成式数据增强与基于 BERT 的回归评分和余弦相似度方法,在 SemRel-2024 语义文本相关性任务中处理阿拉伯语及方言,并在现代标准阿拉伯语赛道取得第一名。
摘要:
语义文本相关性是语义相似度的一个更广泛概念。它衡量两段文本在多大程度上传达相似的含义或主题,或共享相关的概念或语境。这种相关性概念可应用于多种场景,如文档聚类和摘要。SemRel-2024 是 SemEval-2024 中的一项共享任务,旨在通过提供包括阿拉伯语在内的十四种语言和方言的数据集来缩小语义相关性任务中的差距。本文报告了我们参与 Track A(阿尔及利亚和摩洛哥方言)和 Track B(现代标准阿拉伯语)的情况。在监督赛道(A)中,基于 BERT 的模型经过增强和微调用于回归评分;在无监督赛道(B)中,采用基于 BERT 的余弦相似度。我们的系统在 SemRel-2024 的现代标准阿拉伯语(MSA)中排名第一,Spearman 相关系数为 0.49。我们在摩洛哥方言中排名第五,在阿尔及利亚方言中排名第十二,得分分别为 0.83 和 0.53。
英文摘要:
Semantic textual relatedness is a broader concept of semantic similarity. It measures the extent to which two chunks of text convey similar meaning or topics, or share related concepts or contexts. This notion of relatedness can be applied in various applications, such as document clustering and summarizing. SemRel-2024, a shared task in SemEval-2024, aims at reducing the gap in the semantic relatedness task by providing datasets for fourteen languages and dialects including Arabic. This paper reports on our participation in Track A (Algerian and Moroccan dialects) and Track B (Modern Standard Arabic). A BERT-based model is augmented and fine-tuned for regression scoring in supervised track (A), while BERT-based cosine similarity is employed for unsupervised track (B). Our system ranked 1st in SemRel-2024 for MSA with a Spearman correlation score of 0.49. We ranked 5th for Moroccan and 12th for Algerian with scores of 0.83 and 0.53, respectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。