arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.05683cs.CLcs.LGcs.NE
收藏

结合上下文无关和上下文化表示用于阿拉伯语讽刺检测和情感识别

Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification

Savitribai Phule Pune University(萨维特里巴伊·普勒浦那大学)

Amey Hengle, Atharva Kshirsagar, Shaily Desai, Manisha Marathe

摘要:

自诞生以来,基于transformer的语言模型已经在多个自然语言处理任务中带来了令人印象深刻的性能提升。对于阿拉伯语,大多数数据集上的当前最先进的结果是通过AraBERT语言模型实现的。尽管最近取得了这些进展,讽刺和情感检测仍然是阿拉伯语中具有挑战性的任务,因为该语言具有丰富的形态,语言差异和方言变化。本文提供了SPPU-AASM团队提交的WANLP ArSarcasm共享任务2021,该任务围绕阿拉伯语推文的讽刺和情感极性检测。该研究提出了一种混合模型,将AraBERT的句子表示与在阿拉伯语社交媒体语料库上训练的静态词向量相结合。所提出的系统实现了F1讽刺得分为0.62和F-PN得分为0.715的讽刺和情感检测任务,分别。仿真结果表明,该系统优于现有的多种方法的任务,这表明,上下文无关和上下文相关的文本表示的融合,可以帮助捕捉阿拉伯语单词意义的互补方面。该系统在讽刺检测和情感识别的子任务中分别排名第二和第十。

英文摘要:

Since their inception, transformer-based language models have led to impressive performance gains across multiple natural language processing tasks. For Arabic, the current state-of-the-art results on most datasets are achieved by the AraBERT language model. Notwithstanding these recent advancements, sarcasm and sentiment detection persist to be challenging tasks in Arabic, given the language's rich morphology, linguistic disparity and dialectal variations. This paper proffers team SPPU-AASM's submission for the WANLP ArSarcasm shared-task 2021, which centers around the sarcasm and sentiment polarity detection of Arabic tweets. The study proposes a hybrid model, combining sentence representations from AraBERT with static word vectors trained on Arabic social media corpora. The proposed system achieves a F1-sarcastic score of 0.62 and a F-PN score of 0.715 for the sarcasm and sentiment detection tasks, respectively. Simulation results show that the proposed system outperforms multiple existing approaches for both the tasks, suggesting that the amalgamation of context-free and context-dependent text representations can help capture complementary facets of word meaning in Arabic. The system ranked second and tenth in the respective sub-tasks of sarcasm detection and sentiment identification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑