arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.12265cs.CL
收藏

基于上下文-词典的滥用语言检测方法

Contextual-Lexicon Approach for Abusive Language Detection

Institute of Mathematical and Computer Sciences, University of São Paulo(圣保罗大学数学与计算机科学学院);Ribeirão Preto Medical School, University of São Paulo(圣保罗大学里贝朗普雷图医学院);Federal University of Minas Gerais(米纳斯吉拉斯联邦大学)

Francielle Vargas, Fabiana Rodrigues de Góes, Isabelle Carvalho, Fabrício Benevenuto, Thiago Alexandre Salgueiro Pardo

摘要:

由于基于词典的方法在科学上更优雅,解释了解决方案的组成部分,并且更容易推广到其他应用程序,因此本文为社交媒体上的攻击性语言和仇恨言论检测提供了一种新方法。我们的方法体现了一个词汇的隐含和明确的进攻和咒骂的表达与上下文信息注释。由于巴西社交媒体滥用评论的严重性,以及缺乏葡萄牙语的研究,巴西葡萄牙语是用于验证模型的语言。然而,我们的方法可以适用于任何其他语言。进行的实验表明,所提出的方法的有效性,优于目前的基线方法的葡萄牙语。

英文摘要:

Since a lexicon-based approach is more elegant scientifically, explaining the solution components and being easier to generalize to other applications, this paper provides a new approach for offensive language and hate speech detection on social media. Our approach embodies a lexicon of implicit and explicit offensive and swearing expressions annotated with contextual information. Due to the severity of the social media abusive comments in Brazil, and the lack of research in Portuguese, Brazilian Portuguese is the language used to validate the models. Nevertheless, our method may be applied to any other language. The conducted experiments show the effectiveness of the proposed approach, outperforming the current baseline methods for the Portuguese language.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑