arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.06526cs.CLcs.SI
收藏

MetaHate:一个用于统一仇恨言论检测工作的数据集

MetaHate: A Dataset for Unifying Efforts on Hate Speech Detection

Paloma Piot;Patricia Martín-Rodilla;Javier Parapar

Paloma Piot, Patricia Martín-Rodilla, Javier Parapar

AI总结:

本文提出MetaHate数据集,通过审查并整合超过60个相关数据集构建统一元集合,以支持训练更稳健、适应性更强的仇恨言论检测模型。

摘要:

仇恨言论是在线话语中一种普遍且有害的形式,通常通过一系列侮辱性词语表现出来,从充满仇恨的推文到诽谤性帖子不一而足。随着此类言论的扩散,它将全球各地的人们联系起来,并对目标个人和社群构成重大的社会、心理乃至有时是身体上的威胁。当前用于应对这一现象的计算语言学方法依赖带标签的社交媒体数据集进行训练。为了统一各方工作,我们的研究推进了对一个综合性元数据集合的迫切需求,倡导构建一个大规模数据集以有效帮助应对这一问题。我们仔细审查了超过60个数据集,选择性地将与仇恨言论相关的数据集整合到MetaHate中。本文对现有数据集进行了详细考察,突出了它们的优势和局限性。我们的发现有助于更深入地理解现有数据集,为训练更稳健、更具适应性的模型铺平道路。这些经过增强的模型对于有效应对数字领域中仇恨言论动态且复杂的本质至关重要。

英文摘要:

Hate speech represents a pervasive and detrimental form of online discourse, often manifested through an array of slurs, from hateful tweets to defamatory posts. As such speech proliferates, it connects people globally and poses significant social, psychological, and occasionally physical threats to targeted individuals and communities. Current computational linguistic approaches for tackling this phenomenon rely on labelled social media datasets for training. For unifying efforts, our study advances in the critical need for a comprehensive meta-collection, advocating for an extensive dataset to help counteract this problem effectively. We scrutinized over 60 datasets, selectively integrating those pertinent into MetaHate. This paper offers a detailed examination of existing collections, highlighting their strengths and limitations. Our findings contribute to a deeper understanding of the existing datasets, paving the way for training more robust and adaptable models. These enhanced models are essential for effectively combating the dynamic and complex nature of hate speech in the digital realm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑