arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.12018cs.CLcs.AI
收藏

公共仇恨言论数据集的实证评估

Empirical Evaluation of Public HateSpeech Datasets

School of Computer Science(计算机科学学院);University of Sunderland(桑德兰大学)

Sadar Jaf, Basel Barakat

AI总结:

本研究实证评估公共仇恨言论数据集,揭示其局限性,旨在改进机器学习检测模型的准确性与可靠性。

摘要:

尽管社交媒体平台提供了广泛的沟通便利,但仍需解决众多挑战以确保用户安全。用户在这些平台上面临的最重大风险之一便是针对性的仇恨言论。社交媒体平台被广泛用于生成用于训练和评估仇恨言论检测机器学习算法的数据集。然而,现有的公共数据集存在诸多局限性,阻碍了这些算法的有效训练,并导致仇恨言论分类不准确。本研究对常用于自动化仇恨言论分类的多个公共数据集进行了全面的实证评估。通过严谨的分析,我们提供了令人信服的证据,突显了当前仇恨言论数据集的局限性。此外,我们进行了一系列统计分析,以阐明这些数据集固有的优缺点。这项工作旨在通过解决已识别的数据集局限性,推动开发更准确、更可靠的仇恨言论检测机器学习模型。

英文摘要:

Despite the extensive communication benefits offered by social media platforms, numerous challenges must be addressed to ensure user safety. One of the most significant risks faced by users on these platforms is targeted hate speech. Social media platforms are widely utilised for generating datasets employed in training and evaluating machine learning algorithms for hate speech detection. However, existing public datasets exhibit numerous limitations, hindering the effective training of these algorithms and leading to inaccurate hate speech classification. This study provides a comprehensive empirical evaluation of several public datasets commonly used in automated hate speech classification. Through rigorous analysis, we present compelling evidence highlighting the limitations of current hate speech datasets. Additionally, we conduct a range of statistical analyses to elucidate the strengths and weaknesses inherent in these datasets. This work aims to advance the development of more accurate and reliable machine learning models for hate speech detection by addressing the dataset limitations identified.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑