arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2202.02511cs.CL

A simple language-agnostic yet very strong baseline system for hate speech and offensive content identification

Laboratoire d’analyse statistique des textes - Statistical Analysis of Text Laboratory (LAST - SATLab)(文本统计分析实验室(LAST - SATLab));Institut de recherche en sciences psychologiques(心理科学研究所);Université catholique de Louvain(鲁汶天主教大学)

Yves Bestgen

英文摘要:

For automatically identifying hate speech and offensive content in tweets, a system based on a classical supervised algorithm only fed with character n-grams, and thus completely language-agnostic, is proposed by the SATLab team. After its optimization in terms of the feature weighting and the classifier parameters, it reached, in the multilingual HASOC 2021 challenge, a medium performance level in English, the language for which it is easy to develop deep learning approaches relying on many external linguistic resources, but a far better level for the two less resourced language, Hindi and Marathi. It ends even first when performances are averaged over the three tasks in these languages, outperforming many deep learning approaches. These performances suggest that it is an interesting reference level to evaluate the benefits of using more complex approaches such as deep learning or taking into account complementary resources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑