arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.01974cs.CYcs.LGcs.SI
收藏

社交媒体上的仇恨:仇恨和反言论的大规模分类

Countering hate on social media: Large scale classification of hate and counter speech

Santa Fe Institute(圣塔菲研究所);Center for the Study of Complex Systems(复杂系统研究中心);University of Michigan(密歇根大学);Vermont Complex Systems Center(佛蒙特复杂系统中心);University of Vermont(佛蒙特大学)

Joshua Garland, Keyan Ghazi-Zahedi, Jean-Gabriel Young, Laurent Hébert-Dufresne, Mirta Galesic

摘要:

仇恨言论正在扰乱网络话语,助长极端社会运动,并可能引发现实世界的暴力。解决这一日益严重的全球性问题的一个潜在办法是公民产生的反言论,公民积极参与充满仇恨的对话,试图恢复公民的非两极化话语。然而,它在遏制仇恨蔓延方面的实际效力是未知的,难以量化。研究这个问题的一个主要障碍是缺乏大的标记数据集来训练自动分类器来识别反语音。在这里,我们利用了德国的一个独特情况,在那里,自我标签的团体从事有组织的在线仇恨和反言论。我们使用了一种集成学习算法,该算法将各种段落嵌入与正则化逻辑回归函数配对,以在来自这两组的数百万条相关推文的语料库中对仇恨和反言论进行分类。我们的流水线在样本平衡测试集外获得了0.76到0.97的宏观F1分数-准确性一致,甚至超过了最先进的水平。在数千条推文上,我们使用众包来验证分类器做出的判断与人类判断的一致性。然后,我们使用分类器在2013年至2018年发生的超过135,000个完全解决的Twitter对话中发现仇恨和反言论,并研究它们的频率和互动。总之,我们的研究结果突出了自动化方法的潜力,以评估协调的反言语在稳定社交媒体上的对话的影响。

英文摘要:

Hateful rhetoric is plaguing online discourse, fostering extreme societal movements and possibly giving rise to real-world violence. A potential solution to this growing global problem is citizen-generated counter speech where citizens actively engage in hate-filled conversations to attempt to restore civil non-polarized discourse. However, its actual effectiveness in curbing the spread of hatred is unknown and hard to quantify. One major obstacle to researching this question is a lack of large labeled data sets for training automated classifiers to identify counter speech. Here we made use of a unique situation in Germany where self-labeling groups engaged in organized online hate and counter speech. We used an ensemble learning algorithm which pairs a variety of paragraph embeddings with regularized logistic regression functions to classify both hate and counter speech in a corpus of millions of relevant tweets from these two groups. Our pipeline achieved macro F1 scores on out of sample balanced test sets ranging from 0.76 to 0.97---accuracy in line and even exceeding the state of the art. On thousands of tweets, we used crowdsourcing to verify that the judgments made by the classifier are in close alignment with human judgment. We then used the classifier to discover hate and counter speech in more than 135,000 fully-resolved Twitter conversations occurring from 2013 to 2018 and study their frequency and interaction. Altogether, our results highlight the potential of automated methods to evaluate the impact of coordinated counter speech in stabilizing conversations on social media.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑