arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2209.08697cs.SIcs.CLcs.LGstat.AP

量化仇恨社区如何使在线用户激进化

Quantifying How Hateful Communities Radicalize Online Users

Information Sciences Institute(信息科学研究所);University of Southern California(南加州大学)

Matheus Schmitz, Keith Burghardt, Goran Muric

AI总结:

本文利用 Reddit 数据和中断时间序列分析,量化边缘仇恨社区对用户社区外仇恨言论的溢出效应,发现加入此类社区会导致仇恨言论在平台扩散并持续数月,为治理回声室提供了新证据。

摘要:

虽然在线社交媒体为被忽视或压抑的声音提供了被听见的途径,但它也为用户提供了传播仇恨言论的平台。这类言论通常起源于边缘社区,却可能溢出到主流渠道。本文衡量了加入边缘仇恨社区对传播到社交网络其余部分的仇恨言论所产生的影响。我们利用来自 Reddit 的数据,评估加入一种回声室——即由表现出仇恨行为的志同道合用户组成的数字社区——的效应。我们测量成员在成为活跃参与者之前和之后在研究社区之外使用仇恨言论的情况。使用中断时间序列(ITS)分析作为因果推断方法,我们通过将社区外仇恨词使用水平作为习得仇恨的代理指标,来评估溢出效应,即某一社区内部的仇恨语言可能传播到该社区之外。我们调查了四个不同的 Reddit 子社区(subreddits),涵盖仇恨言论的三个领域:种族主义、厌女症和肥胖羞辱。在所有三种情况下,我们都发现原始社区之外的仇恨言论有所增加,这意味着加入此类社区会导致仇恨言论在整个平台上传播。此外,用户被发现在最初加入社区后的数月内持续习得这种新的仇恨言论。我们表明,有害言论并未被限制在社区内部。我们的结果为回声室的有害影响以及对其进行管理以降低仇恨言论采纳的潜在益处提供了新的证据。

英文摘要:

While online social media offers a way for ignored or stifled voices to be heard, it also allows users a platform to spread hateful speech. Such speech usually originates in fringe communities, yet it can spill over into mainstream channels. In this paper, we measure the impact of joining fringe hateful communities in terms of hate speech propagated to the rest of the social network. We leverage data from Reddit to assess the effect of joining one type of echo chamber: a digital community of like-minded users exhibiting hateful behavior. We measure members' usage of hate speech outside the studied community before and after they become active participants. Using Interrupted Time Series (ITS) analysis as a causal inference method, we gauge the spillover effect, in which hateful language from within a certain community can spread outside that community by using the level of out-of-community hate word usage as a proxy for learned hate. We investigate four different Reddit sub-communities (subreddits) covering three areas of hate speech: racism, misogyny and fat-shaming. In all three cases we find an increase in hate speech outside the originating community, implying that joining such community leads to a spread of hate speech throughout the platform. Moreover, users are found to pick up this new hateful speech for months after initially joining the community. We show that the harmful speech does not remain contained within the community. Our results provide new evidence of the harmful effects of echo chambers and the potential benefit of moderating them to reduce adoption of hateful speech.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑