arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.04852cs.SI
收藏

纠正还是反效果:用户对社交纠正的反应的特征刻画与预测

Corrective or Backfire: Characterizing and Predicting User Response to Social Correction

Bing He, Yingchen Ma, Mustaque Ahamad, Srijan Kumar

AI总结:

本研究针对社交纠正的用户反应尚不明确的问题,基于X平台构建55549组三元组数据集,刻画反应特征并构建预测模型,F1值达0.816,助力优化社交纠正策略以最大化纠正效果、最小化反效果。

摘要:

在线错误信息构成了一项全球性风险,会对社会造成有害影响。已知普通社交媒体用户会主动用反错误信息内容回复错误信息帖子,这种做法已被证明能有效遏制错误信息的传播,该行为被定义为“社交纠正(social correction)”。然而,目前尚不清楚在真实场景中用户对社交纠正会作何反应,尤其是它会对用户产生纠正效果还是反效果。探究这一研究问题对于制定和优化能最大化社交纠正举措成效的策略至关重要。为填补这一空白,我们以X(原Twitter)为研究载体,采用数据驱动的方式开展了深入研究,对用户针对社交纠正的反应进行特征刻画与预测,其中用户反应被具体化为用户针对反错误信息内容撰写的回复。具体而言,我们首先构建了一个包含55549组三元组的新型数据集,三元组由错误信息推文、反错误信息回复以及对反错误信息回复的回应构成,随后梳理出一套分类体系来阐释不同类型的用户反应。接着,我们对回复的语言特征、参与度特征以及回复者的用户属性进行了细粒度的统计分析,以明确在决定一条回复会产生纠正效果还是反效果方面具有显著作用的特征。最后,我们构建了一个用户反应预测模型,用于识别社交纠正会产生纠正效果、中性效果还是反效果,该模型取得了0.816的优异F1值。我们的工作能让相关利益方有效监测和预测用户反应,从而指导社交纠正的使用,最大化其纠正影响并最小化反效果。相关代码和数据可在https://github.com/claws-lab/response-to-social-correction获取。

英文摘要:

Online misinformation poses a global risk with harmful implications for society. Ordinary social media users are known to actively reply to misinformation posts with counter-misinformation messages, which is shown to be effective in containing the spread of misinformation. Such a practice is defined as "social correction". Nevertheless, it remains unknown how users respond to social correction in real-world scenarios, especially, will it have a corrective or backfire effect on users. Investigating this research question is pivotal for developing and refining strategies that maximize the efficacy of social correction initiatives. To fill this gap, we conduct an in-depth study to characterize and predict the user response to social correction in a data-driven manner through the lens of X (Formerly Twitter), where the user response is instantiated as the reply that is written toward a counter-misinformation message. Particularly, we first create a novel dataset with 55, 549 triples of misinformation tweets, counter-misinformation replies, and responses to counter-misinformation replies, and then curate a taxonomy to illustrate different kinds of user responses. Next, fine-grained statistical analysis of reply linguistic and engagement features as well as repliers' user attributes is conducted to illustrate the characteristics that are significant in determining whether a reply will have a corrective or backfire effect. Finally, we build a user response prediction model to identify whether a social correction will be corrective, neutral, or have a backfire effect, which achieves a promising F1 score of 0.816. Our work enables stakeholders to monitor and predict user responses effectively, thus guiding the use of social correction to maximize their corrective impact and minimize backfire effects. The code and data is accessible on https://github.com/claws-lab/response-to-social-correction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑