超越试错:预测干预后用户放弃
Beyond Trial-and-Error: Predicting User Abandonment After a Moderation Intervention
AI总结:
本文提出预测用户在内容管理干预后放弃平台的方法,通过训练二元分类器识别高风险用户,实现从反应性到预测性的管理转变。
摘要:
当前的内容管理采用一种反应性、试错的方法,即在实施干预后才测量其效果。相比之下,我们引入了一种主动、预测性的方法,使管理员能够在实施之前预估其影响。我们提出了并解决了预测用户在干预后放弃平台的新任务。我们研究了16,540名用户对Reddit上大规模社区禁令的反应,训练了一组二元分类器来识别在干预后会放弃平台的用户——这是一个具有实际重要性的课题。我们利用1.38亿条帖子的数据集,计算了142个特征集,这些特征传达了有关用户活动、毒性、关系和写作风格的信息。我们获得了有希望的结果,最佳模型的微F1分数为0.914。我们的模型在应用于之前未见过的社区时表现出稳健的泛化能力。此外,我们发现活动特征是最重要的预测因子,其次是关系和毒性特征,而写作风格特征的效用有限。理论上,我们的结果证明了采用预测机器学习方法来估计管理干预效果的可行性。实际上,这项工作标志着从反应性到预测性管理的根本转变,使平台管理员能够利用智能工具来战略性地规划干预,减少意外后果,并优化用户参与度。
英文摘要:
Current content moderation follows a reactive, trial-and-error approach, where interventions are applied and their effects are only measured post-hoc. In contrast, we introduce a proactive, predictive approach that enables moderators to anticipate the impact of their actions before implementation. We propose and tackle the new task of predicting user abandonment following a moderation intervention. We study the reactions of 16,540 users to a massive ban of online communities on Reddit, training a set of binary classifiers to identify those users who would abandon the platform after the intervention -- a problem of great practical relevance. We leverage a dataset of 13.8 million posts to compute a large and diverse set of 142 features, which convey information about the activity, toxicity, relations, and writing style of the users. We obtain promising results, with the best-performing model achieving micro F1-score = 0.914. Our model shows robust generalizability when applied to users from previously unseen communities. Furthermore, we identify activity features as the most informative predictors, followed by relational and toxicity features, while writing style features exhibit limited utility. Theoretically, our results demonstrate the feasibility of adopting a predictive machine learning approach to estimate the effects of moderation interventions. Practically, this work marks a fundamental shift from reactive to predictive moderation, equipping platform administrators with intelligent tools to strategically plan interventions, minimize unintended consequences, and optimize user engagement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。