机器学习方法检测社交媒体欺骗性活动的系统综述:方法、挑战与偏见
A Systematic Review of Machine Learning Approaches for Detecting Deceptive Activities on Social Media: Methods, Challenges, and Biases
AI总结:
本综述评估36项机器学习研究,识别检测社交媒体虚假信息中的选择偏倚、类别不平衡等关键偏见,并提出改进预处理与评估指标以提升模型可靠性。
摘要:
Twitter、Facebook 和 Instagram 等社交媒体平台促进了错误信息的传播,因此有必要建立自动化检测系统。本系统综述评估了 36 项研究,这些研究应用机器学习(ML)和深度学习(DL)模型来检测社交媒体上的虚假新闻、垃圾邮件和虚假账户。通过使用预测模型偏倚风险评估工具(PROBAST),该综述识别了机器学习生命周期中的关键偏见:由于非代表性抽样导致的选择偏倚、对类别不平衡处理不足、语言预处理不充分(例如否定词),以及超参数调优不一致。尽管支持向量机(SVM)、随机森林和长短期记忆(LSTM)网络等模型显示出强大的潜力,但在不平衡数据设置中过度依赖准确率作为评估指标是一个常见缺陷。该综述强调需要改进数据预处理(例如重采样技术)、进行一致的超参数调优,并使用精确率、召回率、F1 分数和 AUROC 等合适的指标。解决这些局限性可以带来更可靠、更具泛化能力的机器学习/深度学习模型来检测欺骗性内容,最终有助于减少社交媒体上的错误信息。
英文摘要:
Social media platforms like Twitter, Facebook, and Instagram have facilitated the spread of misinformation, necessitating automated detection systems. This systematic review evaluates 36 studies that apply machine learning (ML) and deep learning (DL) models to detect fake news, spam, and fake accounts on social media. Using the Prediction model Risk Of Bias ASsessment Tool (PROBAST), the review identified key biases across the ML lifecycle: selection bias due to non-representative sampling, inadequate handling of class imbalance, insufficient linguistic preprocessing (e.g., negations), and inconsistent hyperparameter tuning. Although models such as Support Vector Machines (SVM), Random Forests, and Long Short-Term Memory (LSTM) networks showed strong potential, over-reliance on accuracy as an evaluation metric in imbalanced data settings was a common flaw. The review highlights the need for improved data preprocessing (e.g., resampling techniques), consistent hyperparameter tuning, and the use of appropriate metrics like precision, recall, F1 score, and AUROC. Addressing these limitations can lead to more reliable and generalizable ML/DL models for detecting deceptive content, ultimately contributing to the reduction of misinformation on social media.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。