arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.13466cs.SIcs.CR
收藏

网络分析在虚假信息活动检测中的应用

On the Detection of Disinformation Campaign Activity with Network Analysis

Luis Vargas, Patrick Emami, Patrick Traynor

摘要:

近年来,随着国家支持的虚假信息运动试图通过大规模的协调努力来影响和掩盖政治话题,在线操纵信息变得更加普遍。在这个过程中,这些努力留下了人工制品,研究人员利用这些人工制品来分析虚假信息活动在被删除后所采用的策略。协调网络分析已被证明有助于了解虚假信息活动是如何运作的;然而,这些法医工具作为检测机制的有用性仍然是一个悬而未决的问题。在本文中,我们将探讨使用协调网络分析来生成用于区分虚假信息活动与合法Twitter活动的功能。这样做将为人类分析师提供更多的证据,因为他们考虑拆除。我们为Twitter虚假信息活动和合法Twitter社区创建了一个时间序列的日常协调网络,并根据从这些网络中提取的统计特征训练二元分类器。我们的研究结果表明,该分类器可以预测未来的协调活动的已知虚假信息运动具有较高的准确性(F1 = 0.98)。在更具挑战性的分布外活动分类任务上,性能下降但仍然有希望(F1 = 0.71),主要是由于误报率的增加。通过这样的分析,我们表明,虽然协调模式可能有助于提供虚假信息活动的证据,但在大规模部署之前,需要进一步调查以改进这种方法。

英文摘要:

Online manipulation of information has become more prevalent in recent years as state-sponsored disinformation campaigns seek to influence and polarize political topics through massive coordinated efforts. In the process, these efforts leave behind artifacts, which researchers have leveraged to analyze the tactics employed by disinformation campaigns after they are taken down. Coordination network analysis has proven helpful for learning about how disinformation campaigns operate; however, the usefulness of these forensic tools as a detection mechanism is still an open question. In this paper, we explore the use of coordination network analysis to generate features for distinguishing the activity of a disinformation campaign from legitimate Twitter activity. Doing so would provide more evidence to human analysts as they consider takedowns. We create a time series of daily coordination networks for both Twitter disinformation campaigns and legitimate Twitter communities, and train a binary classifier based on statistical features extracted from these networks. Our results show that the classifier can predict future coordinated activity of known disinformation campaigns with high accuracy (F1 = 0.98). On the more challenging task of out-of-distribution activity classification, the performance drops yet is still promising (F1 = 0.71), mainly due to an increase in the false positive rate. By doing this analysis, we show that while coordination patterns could be useful for providing evidence of disinformation activity, further investigation is needed to improve upon this method before deployment at scale.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑