arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1702.01032cs.IRcs.CRcs.SI
收藏

Twitter流中的半监督式垃圾邮件检测

Semi-Supervised Spam Detection in Twitter Stream

Surendra Sedhai, Aixin Sun

摘要:

Twitter上大多数现有的垃圾邮件检测技术旨在识别和阻止发布垃圾推文的用户。在本文中,我们提出了一个半监督式垃圾邮件检测(S3 D)的垃圾邮件检测框架,在推文级。该框架由两个主要模块组成:垃圾邮件检测模块运行在实时模式下,模型更新模块运行在批处理模式下。垃圾邮件检测模块由四个轻量级检测器组成:(i)黑名单域检测器,用于标记包含黑名单URL的推文;(ii)近似重复检测器,用于标记与预先标记的推文近似重复的推文;(iii)可靠的火腿检测器,用于标记由可信用户发布的不包含垃圾邮件的推文;以及(iv)基于多分类器的检测器标记剩余的推文。检测模块所需的信息基于在前一时间窗口中标记的推文以批处理模式更新。大规模数据集上的实验表明,该框架自适应地学习新的垃圾邮件活动的模式,并保持良好的准确性,垃圾邮件检测推文流。

英文摘要:

Most existing techniques for spam detection on Twitter aim to identify and block users who post spam tweets. In this paper, we propose a Semi-Supervised Spam Detection (S3D) framework for spam detection at tweet-level. The proposed framework consists of two main modules: spam detection module operating in real-time mode, and model update module operating in batch mode. The spam detection module consists of four light-weight detectors: (i) blacklisted domain detector to label tweets containing blacklisted URLs, (ii) near-duplicate detector to label tweets that are near-duplicates of confidently pre-labeled tweets, (iii) reliable ham detector to label tweets that are posted by trusted users and that do not contain spammy words, and (iv) multi-classifier based detector labels the remaining tweets. The information required by the detection module are updated in batch mode based on the tweets that are labeled in the previous time window. Experiments on a large scale dataset show that the framework adaptively learns patterns of new spam activities and maintain good accuracy for spam detection in a tweet stream.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑