arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.06069cs.SIcs.CRcs.GTcs.LG
收藏

基于Nash强化学习的垃圾邮件检测

Robust Spammer Detection by Nash Reinforcement Learning

Univ. of Illinois at Chicago(伊利诺伊大学芝加哥分校);Intel Labs(英特尔实验室);Lehigh University(理海大学)

Yingtong Dou, Guixiang Ma, Philip S. Yu, Sihong Xie

摘要:

在线评论为客户提供产品评估以做出决策。不幸的是,评估可以被专业垃圾邮件发送者使用虚假评论(“垃圾邮件”)操纵,他们通过适应部署的检测器来学习越来越阴险和强大的垃圾邮件策略。垃圾邮件发送策略很难捕捉,因为它们可以随着时间的推移而迅速变化,在垃圾邮件发送者和目标产品之间存在差异,更重要的是,在大多数情况下仍然未知。此外,大多数现有的检测器专注于检测精度,这与保持产品评估的可信度的目标并不一致。为了应对这些挑战,我们制定了一个极大极小的游戏,垃圾邮件发送者和垃圾邮件检测器相互竞争的实际目标,而不仅仅是基于检测的准确性。纳什均衡的游戏导致稳定的检测器是不可知的任何混合检测策略。然而,该博弈没有封闭形式的解决方案,是不可微的承认典型的基于梯度的算法。我们把游戏变成两个依赖马尔可夫决策过程(MDP),允许有效的随机优化的基础上,多臂强盗和策略梯度。我们使用各种最先进的垃圾邮件和检测策略在三个大型评论数据集上进行了实验,并表明优化算法可以可靠地找到一个平衡检测器,该检测器可以鲁棒地有效地防止垃圾邮件发送者使用任何混合垃圾邮件策略实现其实际目标。我们的代码可在https://github.com/YingtongDou/Nash-Detect上获得。

英文摘要:

Online reviews provide product evaluations for customers to make decisions. Unfortunately, the evaluations can be manipulated using fake reviews ("spams") by professional spammers, who have learned increasingly insidious and powerful spamming strategies by adapting to the deployed detectors. Spamming strategies are hard to capture, as they can be varying quickly along time, different across spammers and target products, and more critically, remained unknown in most cases. Furthermore, most existing detectors focus on detection accuracy, which is not well-aligned with the goal of maintaining the trustworthiness of product evaluations. To address the challenges, we formulate a minimax game where the spammers and spam detectors compete with each other on their practical goals that are not solely based on detection accuracy. Nash equilibria of the game lead to stable detectors that are agnostic to any mixed detection strategies. However, the game has no closed-form solution and is not differentiable to admit the typical gradient-based algorithms. We turn the game into two dependent Markov Decision Processes (MDPs) to allow efficient stochastic optimization based on multi-armed bandit and policy gradient. We experiment on three large review datasets using various state-of-the-art spamming and detection strategies and show that the optimization algorithm can reliably find an equilibrial detector that can robustly and effectively prevent spammers with any mixed spamming strategies from attaining their practical goal. Our code is available at https://github.com/YingtongDou/Nash-Detect.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑