arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.01048cs.CLcs.LGstat.ML
收藏

MALCOM:生成恶意评论以攻击神经假新闻检测模型

MALCOM: Generating Malicious Comments to Attack Neural Fake News Detection Models

The Pennsylvania State University(宾夕法尼亚州立大学)

Thai Le, Suhang Wang, Dongwon Lee

摘要:

近年来,所谓的“假新闻”泛滥,对社会造成了很大的干扰,削弱了新闻生态系统。因此,为了缓解这些问题,研究人员开发了最先进的模型,使用复杂的数据科学和机器学习技术自动检测社交媒体上的假新闻。在这项工作中,那么,我们问“如果对手试图攻击这样的检测模型?“并通过以下方式调查相关问题:(i)提出一种针对假新闻检测器的新型威胁模型,其中对手可以对新闻文章发布恶意评论以误导假新闻检测器,以及(ii)开发MALCOM,一种端到端的对抗性评论生成框架以实现这种攻击。通过综合评估,我们证明了平均约94%和93.5%的时间MALCOM可以成功地误导五个最新的神经检测模型,以始终输出有针对性的真实和虚假新闻标签。此外,MALCOM还可以欺骗黑盒假新闻检测器,平均90%的时间总是输出真实的新闻标签。我们还将我们的攻击模型与两个真实世界数据集的四个基线进行了比较,不仅在攻击性能上,而且在生成的质量,一致性,可转移性和鲁棒性上。

英文摘要:

In recent years, the proliferation of so-called "fake news" has caused much disruptions in society and weakened the news ecosystem. Therefore, to mitigate such problems, researchers have developed state-of-the-art models to auto-detect fake news on social media using sophisticated data science and machine learning techniques. In this work, then, we ask "what if adversaries attempt to attack such detection models?" and investigate related issues by (i) proposing a novel threat model against fake news detectors, in which adversaries can post malicious comments toward news articles to mislead fake news detectors, and (ii) developing MALCOM, an end-to-end adversarial comment generation framework to achieve such an attack. Through a comprehensive evaluation, we demonstrate that about 94% and 93.5% of the time on average MALCOM can successfully mislead five of the latest neural detection models to always output targeted real and fake news labels. Furthermore, MALCOM can also fool black box fake news detectors to always output real news labels 90% of the time on average. We also compare our attack model with four baselines across two real-world datasets, not only on attack performance but also on generated quality, coherency, transferability, and robustness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑