arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.06131cs.CRcs.LG
收藏

测试时对机器学习的规避攻击

Evasion Attacks against Machine Learning at Test Time

University of Cagliari(卡利亚里大学);Universität Potsdam(波茨坦大学);University of Tübingen(蒂宾根大学)

Battista Biggio, Igino Corona, Davide Maiorca, Blaine Nelson, Nedim Srndic, Pavel Laskov, Giorgio Giacinto, Fabio Roli

摘要:

在对安全敏感的应用程序中,机器学习的成功取决于彻底审查它们对对抗性数据的抵抗力。在一个相关的,动机良好的攻击场景中,对手可能会试图通过仔细操纵攻击样本来逃避测试时部署的系统。在这项工作中,我们提出了一个简单但有效的基于梯度的方法,可以利用系统地评估几个,广泛使用的分类算法对规避攻击的安全性。根据最近提出的安全评估框架,我们模拟攻击的情况下,表现出不同的风险等级的分类器,通过增加攻击者的知识系统和她的能力来操纵攻击样本。这为分类器设计者提供了在逃避攻击下分类器性能的更好的画面,并允许他执行更明智的模型选择(或参数设置)。我们评估我们的方法在PDF文件中的恶意软件检测的相关安全任务,并表明,这样的系统可以很容易地逃避。并根据分析结果提出了相应的对策建议。

英文摘要:

In security-sensitive applications, the success of machine learning depends on a thorough vetting of their resistance to adversarial data. In one pertinent, well-motivated attack scenario, an adversary may attempt to evade a deployed system at test time by carefully manipulating attack samples. In this work, we present a simple but effective gradient-based approach that can be exploited to systematically assess the security of several, widely-used classification algorithms against evasion attacks. Following a recently proposed framework for security evaluation, we simulate attack scenarios that exhibit different risk levels for the classifier by increasing the attacker's knowledge of the system and her ability to manipulate attack samples. This gives the classifier designer a better picture of the classifier performance under evasion attacks, and allows him to perform a more informed model selection (or parameter setting). We evaluate our approach on the relevant security task of malware detection in PDF files, and show that such systems can be easily evaded. We also sketch some countermeasures suggested by our analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑