arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.13293cs.LGcs.CRstat.ML
收藏

通过可转移对手增强深度学习网络的弹性

Enhancing Resilience of Deep Learning Networks by Means of Transferable Adversaries

University of Münster(明斯特大学)

Moritz Seiler, Heike Trautmann, Pascal Kerschke

摘要:

一般的人工神经网络,特别是深度学习网络,将自己确立为流行且强大的机器学习算法。虽然这些网络的巨大规模在解决复杂任务时是有益的,但大量的参数也导致这些网络容易受到恶意行为的影响,例如对抗性扰动。这些扰动可以改变模型的分类决策。此外,虽然单步攻击者可以很容易地从一个网络转移到另一个网络,但更强大的多步攻击者的转移通常相当困难。在这项工作中,我们介绍了一种方法,用于生成强大的对手,可以很容易地(和经常)在不同的模型之间转移。然后,这种方法被用来生成一个大的对手,在此基础上,选定的防御方法的效果进行实验评估。最后,我们介绍了一种新的,简单的,但有效的方法来提高神经网络对对手的弹性和基准测试它对既定的防御方法。与现有的方法相比,我们提出的防御方法更有效,因为它只需要一个额外的前向传递,以实现可比的性能结果。

英文摘要:

Artificial neural networks in general and deep learning networks in particular established themselves as popular and powerful machine learning algorithms. While the often tremendous sizes of these networks are beneficial when solving complex tasks, the tremendous number of parameters also causes such networks to be vulnerable to malicious behavior such as adversarial perturbations. These perturbations can change a model's classification decision. Moreover, while single-step adversaries can easily be transferred from network to network, the transfer of more powerful multi-step adversaries has - usually -- been rather difficult. In this work, we introduce a method for generating strong ad-versaries that can easily (and frequently) be transferred between different models. This method is then used to generate a large set of adversaries, based on which the effects of selected defense methods are experimentally assessed. At last, we introduce a novel, simple, yet effective approach to enhance the resilience of neural networks against adversaries and benchmark it against established defense methods. In contrast to the already existing methods, our proposed defense approach is much more efficient as it only requires a single additional forward-pass to achieve comparable performance results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑