arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.05646cs.CV
收藏

神经网络中可扩展的后门检测

Scalable Backdoor Detection in Neural Networks

Applied Artificial Intelligence Institute, Deakin University(迪肯大学应用人工智能研究所);IIT Kharagpur(印度理工学院卡拉格布尔分校)

Haripriya Harikumar, Vuong Le, Santu Rana, Sourangshu Bhattacharya, Sunil Gupta, Svetha Venkatesh

摘要:

最近,有研究表明,深度学习模型容易受到特洛伊木马攻击,攻击者可以在训练期间安装后门,使生成的模型错误识别被小触发补丁污染的样本。目前的后门检测方法不能实现良好的检测性能,并且计算量大。在本文中,我们提出了一种新的触发器逆向工程为基础的方法,其计算复杂性不与标签的数量的规模,是基于一个措施,这是可解释的和通用的不同的网络和补丁类型。在实验中,我们观察到我们的方法在分离木马模型和纯模型方面取得了很好的成绩,这是对当前最先进方法的改进。

英文摘要:

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch. Current backdoor detection methods fail to achieve good detection performance and are computationally expensive. In this paper, we propose a novel trigger reverse-engineering based approach whose computational complexity does not scale with the number of labels, and is based on a measure that is both interpretable and universal across different network and patch types. In experiments, we observe that our method achieves a perfect score in separating Trojaned models from pure models, which is an improvement over the current state-of-the art method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑