计算机视觉中基于深度网络权值矩阵分解的后门攻击检测
Backdoor Attack Detection in Computer Vision by Applying Matrix Factorization on the Weights of Deep Networks
摘要:
深度神经网络(DNN)和云服务在训练它们方面的重要性越来越大,这意味着不良行为者有更多的动机和机会插入后门来改变训练模型的行为。在本文中,我们介绍了一种新的后门检测方法,该方法使用独立向量分析(IVA)从预训练的DNN的权重中提取特征,然后使用机器学习分类器。与其他检测技术相比,这具有许多优点,例如不需要任何训练数据,可跨域应用,与广泛的网络架构一起操作,不假设用于改变网络行为的触发器的性质,以及高度可扩展。我们讨论了检测流水线,然后在两个计算机视觉数据集上展示了关于图像分类和目标检测的结果。我们的方法在效率方面优于竞争算法,并且更准确,有助于确保深度学习和AI的安全应用。
英文摘要:
The increasing importance of both deep neural networks (DNNs) and cloud services for training them means that bad actors have more incentive and opportunity to insert backdoors to alter the behavior of trained models. In this paper, we introduce a novel method for backdoor detection that extracts features from pre-trained DNN's weights using independent vector analysis (IVA) followed by a machine learning classifier. In comparison to other detection techniques, this has a number of benefits, such as not requiring any training data, being applicable across domains, operating with a wide range of network architectures, not assuming the nature of the triggers used to change network behavior, and being highly scalable. We discuss the detection pipeline, and then demonstrate the results on two computer vision datasets regarding image classification and object detection. Our method outperforms the competing algorithms in terms of efficiency and is more accurate, helping to ensure the safe application of deep learning and AI.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。