arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.10052cs.CV
收藏

增强神经微调用于高效后门净化

Augmented Neural Fine-Tuning for Efficient Backdoor Purification

University of Central Florida(中佛罗里达大学);North Carolina State University(北卡罗来纳州立大学)

Nazmul Karim, Abdullah Al Arafat, Umar Khalid, Zhishan Guo, Nazanin Rahnavard

AI总结:

本文提出神经掩码微调(NFT)方法,利用简单数据增强和掩码正则化,高效移除后门攻击影响,在有限样本下表现优异,广泛验证于多种任务和数据集。

摘要:

最近的研究揭示了深度神经网络(DNNs)对各种后门攻击的脆弱性,其中DNNs的行为可以通过利用某些类型的触发器或投毒机制而受到损害。最先进的(SOTA)防御方法采用了过于复杂的机制,这些机制要么需要计算成本高昂的对抗性搜索模块来逆向工程触发器分布,要么需要过度敏感的超参数选择模块。此外,它们在具有挑战性的场景中表现不佳,例如有限的验证数据和强攻击。在本文中,我们提出了神经掩码微调(NFT),旨在以最优方式重新组织神经元活动,从而消除后门的影响。利用像MixUp这样的简单数据增强,NFT放宽了触发器合成过程,并消除了对抗性搜索模块的需求。我们的研究进一步揭示,在有限的验证数据下直接进行权重微调会导致净化后的干净测试准确率较差,这主要是由于过拟合问题。为了克服这一点,我们提出微调神经掩码而不是模型权重。此外,设计了一个掩码正则化器以进一步减轻净化过程中的模型漂移。NFT的独特特性使其在运行时和样本使用方面都非常高效,因为即使每个类别只有一个样本可用,它也能移除后门。我们通过涵盖图像分类、目标检测、视频动作识别、3D点云和自然语言处理任务的广泛实验验证了NFT的有效性。我们在11个基准数据集(如ImageNet、UCF101、Pascal VOC、ModelNet、OpenSubtitles2012等)上评估了我们的方法,针对14种不同的攻击(LIRA、WaNet等)。

英文摘要:

Recent studies have revealed the vulnerability of deep neural networks (DNNs) to various backdoor attacks, where the behavior of DNNs can be compromised by utilizing certain types of triggers or poisoning mechanisms. State-of-the-art (SOTA) defenses employ too-sophisticated mechanisms that require either a computationally expensive adversarial search module for reverse-engineering the trigger distribution or an over-sensitive hyper-parameter selection module. Moreover, they offer sub-par performance in challenging scenarios, e.g., limited validation data and strong attacks. In this paper, we propose Neural mask Fine-Tuning (NFT) with an aim to optimally re-organize the neuron activities in a way that the effect of the backdoor is removed. Utilizing a simple data augmentation like MixUp, NFT relaxes the trigger synthesis process and eliminates the requirement of the adversarial search module. Our study further reveals that direct weight fine-tuning under limited validation data results in poor post-purification clean test accuracy, primarily due to overfitting issue. To overcome this, we propose to fine-tune neural masks instead of model weights. In addition, a mask regularizer has been devised to further mitigate the model drift during the purification process. The distinct characteristics of NFT render it highly efficient in both runtime and sample usage, as it can remove the backdoor even when a single sample is available from each class. We validate the effectiveness of NFT through extensive experiments covering the tasks of image classification, object detection, video action recognition, 3D point cloud, and natural language processing. We evaluate our method against 14 different attacks (LIRA, WaNet, etc.) on 11 benchmark data sets such as ImageNet, UCF101, Pascal VOC, ModelNet, OpenSubtitles2012, etc.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑