SSL-Cleanse:自监督学习中的木马检测与缓解
SSL-Cleanse: Trojan Detection and Mitigation in Self-Supervised Learning
AI总结:
针对自监督学习编码器中的木马攻击,提出SSL-Cleanse方法,在未知下游任务和无标签数据下检测并缓解后门,在ImageNet-100上达到82.2%检测成功率,缓解后攻击成功率降至0.3%。
摘要:
自监督学习(SSL)是一种普遍用于编码数据表示的方法。使用预训练的SSL图像编码器并随后训练下游分类器,可以在标注数据极少的情况下在各种任务上取得令人印象深刻的表现。SSL的日益普及导致了对SSL编码器及相关木马攻击的安全研究增加。嵌入在SSL编码器中的木马攻击可以隐蔽地运作,并扩散到多个用户和设备。被植入木马的编码器中存在的后门行为可能被下游分类器无意继承,使得检测和缓解这一威胁变得更加困难。尽管目前监督学习中的木马检测方法可能保护SSL下游分类器,但在SSL编码器广泛传播之前识别和处理其中的触发器是一项具有挑战性的任务。这一挑战源于下游任务可能是未知的,数据集标签可能不可用,并且在SSL编码器的木马检测过程中可能无法访问原始的无标注训练数据集。我们提出了SSL-Cleanse作为识别和缓解SSL编码器中后门威胁的解决方案。我们使用1200个编码器在多个数据集上评估了SSL-Cleanse,在ImageNet-100上实现了82.2%的平均检测成功率。在缓解后门后,被植入后门的编码器平均达到0.3%的攻击成功率,且没有显著的准确率损失,证明了SSL-Cleanse的有效性。SSL-Cleanse的源代码可在https://github.com/UCF-ML-Research/SSL-Cleanse获取。
英文摘要:
Self-supervised learning (SSL) is a prevalent approach for encoding data representations. Using a pre-trained SSL image encoder and subsequently training a downstream classifier, impressive performance can be achieved on various tasks with very little labeled data. The growing adoption of SSL has led to an increase in security research on SSL encoders and associated Trojan attacks. Trojan attacks embedded in SSL encoders can operate covertly, spreading across multiple users and devices. The presence of backdoor behavior in Trojaned encoders can inadvertently be inherited by downstream classifiers, making it even more difficult to detect and mitigate the threat. Although current Trojan detection methods in supervised learning can potentially safeguard SSL downstream classifiers, identifying and addressing triggers in the SSL encoder before its widespread dissemination is a challenging task. This challenge arises because downstream tasks might be unknown, dataset labels may be unavailable, and the original unlabeled training dataset might be inaccessible during Trojan detection in SSL encoders. We introduce SSL-Cleanse as a solution to identify and mitigate backdoor threats in SSL encoders. We evaluated SSL-Cleanse on various datasets using 1200 encoders, achieving an average detection success rate of 82.2% on ImageNet-100. After mitigating backdoors, on average, backdoored encoders achieve 0.3% attack success rate without great accuracy loss, proving the effectiveness of SSL-Cleanse. The source code of SSL-Cleanse is available at https://github.com/UCF-ML-Research/SSL-Cleanse.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。