用势能损失保护分割学习
Protecting Split Learning by Potential Energy Loss
AI总结:
针对分割学习前向嵌入的标签隐私泄露问题,提出势能损失方法,通过将同类嵌入推向决策边界增加其复杂度,有效抵御微调与聚类攻击。
摘要:
作为一种实用的隐私保护学习方法,分割学习在学术界和工业界引起了广泛关注。然而,由于在训练和推理过程中会共享中间结果,其安全性不断受到质疑。本文重点关注分割学习中前向嵌入的隐私泄露问题。具体而言,由于前向嵌入包含过多关于标签的信息,攻击者可以使用少量带标签样本微调顶层模型,或执行聚类等无监督攻击,从前向嵌入中推断出真实标签。为防止此类隐私泄露,我们提出势能损失,通过将同类别的嵌入推向决策边界,使前向嵌入变得更加“复杂”。因此,攻击者很难从前向嵌入中学习。实验结果表明,我们的方法显著降低了微调攻击和聚类攻击的性能。
英文摘要:
As a practical privacy-preserving learning method, split learning has drawn much attention in academia and industry. However, its security is constantly being questioned since the intermediate results are shared during training and inference. In this paper, we focus on the privacy leakage from the forward embeddings of split learning. Specifically, since the forward embeddings contain too much information about the label, the attacker can either use a few labeled samples to fine-tune the top model or perform unsupervised attacks such as clustering to infer the true labels from the forward embeddings. To prevent such kind of privacy leakage, we propose the potential energy loss to make the forward embeddings become more 'complicated', by pushing embeddings of the same class towards the decision boundary. Therefore, it is hard for the attacker to learn from the forward embeddings. Experiment results show that our method significantly lowers the performance of both fine-tuning attacks and clustering attacks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。