arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.06187cs.LG
收藏

$f$-FUM: 通过min-max和$f$-散度实现联邦去学习

$f$-FUM: Federated Unlearning via min--max and $f$-divergence

Department of Statistics, Universite de Geneve, Geneva, Switzerland(日内瓦大学统计系);University of Cambridge, Cambridge, United Kingdom(剑桥大学);The Alan Turing Institute, London, UK(艾伦·图灵研究所)

Radmehr Karimian, Amirhossein Bagheri, Meghdad Kurmanji, Nicholas D. Lane, Gholamali Aminian

AI总结:

本文提出$f$-FUM框架,通过min-max和$f$-散度实现联邦去学习,有效减少数据移除对模型的影响,提升效率。

摘要:

联邦学习(FL)已作为一种强大的范式,用于在去中心化数据源上进行协作机器学习,通过保持数据本地化来保护隐私。然而,日益增长的法律和伦理需求,如'被遗忘的权利',以及减轻数据污染攻击的需要,突显了在FL中系统性地进行数据去学习的紧迫性。与集中式设置不同,FL的分布式特性使去除个体数据贡献变得更加复杂。在本文中,我们提出了一种新的联邦去学习框架,其形式化为一个min-max优化问题,目标是最大化在所有数据上训练的模型与在特定数据点上重新训练的模型之间的$f$-散度,同时最小化对保留数据的影响。我们的框架可以像插件一样添加到几乎任何联邦设置中,不同于最先进的方法如(\cite{10269017}需要在服务器上减少模型退化,或\cite{khalil2025notfederatedunlearningweight}需要涉及模型架构和模型权重)。这种形式化允许在联邦设置中高效地近似数据移除效果。我们提供实证评估,表明我们的方法在重新训练方面实现了显著的速度提升,对效用影响最小。

英文摘要:

Federated learning (FL) enables collaborative training while keeping raw data on clients. Deletion requests and the discovery of poisoned data create a need to remove selected contributions from an already trained model. This is challenging in FL because client data are decentralized and their influence is entangled through repeated aggregation. We present f-FUM, an active federated unlearning method that builds on teacher-student forget/retain optimization. Starting from a pretrained global model, the method keeps that model fixed as a teacher. Clients maximize an $f$-divergence between student and teacher predictive distributions on forget examples, then minimize KL-based teacher-student disagreement and supervised loss on retained examples. The updates are aggregated in separate, sample-weighted synchronization phases without moving raw data to the server or changing the model architecture. We evaluate forget-side divergence choices in client-level and data-level deletion settings involving backdoors, label confusion, and clean-data deletion. Under equal synchronization-phase budgets, divergence choice changes the forgetting-utility trade-off, yielding improvements in some settings and mixed results in others. In the evaluated configurations, f-FUM uses up to 8 times fewer synchronization phases than full federated retraining.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑