arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.14747cs.CVcs.AI
收藏

面向机器遗忘的分布级特征距离化:迈向模型效用与遗忘之间更优的权衡

Distribution-Level Feature Distancing for Machine Unlearning: Towards a Better Trade-off Between Model Utility and Forgetting

Yonsei University(延世大学);MODULABS;POSTECH(浦项科技大学)

Dasol Choi, Dongbin Na

AI总结:

针对机器遗忘中因相关性坍塌导致的模型效用下降问题,提出DLFD方法,通过优化特征分布合成数据,在单周期内高效遗忘实例并保留特征相关性,显著提升了遗忘性能与模型效用。

摘要:

随着深度学习应用的爆炸性增长和隐私问题的日益凸显,被遗忘权已成为各类AI行业的关键需求。例如,在人脸识别系统中,部分用户可能希望删除在训练阶段被使用的个人数据。然而,深度神经网络有时会意外泄露个人身份,使得这种删除极具挑战性。尽管近期的机器遗忘算法旨在让模型遗忘特定数据,但我们发现了一种意外的效用下降现象——相关性坍塌,即在遗忘过程中,图像特征与真实标签之间的关键相关性被削弱。为应对此挑战,我们提出了分布级特征距离化(DLFD),这是一种在保留任务相关特征相关性的同时高效遗忘实例的新方法。该方法通过优化特征分布使其明显区别于遗忘样本的特征分布来合成数据样本,在单个训练周期内即可取得显著效果。通过在人脸识别数据集上的大量实验,我们证明该方法在遗忘性能和模型效用保持方面均显著优于当前最先进的机器遗忘方法。

英文摘要:

With the explosive growth of deep learning applications and increasing privacy concerns, the right to be forgotten has become a critical requirement in various AI industries. For example, given a facial recognition system, some individuals may wish to remove their personal data that might have been used in the training phase. Unfortunately, deep neural networks sometimes unexpectedly leak personal identities, making this removal challenging. While recent machine unlearning algorithms aim to enable models to forget specific data, we identify an unintended utility drop-correlation collapse-in which the essential correlations between image features and true labels weaken during the forgetting process. To address this challenge, we propose Distribution-Level Feature Distancing (DLFD), a novel method that efficiently forgets instances while preserving task-relevant feature correlations. Our method synthesizes data samples by optimizing the feature distribution to be distinctly different from that of forget samples, achieving effective results within a single training epoch. Through extensive experiments on facial recognition datasets, we demonstrate that our approach significantly outperforms state-of-the-art machine unlearning methods in both forgetting performance and model utility preservation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑