arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.23536cs.LGcs.AI
收藏

关于不可学习数据的综述

A Survey on Unlearnable Data

Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Pengcheng Laboratory(鹏城实验室)

Jiahao Li, Yiqiang Chen, Yunbing Xing, Yang Gu, Xiangyuan Lan

AI总结:

综述不可学习数据(ULD)这一创新防御技术,全面回顾其生成方法、基准、指标、理论及应用等,比较不同方法优缺点与权衡,讨论挑战,强调未来研究方向,凸显其在机器学习数据保护中的潜力。

摘要:

不可学习数据(ULD)已成为一种创新的防御技术,用于防止机器学习模型从特定数据中学习有意义的模式,从而保护数据隐私和安全。通过对训练数据引入扰动,ULD会降低模型性能,使未经授权的模型难以提取有用表示。尽管ULD的重要性日益增加,但现有综述主要关注相关领域,如对抗攻击和模型遗忘,很少将ULD作为一个独立研究领域关注。本综述通过全面回顾ULD,研究不可学习数据生成方法、公共基准、评估指标、理论基础和实际应用。我们比较不同的ULD方法,分析其与不可学习性、不可感知性、效率和鲁棒性相关的优缺点及权衡。此外,我们讨论了关键挑战,如平衡扰动不可感知性与模型退化以及ULD生成的计算复杂性。最后,我们强调了有前景的未来研究方向,以提高ULD的有效性和适用性,突出其在机器学习数据保护不断发展的格局中成为关键工具的潜力。

英文摘要:

Unlearnable data (ULD) has emerged as an innovative defense technique to prevent machine learning models from learning meaningful patterns from specific data, thus protecting data privacy and security. By introducing perturbations to the training data, ULD degrades model performance, making it difficult for unauthorized models to extract useful representations. Despite the growing significance of ULD, existing surveys predominantly focus on related fields, such as adversarial attacks and machine unlearning, with little attention given to ULD as an independent area of study. This survey fills that gap by offering a comprehensive review of ULD, examining unlearnable data generation methods, public benchmarks, evaluation metrics, theoretical foundations and practical applications. We compare and contrast different ULD approaches, analyzing their strengths, limitations, and trade-offs related to unlearnability, imperceptibility, efficiency and robustness. Moreover, we discuss key challenges, such as balancing perturbation imperceptibility with model degradation and the computational complexity of ULD generation. Finally, we highlight promising future research directions to advance the effectiveness and applicability of ULD, underscoring its potential to become a crucial tool in the evolving landscape of data protection in machine learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑