arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.20516cs.LGcs.AIcs.CL
收藏

生成式AI中的机器遗忘:一项综述

Machine Unlearning in Generative AI: A Survey

University of Notre Dame(圣母大学);University of Pennsylvania(宾夕法尼亚大学)

Zheyuan Liu, Guangyao Dou, Zhaoxuan Tan, Yijun Tian, Meng Jiang

AI总结:

本文全面综述了生成式AI中的机器遗忘(MU)技术,涵盖问题表述、评估方法及各类技术的优劣,以解决模型记忆并生成敏感、偏见或危险信息的问题,并提出了未来研究的挑战与方向。

摘要:

生成式AI技术已被广泛部署,例如(多模态)大语言模型和视觉生成模型。其卓越的性能应归功于海量训练数据和涌现的推理能力。然而,模型会记忆并生成源自训练数据(尤其是网络爬取数据)的敏感、有偏见或危险信息。新的机器遗忘(MU)技术正被开发,以减少或消除模型中不良知识及其影响,因为为传统分类任务设计的遗忘技术无法应用于生成式AI。我们针对生成式AI中的MU提供了全面综述,包括新的问题表述、评估方法,以及对不同类型MU技术的优势与局限性的结构化讨论。本文还提出了MU研究中的若干关键挑战与有前景的方向。精选阅读列表可见:https://github.com/franciscoliu/GenAI-MU-Reading。

英文摘要:

Generative AI technologies have been deployed in many places, such as (multimodal) large language models and vision generative models. Their remarkable performance should be attributed to massive training data and emergent reasoning abilities. However, the models would memorize and generate sensitive, biased, or dangerous information originated from the training data especially those from web crawl. New machine unlearning (MU) techniques are being developed to reduce or eliminate undesirable knowledge and its effects from the models, because those that were designed for traditional classification tasks could not be applied for Generative AI. We offer a comprehensive survey on many things about MU in Generative AI, such as a new problem formulation, evaluation methods, and a structured discussion on the advantages and limitations of different kinds of MU techniques. It also presents several critical challenges and promising directions in MU research. A curated list of readings can be found: https://github.com/franciscoliu/GenAI-MU-Reading.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑