While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data. Specifically, we introduce a variety of different techniques to assess whether a language model has seen a tabular dataset during training. This investigation reveals that LLMs have memorized many popular tabular datasets verbatim. We then compare the few-shot learning performance of LLMs on datasets that were seen during training to the performance on datasets released after training. We find that LLMs perform better on datasets seen during training, indicating that memorization leads to overfitting. At the same time, LLMs show non-trivial performance on novel datasets and are surprisingly robust to data transformations. We then investigate the in-context statistical learning abilities of LLMs. While LLMs are significantly better than random at solving statistical classification problems, the sample efficiency of few-shot learning lags behind traditional statistical learning algorithms, especially as the dimension of the problem increases. This suggests that much of the observed few-shot performance on novel real-world datasets is due to the LLM's world knowledge. Overall, our results highlight the importance of testing whether an LLM has seen an evaluation dataset during pre-training. We release the https://github.com/interpretml/LLM-Tabular-Memorization-Checker Python package to test LLMs for memorization of tabular datasets.
Don't Forget! Decomposing the Training Dynamics of Memorization in Language Models
LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Mila – Quebec AI Institute(魁北克人工智能研究所);University of Montreal(蒙特利尔大学);Saarland University(萨尔大学)
Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models
Harbin Institute of Technology(哈尔滨工业大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Unlimidata Ltd(Unlimidata有限公司);The Chinese University of Hong Kong(香港中文大学);University of Calabria(卡拉布里亚大学)
From Anchors to Supervision: Memory-Graph Guided Corpus-Free Unlearning for Large Language Models
College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院);Shanghai University of Electric Power(上海电力大学);School of Information Science and Engineering, East China University of Science and Technology(东华大学信息科学与工程学院)
SIGUA: Forgetting May Make Learning with Noisy Labels More Robust
Hong Kong Baptist University(香港浸会大学);RIKEN(理化学研究所);AAII, University of Technology Sydney(悉尼科技大学人工智能研究所);Paradigm Inc. (Hong Kong)(第四范式(香港));University of Queensland(昆士兰大学);The University of Tokyo(东京大学)
Is Gradient Ascent Really Necessary? Memorize to Forget for Machine Unlearning
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);Hong Kong Baptist University(香港 Baptist 大学);RIKEN AIP(日本理化学研究所AIP);University of Technology Sydney(悉尼技术大学)
Preserving Diversity in Supervised Fine-Tuning of Large Language Models
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Research Institute of Big Data(深圳大数据研究院);Nanjing University(南京大学);Hong Kong University of Science and Technology(香港科技大学);University of Pennsylvania(宾夕法尼亚大学)
Hierarchical Dual-Strategy Unlearning for Biomedical and Healthcare Intelligence Using Imperfect and Privacy-Sensitive Medical Data
Department of Neurosurgery, Qilu Hospital of Shandong University and Institute of Brain and Brain-Inspired Science(齐鲁医院山东大学神经外科和脑科学与脑启发科学研究院);Department of Neurosurgery, The Affiliated Hospital of Qingdao University(青岛大学附属医院神经外科);Department of Neurosurgery, Peking Union Medical College Hospital(北京地坛医院神经外科);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);College of Artificial Intelligence, Dalian Maritime University(大连海事大学人工智能学院);University of Colorado Boulder(科罗拉多大学波尔德分校);Zhengzhou University(郑州大学);The University of Hong Kong(香港大学);Georgia Institute of Technology(佐治亚理工学院)
University of Maryland, College Park(马里兰大学帕克分校);Google Research(谷歌研究院)
大型Transformer模型在许多自然语言任务中取得了令人印象深刻的性能。特别地,基于Transformer的语言模型已经被证明在以其大量参数对事实知识进行编码方面具有很强的能力。虽然提高Transformers的记忆和概括能力的任务已经得到了广泛的研究,但如何使transformers忘记特定的旧事实并记住新事实还不太清楚。在本文中,我们提出了一个新的任务\emph{explicitly modifying specific factual knowledge in Transformer models while ensuring the model performance does not degrade on the unmodified facts}。此任务在许多情况下都很有用,例如更新陈旧的知识,保护隐私,以及消除存储在模型中的意外偏见。我们对几种方法进行了基准测试,这些方法在这项任务上提供了自然的基线性能。这导致了Transformer模型的关键组件的发现,这些组件对于知识修改特别有效。这项工作还提供了不同的训练阶段(如预训练和微调)对记忆和知识修改的作用的见解。
ToFU: Transforming How Federated Learning Systems Forget User Data
School of Computer Science(计算机科学学院);Statistics, Trinity College Dublin, Ireland(统计学,都柏林信任学院,爱尔兰);School of Computer Science, University College Dublin, Ireland(计算机科学学院,都柏林大学学院,爱尔兰)
Inference-Time Machine Unlearning via Gated Activation Redirection
MALTA, Machine Learning Theory and Applications Lab, PUCRS, Porto Alegre, Brazil(MALTA机器学习理论与应用实验室,PUCRS,波士顿-阿尔格雷,巴西);Harvard University(哈佛大学);Kunumi Institute, Brazil(库努米研究所,巴西)