arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.02879cs.CL
收藏

立场:LLM 遗忘基准是衡量进展的薄弱指标

Position: LLM Unlearning Benchmarks are Weak Measures of Progress

Carnegie Mellon University(卡内基梅隆大学)

Pratiksha Thaker, Shengyuan Hu, Neil Kale, Yash Maurya, Zhiwei Steven Wu, Virginia Smith

AI总结:

本文指出当前 LLM 遗忘基准过于乐观且易被简单修改破坏,遗忘目标不明确还会导致方法过拟合测试查询,并据此提出未来研究建议。

摘要:

遗忘方法有潜力通过事后移除敏感或有害信息来改善大语言模型(LLMs)的隐私与安全性。LLM 遗忘研究社区越来越多地借助经验基准来评估此类方法的有效性。在本文中,我们发现现有基准对候选遗忘方法的有效性提供了过于乐观且可能具有误导性的看法。通过对多个流行基准引入简单、良性的修改,我们揭示了若干实例:在这些实例中,据称已被遗忘的信息仍然可以被访问,或者遗忘过程对保留信息的模型性能造成的退化程度远高于原始基准所显示的水平。我们识别出现有基准尤其容易受到那些在遗忘信息与保留信息之间引入哪怕宽松依赖关系的修改的影响。此外,我们表明,现有基准中遗忘目标的不明确性很容易导致所设计的方法对给定的测试查询过拟合。基于我们的发现,我们敦促社区在将基准结果解释为可靠的进展衡量标准时保持谨慎,并提供若干建议以指导未来的 LLM 遗忘研究。

英文摘要:

Unlearning methods have the potential to improve the privacy and safety of large language models (LLMs) by removing sensitive or harmful information post hoc. The LLM unlearning research community has increasingly turned toward empirical benchmarks to assess the effectiveness of such methods. In this paper, we find that existing benchmarks provide an overly optimistic and potentially misleading view on the effectiveness of candidate unlearning methods. By introducing simple, benign modifications to a number of popular benchmarks, we expose instances where supposedly unlearned information remains accessible, or where the unlearning process has degraded the model's performance on retained information to a much greater extent than indicated by the original benchmark. We identify that existing benchmarks are particularly vulnerable to modifications that introduce even loose dependencies between the forget and retain information. Further, we show that ambiguity in unlearning targets in existing benchmarks can easily lead to the design of methods that overfit to the given test queries. Based on our findings, we urge the community to be cautious when interpreting benchmark results as reliable measures of progress, and we provide several recommendations to guide future LLM unlearning research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑