arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.03536cs.IRcs.AI
收藏

面向大语言模型推荐系统的高效且有效遗忘方法研究

Towards Efficient and Effective Unlearning of Large Language Models for Recommendation

Shanghai Jiao Tong University(上海交通大学)

Hangyu Wang, Jianghao Lin, Bo Chen, Yang Yang, Ruiming Tang, Weinan Zhang, Yong Yu

AI总结:

本文提出E2URec方法,通过仅更新少量LoRA参数并结合多教师-学生框架,首次实现LLM推荐系统的高效且有效遗忘,在不损害推荐性能的前提下保护用户隐私。

摘要:

大语言模型(LLMs)的显著进展催生了一个有前景的研究方向,即利用LLMs作为推荐器(LLMRec)。LLMRec的有效性源于LLMs固有的开放世界知识和推理能力。LLMRec通过基于用户交互数据的指令微调来获得推荐能力。然而,为了保护用户隐私并优化效用,LLMRec同样需要能够有意识地遗忘特定用户数据,这通常被称为推荐遗忘。在LLMs时代,推荐遗忘在效率低下和效果不佳两个方面给LLMRec带来了新的挑战。现有的遗忘方法需要更新LLMRec中数十亿的参数,成本高昂且耗时。此外,这些方法在遗忘过程中往往会影响模型的效用。为此,我们提出了E2URec,这是首个面向LLMRec的高效且有效的遗忘方法。我们提出的E2URec通过仅更新少量额外的LoRA参数来提升遗忘效率,并通过采用教师-学生框架来提升遗忘效果,在该框架中我们维护多个教师网络来指导遗忘过程。大量实验表明,E2URec在两个真实世界数据集上优于最先进的基线方法。具体而言,E2URec能够在不影响推荐性能的情况下高效地遗忘特定数据。源代码位于https://github.com/justarter/E2URec。

英文摘要:

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities inherent in LLMs. LLMRec acquires the recommendation capabilities through instruction tuning based on user interaction data. However, in order to protect user privacy and optimize utility, it is also crucial for LLMRec to intentionally forget specific user data, which is generally referred to as recommendation unlearning. In the era of LLMs, recommendation unlearning poses new challenges for LLMRec in terms of \textit{inefficiency} and \textit{ineffectiveness}. Existing unlearning methods require updating billions of parameters in LLMRec, which is costly and time-consuming. Besides, they always impact the model utility during the unlearning process. To this end, we propose \textbf{E2URec}, the first \underline{E}fficient and \underline{E}ffective \underline{U}nlearning method for LLM\underline{Rec}. Our proposed E2URec enhances the unlearning efficiency by updating only a few additional LoRA parameters, and improves the unlearning effectiveness by employing a teacher-student framework, where we maintain multiple teacher networks to guide the unlearning process. Extensive experiments show that E2URec outperforms state-of-the-art baselines on two real-world datasets. Specifically, E2URec can efficiently forget specific data without affecting recommendation performance. The source code is at \url{https://github.com/justarter/E2URec}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑