arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.09959cs.IR
收藏

一种面向基于大语言模型推荐的联邦框架

A Federated Framework for LLM-based Recommendation

Jujia Zhao, Wenjie Wang, Chen Xu, See-Kiong Ng, Tat-Seng Chua

AI总结:

针对大语言模型推荐直接应用联邦学习存在的客户端性能失衡、资源成本高的问题,提出含动态平衡与灵活存储策略的FELLRec框架,在保护隐私的同时实现性能均衡与整体提升,且资源效率更高。

摘要:

大语言模型(LLMs)通过对用户行为数据进行微调,为生成式推荐系统提供了强大支撑。然而,使用用户数据可能带来重大隐私风险,进而引发伦理困境并违反数据保护法规。为解决隐私问题,联邦推荐学习(Fed4Rec)被视为一种极具前景的解决方案。但将Fed4Rec直接应用于大语言模型场景会带来两大挑战:1)客户端性能失衡加剧,最终影响系统的长期有效性;2)客户端资源成本高昂,对本地训练和推理大语言模型所需的计算与存储能力提出了极高要求。\n 为应对这些挑战,我们提出了一种面向基于大语言模型推荐的联邦框架(简称FELLRec)。总体而言,FELLRec设计了两项核心策略:1)动态平衡策略,为不同客户端设计动态参数聚合机制与学习速率,旨在保障各客户端间的性能均衡;2)灵活存储策略,选择性地将部分敏感大语言模型层保留在客户端,同时将其他层卸载至服务器,旨在兼顾隐私保护与资源节约。实验结果表明,FELLRec能够在充分保护用户隐私的前提下,以计算与存储高效的方式实现更均衡的客户端性能,并提升整体性能。

英文摘要:

Large Language Models (LLMs) have empowered generative recommendation systems through fine-tuning user behavior data. However, utilizing the user data may pose significant privacy risks, potentially leading to ethical dilemmas and violations of data protection regulations. To address the privacy concerns, Federated Learning for Recommendation (Fed4Rec) has been identified as a promising solution. However, directly applying Fed4Rec in the LLM context introduces two challenges: 1) exacerbated client performance imbalance, which ultimately impacts the system's long-term effectiveness, and 2) substantial client resource costs, posing a high demand for clients' both computational and storage capability to locally train and infer LLMs. To tackle these challenges, we propose a federated framework for LLM-based recommendation (shorted as FELLRec). Generally, FELLRec designs two key strategies. 1) Dynamic balance strategy, which designs dynamic parameter aggregation and learning speed for different clients, aiming to ensure balanced performance across clients. 2) Flexible storage strategy, which selectively retains certain sensitive LLM layers on the client side, while offloading other layers to the server, aiming to preserve privacy while saving resources. Experiment results show that FELLRec can achieve a more balanced client performance and improved overall performance in a computational and storage-efficient way while safeguarding user privacy well.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑