Large Language Models (LLMs) have empowered generative recommendation systems through fine-tuning user behavior data. However, utilizing the user data may pose significant privacy risks, potentially leading to ethical dilemmas and violations of data protection regulations. To address the privacy concerns, Federated Learning for Recommendation (Fed4Rec) has been identified as a promising solution. However, directly applying Fed4Rec in the LLM context introduces two challenges: 1) exacerbated client performance imbalance, which ultimately impacts the system's long-term effectiveness, and 2) substantial client resource costs, posing a high demand for clients' both computational and storage capability to locally train and infer LLMs.
To tackle these challenges, we propose a federated framework for LLM-based recommendation (shorted as FELLRec). Generally, FELLRec designs two key strategies. 1) Dynamic balance strategy, which designs dynamic parameter aggregation and learning speed for different clients, aiming to ensure balanced performance across clients. 2) Flexible storage strategy, which selectively retains certain sensitive LLM layers on the client side, while offloading other layers to the server, aiming to preserve privacy while saving resources. Experiment results show that FELLRec can achieve a more balanced client performance and improved overall performance in a computational and storage-efficient way while safeguarding user privacy well.
Multimodal-enhanced Federated Recommendation: A Group-wise Fusion Approach
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University(吉林大学教育部符号计算与知识工程重点实验室);PolyU Academy for Artificial Intelligence, Hong Kong Polytechnic University(香港理工大学PolyU人工智能学院);Australian Artificial Intelligence Institute, FEIT, University of Technology Sydney(悉尼科技大学FEIT澳大利亚人工智能研究所);College of Computer Science, Inner Mongolia University(内蒙古大学计算机学院)
TransFR: Transferable Federated Recommendation with Adapter Tuning on Pre-trained Language Models
Key Laboratory of Big Data & Artificial Intelligence in Transportation, Ministry of Education, China(交通运输部大数据与人工智能重点实验室);Beijing Jiaotong University, China(北京交通大学);University of Technology Sydney, Australia(悉尼科技大学);Peking University, China(北京大学);Nanyang Technological University, Singapore(南洋理工大学)
Learning Evolving Preferences: A Federated Continual Framework for User-Centric Recommendation
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University(吉林大学符号计算与知识工程教育部重点实验室);PolyU Academy for Artificial Intelligence, Hong Kong Polytechnic University(香港理工大学PolyU人工智能研究院);Australian Artificial Intelligence Institute, FEIT, University of Technology Sydney(悉尼科技大学FEIT澳大利亚人工智能研究所)
A Systematic Survey on Federated Sequential Recommendation
School of Computer Science and Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);The Hong Kong Polytechnic University(香港理工大学)
FedCRF: A Federated Cross-domain Recommendation Method with Semantic-driven Deep Knowledge Fusion
School of Computer and Artificial Intelligence, Shandong Normal University(山东师范大学计算机与人工智能学院);Qingdao Institute of Software, China University of Petroleum (East China)(中国石油大学(华东)青岛软件研究院);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Shandong Provincial Key Laboratory of Industrial Network and Information System Security, Shandong Fundamental Research Center for Computer Science(山东省计算机基础研究中心);School of Computer Science and Technology, Ocean University of China(中国海洋大学计算机科学与技术学院);School of Computing and Artificial Intelligence, Shandong University of Finance and Economics(山东财经大学计算与人工智能学院)
Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR)(山东大学-南洋理工大学人工智能国际联合研究院(C-FAIR));Software School, Shandong University(山东大学软件学院);Shandong University(山东大学);Sino-Singapore International Joint Research Institute(中新国际联合研究院);Alibaba-NTU Singapore Joint Research Institute(阿里巴巴-新加坡南洋理工大学联合研究学院);Nanyang Technological University(南洋理工大学);Microsoft Research Asia(微软亚洲研究院)
Federated Semantic Residuals for Multimodal Recommendation
Australian Artificial Intelligence Institute, Faculty of Engineering and Information Technology, University of Technology Sydney(悉尼科技大学工程与信息学院澳大利亚人工智能研究所);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系)
Personalized Recommendation Models in Federated Settings: A Survey
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Hong Kong University of Science and Technology(香港科技大学);WeBank(微众银行)