arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.16034cs.IR
收藏

FeDecider: 一种基于大语言模型的联邦跨域推荐框架

FeDecider: An LLM-Based Framework for Federated Cross-Domain Recommendation

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Xinrui He, Ting-Wei Li, Tianxin Wei, Xuying Ning, Xinyu He, Wenxuan Bao, Hanghang Tong, Jingrui He

AI总结:

FeDecider是一种基于大语言模型的联邦跨域推荐框架,通过解耦客户端低秩更新并学习个性化权重,有效解决跨域推荐中的过拟合和异质性问题。

摘要:

联邦跨域推荐(联邦CDR)旨在在异构领域间协同学习个性化推荐模型,同时保护数据隐私。近期,基于大语言模型(LLM)的推荐模型通过利用LLM强大的推理能力和广泛的知识展示了出色的性能。然而,在联邦CDR场景中采用LLM推荐模型引入了新的挑战。首先,存在领域特定本地适配器过拟合的风险。本地优化的参数更新幅度在不同领域间往往不同,导致偏置聚合和对领域特定分布的过拟合。其次,与传统推荐模型(如协同过滤、双图方法)学习显式且可比较的用户/物品表示不同,LLM通过自回归文本生成训练隐式编码知识。这在异质性下有效测量跨域相似性方面提出了额外挑战。为解决这些挑战,我们提出了一种基于LLM的联邦跨域推荐框架FeDecider。具体而言,FeDecider通过解耦每个客户端的低秩更新并共享仅其方向成分来处理规模特定的噪声问题。为处理灵活且有效的整合需求,每个客户端进一步学习个性化权重,以实现其他领域更新的数据感知整合。在多样化的数据集上进行的大量实验验证了我们提出的FeDecider的有效性。

英文摘要:

Federated cross-domain recommendation (Federated CDR) aims to collaboratively learn personalized recommendation models across heterogeneous domains while preserving data privacy. Recently, large language model (LLM)-based recommendation models have demonstrated impressive performance by leveraging LLMs' strong reasoning capabilities and broad knowledge. However, adopting LLM-based recommendation models in Federated CDR scenarios introduces new challenges. First, there exists a risk of overfitting with domain-specific local adapters. The magnitudes of locally optimized parameter updates often vary across domains, causing biased aggregation and overfitting toward domain-specific distributions. Second, unlike traditional recommendation models (e.g., collaborative filtering, bipartite graph-based methods) that learn explicit and comparable user/item representations, LLMs encode knowledge implicitly through autoregressive text generation training. This poses additional challenges for effectively measuring the cross-domain similarities under heterogeneity. To address these challenges, we propose an LLM-based framework for federated cross-domain recommendation, FeDecider. Specifically, FeDecider tackles the challenge of scale-specific noise by disentangling each client's low-rank updates and sharing only their directional components. To handle the need for flexible and effective integration, each client further learns personalized weights that achieve the data-aware integration of updates from other domains. Extensive experiments across diverse datasets validate the effectiveness of our proposed FeDecider.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑