arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.15950cs.IRcs.AI
收藏

面向推荐系统的大语言模型表示学习

Representation Learning with Large Language Models for Recommendation

University of Hong Kong(香港大学);Baidu Inc.(百度公司)

Xubin Ren, Wei Wei, Lianghao Xia, Lixin Su, Suqi Cheng, Junfeng Wang, Dawei Yin, Chao Huang

AI总结:

针对传统基于ID的图推荐器忽略文本信息、隐式反馈有噪声偏差等问题,提出模型无关框架RLMRec,结合LLM进行表示学习,通过用户/物品画像、跨视图对齐等提升推荐效果,并验证了其效率与鲁棒性。

摘要:

受深度学习和图神经网络的影响,推荐系统已取得显著进展,尤其在捕捉复杂的用户-物品关系方面表现突出。然而,这些基于图的推荐器严重依赖基于ID的数据,可能忽略了与用户和物品相关的宝贵文本信息,导致学习到的表征信息量不足。此外,隐式反馈数据的使用引入了潜在的噪声和偏差,给用户偏好学习的有效性带来了挑战。虽然将大语言模型(LLMs)集成到传统的基于ID的推荐器中已受到关注,但在实际推荐系统中有效实施仍需解决可扩展性问题、仅依赖文本的局限性以及提示输入约束等挑战。为应对这些挑战,我们提出了一个模型无关框架RLMRec,旨在通过LLM赋能的表示学习增强现有推荐器的性能。该框架提出了一种将表示学习与LLMs相结合的推荐范式,以捕捉用户行为和偏好的复杂语义层面。RLMRec融合了辅助文本信号,开发了由LLMs赋能的用户/物品画像范式,并通过跨视图对齐框架将LLMs的语义空间与协同关系信号的表示空间进行对齐。本研究进一步建立了理论基础,证明通过互信息最大化引入文本信号可提升表征质量。在评估中,我们将RLMRec与当前最先进的推荐模型集成,同时分析了其效率和对噪声数据的鲁棒性。我们的实现代码可在https://github.com/HKUDS/RLMRec获取。

英文摘要:

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on ID-based data, potentially disregarding valuable textual information associated with users and items, resulting in less informative learned representations. Moreover, the utilization of implicit feedback data introduces potential noise and bias, posing challenges for the effectiveness of user preference learning. While the integration of large language models (LLMs) into traditional ID-based recommenders has gained attention, challenges such as scalability issues, limitations in text-only reliance, and prompt input constraints need to be addressed for effective implementation in practical recommender systems. To address these challenges, we propose a model-agnostic framework RLMRec that aims to enhance existing recommenders with LLM-empowered representation learning. It proposes a recommendation paradigm that integrates representation learning with LLMs to capture intricate semantic aspects of user behaviors and preferences. RLMRec incorporates auxiliary textual signals, develops a user/item profiling paradigm empowered by LLMs, and aligns the semantic space of LLMs with the representation space of collaborative relational signals through a cross-view alignment framework. This work further establish a theoretical foundation demonstrating that incorporating textual signals through mutual information maximization enhances the quality of representations. In our evaluation, we integrate RLMRec with state-of-the-art recommender models, while also analyzing its efficiency and robustness to noise data. Our implementation codes are available at https://github.com/HKUDS/RLMRec.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑