arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.06101cs.IRcs.CL
收藏

RALLRec:通过表示学习改进检索增强型大语言模型推荐

RALLRec: Improving Retrieval Augmented Large Language Model Recommendation with Representation Learning

Tsinghua University(清华大学);City University of Hong Kong(香港城市大学);Dongguan University of Technology(东莞理工学院);Alibaba Group(阿里巴巴集团);City University of Hong Kong Shenzhen Research Institute(香港城市大学深圳研究院)

Jian Xu, Sichun Luo, Xiangyu Chen, Haoming Huang, Hanxu Hou, Linqi Song

AI总结:

针对现有RAG推荐方法依赖文本语义导致相关项目纳入不足的问题,提出RALLRec,通过LLM生成详细项目描述增强文本语义,联合学习文本与协同语义并引入重排序捕捉用户偏好动态,在三个数据集上验证了有效性。

摘要:

大语言模型(LLMs)已被整合到推荐系统中,以增强对用户行为的理解。检索增强生成(RAG)技术进一步被纳入这些系统,以检索更多相关项目并提升系统性能。然而,现有RAG方法主要依赖文本语义,往往无法纳入最相关的项目,限制了系统的有效性。在本文中,我们提出了检索增强型大语言模型推荐的表示学习方法(RALLRec)。具体而言,我们通过提示LLMs生成更详细的项目描述来增强文本语义,随后对分别由LLM和推荐模型提取的文本语义与协同语义进行联合表示学习。考虑到用户兴趣潜在的时变特性,我们进一步引入了一种简单但有效的重排序方法来捕捉用户偏好的动态变化。我们在三个真实世界的数据集上进行了广泛的实验,评估结果验证了我们方法的有效性。代码已公开在https://github.com/JianXu95/RALLRec。

英文摘要:

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items and improve system performance. However, existing RAG methods rely primarily on textual semantics and often fail to incorporate the most relevant items, limiting the effectiveness of the systems. In this paper, we propose Representation learning for retrieval-Augmented Large Language model Recommendation (RALLRec). Specifically, we enhance textual semantics by prompting LLMs to generate more detailed item descriptions, followed by joint representation learning of textual and collaborative semantics, which are extracted by the LLM and recommendation models, respectively. Considering the potential time-varying characteristics of user interest, a simple yet effective reranking method is further introduced to capture the dynamics of user preference. We conducted extensive experiments on three real-world datasets, and the evaluation results validated the effectiveness of our method. Code is made public at https://github.com/JianXu95/RALLRec.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑