arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.16674cs.IR
收藏

一种基于提示的表示学习方法用于结合大语言模型的推荐系统

A Prompting-Based Representation Learning Method for Recommendation with Large Language Models

Junyi Chen, Toyotaro Suzumura

AI总结:

本文提出P4R框架,利用大语言模型提示生成物品画像,结合BERT语义嵌入与GCN协同过滤表示,以提升推荐系统性能。

摘要:

近年来,随着大语言模型(LLMs)在自然语言处理(NLP)领域的发展,推荐系统(RS)经历了变革性的转变。GPT-3.5/4、Llama等模型在理解和生成类人文本方面展现出前所未有的能力。这些LLMs预训练所包含的广泛信息,使其有潜力从用户和物品的不同上下文信息中捕获更深层的语义表示。虽然LLMs的蓬勃发展背后蕴藏着巨大潜力,但如何从上下文信息中利用用户-物品偏好,并将其与推荐系统的改进相结合,仍是一个需要解决的挑战。我们认为,更好地理解用户或物品本身可能是提升推荐性能的关键因素,因此我们开展了利用最先进的LLMs生成信息丰富画像的研究。为了增强LLMs在推荐系统中的语言能力,我们提出了基于提示的推荐表示学习方法(P4R)。在我们的P4R框架中,我们利用LLM提示策略来创建个性化物品画像。随后,使用预训练的BERT模型进行文本嵌入,将这些画像转换到语义表示空间中。此外,我们引入图卷积网络(GCN)用于协同过滤表示。P4R框架对齐这两个嵌入空间,以解决通用推荐任务。在评估中,我们将P4R与最先进的推荐模型进行比较,并评估基于提示的画像生成质量。

英文摘要:

In recent years, Recommender Systems (RS) have witnessed a transformative shift with the advent of Large Language Models (LLMs) in the field of Natural Language Processing (NLP). Models such as GPT-3.5/4, Llama, have demonstrated unprecedented capabilities in understanding and generating human-like text. The extensive information pre-trained by these LLMs allows for the potential to capture a more profound semantic representation from different contextual information of users and items. While the great potential lies behind the thriving of LLMs, the challenge of leveraging user-item preferences from contextual information and its alignment with the improvement of Recommender Systems needs to be addressed. Believing that a better understanding of the user or item itself can be the key factor in improving recommendation performance, we conduct research on generating informative profiles using state-of-the-art LLMs. To boost the linguistic abilities of LLMs in Recommender Systems, we introduce the Prompting-Based Representation Learning Method for Recommendation (P4R). In our P4R framework, we utilize the LLM prompting strategy to create personalized item profiles. These profiles are then transformed into semantic representation spaces using a pre-trained BERT model for text embedding. Furthermore, we incorporate a Graph Convolution Network (GCN) for collaborative filtering representation. The P4R framework aligns these two embedding spaces in order to address the general recommendation tasks. In our evaluation, we compare P4R with state-of-the-art Recommender models and assess the quality of prompt-based profile generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑