arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.01339cs.IR
收藏

利用大语言模型改进序列推荐

Improving Sequential Recommendations with LLMs

Artun Boz, Wouter Zorgdrager, Zoe Kotti, Jesse Harte, Panos Louridas, Dietmar Jannach, Vassilios Karakoidas, Marios Fragkoulis

AI总结:

本研究探索大语言模型在序列推荐中的应用,设计三类正交方法及混合方案,经多数据集实验验证,LLM嵌入初始化、微调等方式可显著提升推荐准确率,为后续推荐系统发展提供参考。

摘要:

序列推荐问题在过去几年中吸引了大量研究关注,催生了众多推荐模型。在本研究中,我们探讨了如今在众多基于AI的应用中产生颠覆性影响的大语言模型(Large Language Models, LLMs)如何被用于构建或改进序列推荐方法。具体而言,我们设计了三种正交方法及其混合方案,以不同方式利用LLM的能力。此外,我们通过聚焦每种方法的技术构成要素,并为每个要素确定一系列替代选择,来探究每种方法的潜力。我们在三个数据集上开展了大量实验,探索了多种配置,包括不同的语言模型和基线推荐模型,以全面了解每种方法的性能。在诸多观察结果中,我们重点指出:用从LLM获得的嵌入初始化BERT4Rec或SASRec等最先进的序列推荐模型,可在准确率方面带来显著的性能提升。此外,我们发现针对推荐任务微调LLM,不仅能让模型学习任务本身,还能在一定程度上学习领域概念。我们还表明,微调OpenAI GPT的性能明显优于微调Google PaLM 2。总体而言,我们的大量实验表明,在未来的推荐方法中利用LLM具有巨大的潜在价值。我们公开分享了实验的代码和数据以确保可复现性。

英文摘要:

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays introducing disruptive effects in many AI-based applications, can be used to build or improve sequential recommendation approaches. Specifically, we design three orthogonal approaches and hybrids of those to leverage the power of LLMs in different ways. In addition, we investigate the potential of each approach by focusing on its comprising technical aspects and determining an array of alternative choices for each one. We conduct extensive experiments on three datasets and explore a large variety of configurations, including different language models and baseline recommendation models, to obtain a comprehensive picture of the performance of each approach. Among other observations, we highlight that initializing state-of-the-art sequential recommendation models such as BERT4Rec or SASRec with embeddings obtained from an LLM can lead to substantial performance gains in terms of accuracy. Furthermore, we find that fine-tuning an LLM for recommendation tasks enables it to learn not only the tasks, but also concepts of a domain to some extent. We also show that fine-tuning OpenAI GPT leads to considerably better performance than fine-tuning Google PaLM 2. Overall, our extensive experiments indicate a huge potential value of leveraging LLMs in future recommendation approaches. We publicly share the code and data of our experiments to ensure reproducibility.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑