arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.16378cs.IR
收藏

发挥各自优势:传统推荐模型与大型语言模型的协同智能

Play to Your Strengths: Collaborative Intelligence of Conventional Recommender Models and Large Language Models

Yunjia Xi, Weiwen Liu, Jianghao Lin, Chuhan Wu, Bo Chen, Ruiming Tang, Weinan Zhang, Yong Yu

AI总结:

本文提出CoReLLa框架,通过联合训练传统推荐模型与大型语言模型并利用对齐损失解决决策边界偏移,使CRM处理简单样本、LLM处理复杂样本,从而发挥两者协同优势,显著提升推荐性能。

摘要:

大型语言模型(LLMs)的兴起通过增强用户行为建模和内容理解,为推荐系统(RSs)带来了新机遇。然而,当前将LLMs集成到RSs的方法仅利用LLM或传统推荐模型(CRM)来生成最终推荐,未考虑LLM或CRM各自擅长处理哪些数据段。为填补这一空白,我们在MovieLens-1M和Amazon-Books数据集上进行实验,比较了代表性CRM(DCNv2)和LLM(LLaMA2-7B)在不同数据样本组上的表现。研究发现,LLMs在CRMs表现出较低置信度和精度的数据段中表现优异,而CRM擅长的样本对LLM来说相对困难,需要大量训练数据和较长训练时间才能达到相当的性能。这表明LLM与CRM的结合存在潜在的协同效应。受此启发,我们提出了传统推荐器与大型语言模型协同推荐(简称CoReLLa)。在该框架中,我们首先联合训练LLM和CRM,并通过对齐损失解决决策边界偏移问题。然后,资源高效且推理时间较短的CRM处理简单和中等样本,而LLM处理CRM难以处理的少量挑战性样本。实验结果表明,CoReLLa显著优于最先进的CRM和LLM方法,凸显了其在推荐任务中的有效性。

英文摘要:

The rise of large language models (LLMs) has opened new opportunities in Recommender Systems (RSs) by enhancing user behavior modeling and content understanding. However, current approaches that integrate LLMs into RSs solely utilize either LLM or conventional recommender model (CRM) to generate final recommendations, without considering which data segments LLM or CRM excel in. To fill in this gap, we conduct experiments on MovieLens-1M and Amazon-Books datasets, and compare the performance of a representative CRM (DCNv2) and an LLM (LLaMA2-7B) on various groups of data samples. Our findings reveal that LLMs excel in data segments where CRMs exhibit lower confidence and precision, while samples where CRM excels are relatively challenging for LLM, requiring substantial training data and a long training time for comparable performance. This suggests potential synergies in the combination between LLM and CRM. Motivated by these insights, we propose Collaborative Recommendation with conventional Recommender and Large Language Model (dubbed \textit{CoReLLa}). In this framework, we first jointly train LLM and CRM and address the issue of decision boundary shifts through alignment loss. Then, the resource-efficient CRM, with a shorter inference time, handles simple and moderate samples, while LLM processes the small subset of challenging samples for CRM. Our experimental results demonstrate that CoReLLa outperforms state-of-the-art CRM and LLM methods significantly, underscoring its effectiveness in recommendation tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑