arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.20646cs.IRcs.CL
收藏

LLM-ESR: 面向长尾序列推荐的大语言模型增强方法

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation

Xi’an Jiaotong University(西安交通大学);City University of Hong Kong(香港城市大学);Jilin University(吉林大学);Jarvis Research Center, Tencent YouTu Lab(腾讯优图实验室贾维斯研究中心);Westlake University(西湖大学)

Qidong Liu, Xian Wu, Yejing Wang, Zijian Zhang, Feng Tian, Yefeng Zheng, Xiangyu Zhao

AI总结:

针对序列推荐中的长尾用户与物品挑战,提出融合LLM语义与协同信号的LLM-ESR增强框架,通过双视角建模和检索增强自蒸馏提升推荐效果,且不增加额外推理负载,在多数据集上验证了有效性。

摘要:

序列推荐系统(SRS)旨在根据用户的历史交互行为预测其后续选择,已在电商、社交媒体等多个领域得到应用。然而在真实系统中,大多数用户仅与少数物品产生交互,同时绝大多数物品很少被消费。这两个问题分别被称为长尾用户挑战和长尾物品挑战,往往给现有序列推荐系统带来难题,会对用户体验和商家利益造成负面影响,因此亟需解决。尽管已有少量研究针对这些挑战展开探索,但由于交互数据本身的稀缺性,这些方法仍存在顾此失彼的“跷跷板”问题或噪声干扰问题。大语言模型(LLM)的发展为从语义层面解决这些问题提供了可行思路。作为该领域的先行探索之一,我们提出了面向序列推荐的大语言模型增强框架LLM-ESR。该框架利用从大语言模型中提取的语义嵌入增强序列推荐系统,且不会额外增加大语言模型带来的推理负载。针对长尾物品挑战,我们设计了双视角建模框架,融合大语言模型的语义信息与传统序列推荐系统的协同信号。针对长尾用户挑战,我们提出检索增强自蒸馏方法,借助相似用户的更丰富交互信息优化用户偏好表征。为验证所提增强框架的有效性与通用性,我们采用三种主流序列推荐模型,在三个真实世界数据集上开展了大量实验。结果表明,我们的方法始终优于现有基线模型,尤其能为长尾用户和长尾物品带来显著性能提升。实现代码可在https://github.com/Applied-Machine-Learning-Lab/LLM-ESR获取。

英文摘要:

Sequential recommender systems (SRS) aim to predict users' subsequent choices based on their historical interactions and have found applications in diverse fields such as e-commerce and social media. However, in real-world systems, most users interact with only a handful of items, while the majority of items are seldom consumed. These two issues, known as the long-tail user and long-tail item challenges, often pose difficulties for existing SRS. These challenges can adversely affect user experience and seller benefits, making them crucial to address. Though a few works have addressed the challenges, they still struggle with the seesaw or noisy issues due to the intrinsic scarcity of interactions. The advancements in large language models (LLMs) present a promising solution to these problems from a semantic perspective. As one of the pioneers in this field, we propose the Large Language Models Enhancement framework for Sequential Recommendation (LLM-ESR). This framework utilizes semantic embeddings derived from LLMs to enhance SRS without adding extra inference load from LLMs. To address the long-tail item challenge, we design a dual-view modeling framework that combines semantics from LLMs and collaborative signals from conventional SRS. For the long-tail user challenge, we propose a retrieval augmented self-distillation method to enhance user preference representation using more informative interactions from similar users. To verify the effectiveness and versatility of our proposed enhancement framework, we conduct extensive experiments on three real-world datasets using three popular SRS models. The results show that our method surpasses existing baselines consistently, and benefits long-tail users and items especially. The implementation code is available at https://github.com/Applied-Machine-Learning-Lab/LLM-ESR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑