arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09253cs.IRcs.AIcs.CLcs.LG
收藏

释放大语言模型在序列推荐中的潜力:协调双动态索引机制

Unleash LLMs Potential for Sequential Recommendation by Coordinating Dual Dynamic Index Mechanism

Central South University(中南大学);Microsoft(微软公司);Microsoft Research Asia(微软亚洲研究院);Griffith University(格里菲斯大学)

Jun Yin, Zhengxin Zeng, Mingzheng Li, Hao Yan, Chaozhuo Li, Weihao Han, Jianjin Zhang, Ruochen Liu, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Shirui Pan, Senzhang Wang

AI总结:

本文提出端到端双动态(ED$^2$)推荐器,通过双动态索引机制统一索引生成与序列推荐,并利用用户相关信息,在三个公开数据集上分别提升命中率19.62%和NDCG 21.11%。

摘要:

得益于在语义理解和逻辑推理方面前所未有的能力,大语言模型(LLMs)在开发下一代序列推荐系统(RSs)方面展现出了巨大的潜力。然而,现有的基于LLM的序列推荐系统大多将索引生成与序列推荐分离,导致语义信息与协同信息之间的整合不足。另一方面,对用户相关信息的忽视阻碍了基于LLM的序列推荐系统利用高阶用户-物品交互模式。在本文中,我们提出了端到端双动态(ED$^2$)推荐器,这是首个采用双动态索引机制的基于LLM的序列推荐系统,旨在同时解决上述局限性。双动态索引机制不仅可以将索引生成和序列推荐整合到一个统一的LLM骨干流水线中,而且使基于LLM的序列推荐器能够实际利用用户相关信息。具体而言,为了促进LLM对双动态索引的理解能力,我们提出了一种多粒度令牌调节器,该调节器基于LLM在多个表示粒度上的语义知识构建对齐监督。此外,专门定制了关联的用户收集数据以及一系列新颖的指令调优任务,以捕获高阶用户-物品交互模式。在三个公开数据集上的大量实验证明了ED$^2$的优越性,在命中率上平均提高了19.62%,在NDCG上平均提高了21.11%。

英文摘要:

Owing to the unprecedented capability in semantic understanding and logical reasoning, large language models (LLMs) have shown fantastic potential in developing next-generation sequential recommender systems (RSs). However, existing LLM-based sequential RSs mostly separate index generation from sequential recommendation, leading to insufficient integration between semantic information and collaborative information. On the other hand, the neglect of user-related information hinders LLM-based sequential RSs from exploiting high-order user-item interaction patterns. In this paper, we propose the End-to-End Dual Dynamic (ED$^2$) recommender, the first LLM-based sequential RS which adopts dual dynamic index mechanism, targeting resolving the above limitations simultaneously. The dual dynamic index mechanism can not only assembly index generation and sequential recommendation into a unified LLM-backbone pipeline, but also make it practical for LLM-based sequential recommender to take advantage of user-related information. Specifically, to facilitate the LLM comprehension ability to dual dynamic index, we propose a multigrained token regulator which constructs alignment supervision based on LLMs semantic knowledge across multiple representation granularities. Moreover, the associated user collection data and a series of novel instruction tuning tasks are specially customized to capture the high-order user-item interaction patterns. Extensive experiments on three public datasets demonstrate the superiority of ED$^2$, achieving an average improvement of 19.62% in Hit-Rate and 21.11% in NDCG.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑