arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.07427cs.IR
收藏

超越物品间关系:动态自适应以增强基于LLM的序列推荐

Beyond Inter-Item Relations: Dynamic Adaption for Enhancing LLM-Based Sequential Recommendation

CanYi Liu, Wei Li, Youchen, Zhang, Hui Li, Rongrong Ji

AI总结:

针对现有基于LLM的序列推荐忽视物品内部关系、长期协同知识及架构不灵活的问题,提出DARec模型,通过上下文掩码、协同知识注入和贝叶斯优化的动态自适应机制增强推荐效果。

摘要:

序列推荐系统(SRS)基于用户历史交互序列预测用户可能偏好的下一个物品。受大型语言模型(LLMs)在各种AI应用中崛起的启发,基于LLM的SRS研究大量涌现。尽管其性能颇具吸引力,但现有的基于LLM的SRS仍存在一些局限性,包括忽视物品内部关系、忽略长期协同知识以及使用不灵活的架构设计进行自适应。为了缓解这些问题,我们提出了一种名为DARec的基于LLM的序列推荐模型。在用于捕获物品间关系的粗粒度自适应基础上,DARec进一步通过以下方式增强:(1)上下文掩码,对物品内部关系进行建模,以帮助LLM在SRS上下文中更好地理解token和物品语义;(2)协同知识注入,帮助LLM融入长期协同知识;(3)动态自适应机制,使用贝叶斯优化灵活选择分层适配器架构,以更好地融入不同的序列信息。大量实验表明,DARec能够以动态和自适应的方式有效处理序列推荐。

英文摘要:

Sequential recommender systems (SRS) predict the next items that users may prefer based on user historical interaction sequences. Inspired by the rise of large language models (LLMs) in various AI applications, there is a surge of work on LLM-based SRS. Despite their attractive performance, existing LLM-based SRS still exhibit some limitations, including neglecting intra-item relations, ignoring long-term collaborative knowledge and using inflexible architecture designs for adaption. To alleviate these issues, we propose an LLM-based sequential recommendation model named DARec. Built on top of coarse-grained adaption for capturing inter-item relations, DARec is further enhanced with (1) context masking that models intra-item relations to help LLM better understand token and item semantics in the context of SRS, (2) collaborative knowledge injection that helps LLM incorporate long-term collaborative knowledge, and (3) a dynamic adaption mechanism that uses Bayesian optimization to flexibly choose layer-wise adapter architectures in order to better incorporate different sequential information. Extensive experiments demonstrate that DARec can effectively handle sequential recommendation in a dynamic and adaptive manner.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑