arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.16865cs.IR
收藏

LARES:面向序列推荐的潜在推理框架

LARES: Latent Reasoning for Sequential Recommendation

Enze Liu, Bowen Zheng, Xiaolei Wang, Wayne Xin Zhao, Jinpeng Wang, Sheng Chen, Ji-Rong Wen

AI总结:

LARES提出一种通过深度循环潜在推理增强序列推荐模型表示能力的框架,结合自监督预训练与强化后训练,在不增加参数复杂度的情况下提升推荐性能,并可与现有先进模型兼容。

摘要:

序列推荐系统在建模用户行为序列以预测其偏好的实际应用中已变得日益重要。然而,现有的序列推荐方法主要依赖非推理范式,这可能限制模型的计算能力并导致次优的推荐性能。为了解决这些局限性,我们提出了LARES,一种新颖且可扩展的面向序列推荐的潜在推理框架,该框架通过深度循环潜在推理提高参数的计算密度,从而增强模型的表示能力。我们提出的方法采用循环架构,允许在不增加参数复杂度的情况下灵活扩展推理深度,从而有效捕捉动态且复杂的用户兴趣模式。LARES的一个关键区别在于在每个隐式推理步骤中细化所有输入token,以提高计算利用率。为了充分释放模型的推理潜力,我们设计了一个两阶段训练策略:(1)具有双重对齐目标的自监督预训练(SPT);(2)强化后训练(RPT)。在第一阶段,我们引入轨迹级对齐和步级对齐目标,使模型能够在不需要补充标注数据的情况下学习面向推荐的潜在推理模式。后续阶段利用强化学习(RL)来发挥模型的探索能力,进一步完善其推理能力。在真实世界基准上的综合实验证明了我们框架的优越性能。值得注意的是,LARES与现有先进模型展现出无缝兼容性,进一步提升了它们的推荐性能。我们的代码可在https://anonymous.4open.science/r/LARES-E458/获取。

英文摘要:

Sequential recommender systems have become increasingly important in real-world applications that model user behavior sequences to predict their preferences. However, existing sequential recommendation methods predominantly rely on non-reasoning paradigms, which may limit the model's computational capacity and result in suboptimal recommendation performance. To address these limitations, we present LARES, a novel and scalable LAtent REasoning framework for Sequential recommendation that enhances model's representation capabilities through increasing the computation density of parameters by depth-recurrent latent reasoning. Our proposed approach employs a recurrent architecture that allows flexible expansion of reasoning depth without increasing parameter complexity, thereby effectively capturing dynamic and intricate user interest patterns. A key difference of LARES lies in refining all input tokens at each implicit reasoning step to improve the computation utilization. To fully unlock the model's reasoning potential, we design a two-phase training strategy: (1) Self-supervised pre-training (SPT) with dual alignment objectives; (2) Reinforcement post-training (RPT). During the first phase, we introduce trajectory-level alignment and step-level alignment objectives, which enable the model to learn recommendation-oriented latent reasoning patterns without requiring supplementary annotated data. The subsequent phase utilizes reinforcement learning (RL) to harness the model's exploratory ability, further refining its reasoning capabilities. Comprehensive experiments on real-world benchmarks demonstrate our framework's superior performance. Notably, LARES exhibits seamless compatibility with existing advanced models, further improving their recommendation performance. Our code is available at https://anonymous.4open.science/r/LARES-E458/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑