arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.14577cs.IR
收藏

基于双网络的顺序推荐中过去-未来模型的分离

Disentangling Past-Future Modeling in Sequential Recommendation via Dual Networks

Hengyu Zhang, Enming Yuan, Wei Guo, Zhicheng He, Jiarui Qin, Huifeng Guo, Bo Chen, Xiu Li, Ruiming Tang

摘要:

顺序推荐(SR)是个性化推荐系统的重要组成部分,因为它可以从用户的实时增长行为中捕获动态的、多样化的偏好。与标准的自回归训练策略不同,未来的数据(在训练过程中也可用)已被用于促进模型训练,因为它提供了关于用户当前兴趣的更丰富的信号,并可用于提高推荐质量。然而,这些方法存在严重的训练-推理间隙,即,在训练时,过去和未来的上下文都由相同的编码器建模,而在推断期间仅历史行为可用。这种差异导致潜在的性能下降。为了缓解训练-推理的差距,我们提出了一个新的框架DualRec,它通过一个新的双网络实现了过去-未来的解纠缠和过去-未来的相互增强。具体来说,利用双重网络结构来分别对过去和未来上下文进行建模。双向知识转移机制增强了双网络的知识学习能力。在四个真实数据集上的大量实验证明了我们的方法优于基线方法。此外,我们通过使用RNN,Transformer和filter-MLP作为主干来实例化DualRec的兼容性。进一步的实证分析验证了在我们的DualRec框架下建模未来上下文的高效用。DualRec的代码可在https://github.com/zhy99426/DualRec上公开获得。

英文摘要:

Sequential recommendation (SR) plays an important role in personalized recommender systems because it captures dynamic and diverse preferences from users' real-time increasing behaviors. Unlike the standard autoregressive training strategy, future data (also available during training) has been used to facilitate model training as it provides richer signals about user's current interests and can be used to improve the recommendation quality. However, these methods suffer from a severe training-inference gap, i.e., both past and future contexts are modeled by the same encoder when training, while only historical behaviors are available during inference. This discrepancy leads to potential performance degradation. To alleviate the training-inference gap, we propose a new framework DualRec, which achieves past-future disentanglement and past-future mutual enhancement by a novel dual network. Specifically, a dual network structure is exploited to model the past and future context separately. And a bi-directional knowledge transferring mechanism enhances the knowledge learnt by the dual network. Extensive experiments on four real-world datasets demonstrate the superiority of our approach over baseline methods. Besides, we demonstrate the compatibility of DualRec by instantiating using RNN, Transformer, and filter-MLP as backbones. Further empirical analysis verifies the high utility of modeling future contexts under our DualRec framework. The code of DualRec is publicly available at https://github.com/zhy99426/DualRec.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑