arXiv 2201.060352022-01cs.IRcs.AIcs.LG

基于随机自注意的序贯推荐

Sequential Recommendation via Stochastic Self-Attention

University of Illinois at Chicago（伊利诺伊大学芝加哥分校）；Spotify（声田）；Pinterest Inc（拼趣公司）；Beihang University（北京航空航天大学）

Ziwei Fan, Zhiwei Liu, Alice Wang, Zahra Nazari, Lei Zheng, Hao Peng, Philip S. Yu

备注：: updated version for camera-ready

摘要：

序贯推荐是通过对用户先前行为的动态建模来预测下一个项目的一种方法，受到了广泛的关注。基于转换器的方法，它嵌入项目作为向量，并使用点积自我注意力来衡量项目之间的关系，表现出优越的能力，现有的顺序方法。然而，用户的真实世界的顺序行为是\textit{\textbf{uncertain}}，而不是确定性的，提出了一个重大的挑战，目前的技术。我们进一步建议，基于点积的方法不能完全捕获\textit{\textbf{collaborative transitivity}}，它可以在序列内的项目-项目转换中导出，并且对冷启动项目是有益的。我们进一步指出，BPR损失没有约束的积极和抽样的负面项目，这误导了优化。我们提出了一种新的\textbf{STO}随机\textbf{S} elf- \textbf{A} tension ~（STOSA）来克服这些问题。特别是，STOSA将每个项目嵌入为随机高斯分布，其协方差编码不确定性。我们设计了一个新的Wasserstein自我注意模块来描述序列中的项目-项目位置关系，它有效地将不确定性纳入模型训练。Wasserstein的注意也启发了协作传递性学习，因为它满足三角不等式。此外，我们引入了一个新的正则化项的排名损失，这保证了积极和消极的项目之间的相异性。在五个真实世界的基准数据集上进行的大量实验表明，该模型优于最先进的基线，特别是在冷启动项目上。代码在\url{https://github.com/zfan20/STOSA}中可用。

英文摘要：

Sequential recommendation models the dynamics of a user's previous behaviors in order to forecast the next item, and has drawn a lot of attention. Transformer-based approaches, which embed items as vectors and use dot-product self-attention to measure the relationship between items, demonstrate superior capabilities among existing sequential methods. However, users' real-world sequential behaviors are \textit{\textbf{uncertain}} rather than deterministic, posing a significant challenge to present techniques. We further suggest that dot-product-based approaches cannot fully capture \textit{\textbf{collaborative transitivity}}, which can be derived in item-item transitions inside sequences and is beneficial for cold start items. We further argue that BPR loss has no constraint on positive and sampled negative items, which misleads the optimization. We propose a novel \textbf{STO}chastic \textbf{S}elf-\textbf{A}ttention~(STOSA) to overcome these issues. STOSA, in particular, embeds each item as a stochastic Gaussian distribution, the covariance of which encodes the uncertainty. We devise a novel Wasserstein Self-Attention module to characterize item-item position-wise relationships in sequences, which effectively incorporates uncertainty into model training. Wasserstein attentions also enlighten the collaborative transitivity learning as it satisfies triangle inequality. Moreover, we introduce a novel regularization term to the ranking loss, which assures the dissimilarity between positive and the negative items. Extensive experiments on five real-world benchmark datasets demonstrate the superiority of the proposed model over state-of-the-art baselines, especially on cold start items. The code is available in \url{https://github.com/zfan20/STOSA}.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

摘要：

英文摘要：

相关论文