arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.05022cs.IRcs.AIcs.LG
收藏

通过具有多维嵌入的自适应鲁棒注意力实现序列推荐

Sequential Recommendation via Adaptive Robust Attention with Multi-dimensional Embeddings

Salesforce(Salesforce公司);University of Technology Sydney(悉尼科技大学)

Linsey Pang, Amir Hossein Raffiee, Wei Liu, Keld Lundgaard

AI总结:

针对序列推荐中用户行为多样及模型鲁棒性问题,提出ADRRec框架,结合多维时间上下文核嵌入、混合注意力与LNI正则化,实验表明其优于现有自注意力架构。

摘要:

序列推荐模型利用自注意力机制已取得最先进的性能。此后研究发现,在预测下一个物品时,不再仅使用物品ID和位置嵌入,可显著提升准确率。近期文献报道,采用带有时间上下文核的多维核嵌入来捕捉用户多样化的行为模式,能够带来实质性的性能提升。在本研究中,我们通过引入一种混合注意力机制并辅以逐层噪声注入(LNI)正则化,进一步提升序列推荐模型的鲁棒性和泛化能力。我们将所提出的模型称为自适应鲁棒序列推荐框架(ADRRec),并通过大量实验证明,该模型优于现有的自注意力架构。

英文摘要:

Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when predicting the next item. In recent literature, it was reported that a multi-dimensional kernel embedding with temporal contextual kernels to capture users' diverse behavioral patterns results in a substantial performance improvement. In this study, we further improve the sequential recommender model's robustness and generalization by introducing a mix-attention mechanism with a layer-wise noise injection (LNI) regularization. We refer to our proposed model as adaptive robust sequential recommendation framework (ADRRec), and demonstrate through extensive experiments that our model outperforms existing self-attention architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑