arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.02095cs.IR
收藏

神经交互式协同过滤

Neural Interactive Collaborative Filtering

Lixin Zou, Long Xia, Yulong Gu, Xiangyu Zhao, Weidong Liu, Jimmy Xiangji Huang, Dawei Yin

摘要:

在本文中,我们研究了协同过滤在一个互动的设置,其中的推荐代理之间进行推荐和更新的用户简档的互动反馈的基础上。在这种情况下最具挑战性的问题是当用户简档还没有很好地建立时如何建议项目,即,推荐冷启动用户或热启动用户与口味漂移。现有的方法要么依赖于过于悲观的线性探索策略,要么采用基于元学习的算法,以充分利用的方式。在这项工作中,为了快速赶上用户的兴趣,我们建议用神经网络来表示探索策略,并直接从反馈数据中学习。具体地说,探索策略被编码在多通道堆叠自注意神经网络的权重中,并通过最大化推荐系统中用户的总体满意度来进行有效的Q学习训练。关键的见解是,由探索推荐触发的满意推荐可以被视为探索奖励(延迟奖励),以表彰其对提高用户简档质量的贡献。因此,为了在学习用户简档和做出准确推荐之间取得平衡,所提出的探索策略可以通过最大化用户对强化学习的长期满意度来直接优化。在三个基准协同过滤数据集上进行的大量实验和分析表明,我们的方法优于最先进的方法。

英文摘要:

In this paper, we study collaborative filtering in an interactive setting, in which the recommender agents iterate between making recommendations and updating the user profile based on the interactive feedback. The most challenging problem in this scenario is how to suggest items when the user profile has not been well established, i.e., recommend for cold-start users or warm-start users with taste drifting. Existing approaches either rely on overly pessimistic linear exploration strategy or adopt meta-learning based algorithms in a full exploitation way. In this work, to quickly catch up with the user's interests, we propose to represent the exploration policy with a neural network and directly learn it from the feedback data. Specifically, the exploration policy is encoded in the weights of multi-channel stacked self-attention neural networks and trained with efficient Q-learning by maximizing users' overall satisfaction in the recommender systems. The key insight is that the satisfied recommendations triggered by the exploration recommendation can be viewed as the exploration bonus (delayed reward) for its contribution on improving the quality of the user profile. Therefore, the proposed exploration policy, to balance between learning the user profile and making accurate recommendations, can be directly optimized by maximizing users' long-term satisfaction with reinforcement learning. Extensive experiments and analysis conducted on three benchmark collaborative filtering datasets have demonstrated the advantage of our method over state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑