arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.07102cs.IR
收藏

基于递归对数双线性模型的多行为序列预测

Multi-behavioral Sequential Prediction with Recurrent Log-bilinear Model

Qiang Liu, Shu Wu, Liang Wang

摘要:

随着互联网应用的快速发展,协同过滤中的顺序预测已经成为一个新兴的和关键的任务。鉴于特定用户的行为历史,预测他或她的下一个选择在改善各种在线服务方面起着关键作用。同时,具有多种行为类型的场景越来越多,而现有的工作主要研究具有单一行为类型的序列。马尔可夫链模型作为一种广泛使用的方法,是基于一个强的独立性假设。作为两种经典的神经网络序列建模方法,递归神经网络不能很好地建模短期上下文,对数双线性模型不适合长期上下文。在本文中,我们提出了一个递归对数双线性(RLBL)模型。它可以用特定于行为的转换矩阵对历史序列中的多种类型的行为进行建模。RLBL应用递归结构来建模长期上下文。它对每个隐藏层中的多个项进行建模,并采用特定于位置的转换矩阵来对短期上下文进行建模。此外,考虑到行为历史中的连续时间差是动态预测的关键因素,我们进一步扩展了RLBL,用时间特定的转移矩阵代替位置特定的转移矩阵,从而提出了时间感知的递归对数双线性(TA-RLBL)模型。实验结果表明,在三个数据集上,所提出的RLBL模型和TA-RLBL模型比竞争性比较方法有显著的改进,Movielens-1 M数据集,全球恐怖主义数据库和天猫数据集,具有不同数量的行为类型。

英文摘要:

With the rapid growth of Internet applications, sequential prediction in collaborative filtering has become an emerging and crucial task. Given the behavioral history of a specific user, predicting his or her next choice plays a key role in improving various online services. Meanwhile, there are more and more scenarios with multiple types of behaviors, while existing works mainly study sequences with a single type of behavior. As a widely used approach, Markov chain based models are based on a strong independence assumption. As two classical neural network methods for modeling sequences, recurrent neural networks cannot well model short-term contexts, and the log-bilinear model is not suitable for long-term contexts. In this paper, we propose a Recurrent Log-BiLinear (RLBL) model. It can model multiple types of behaviors in historical sequences with behavior-specific transition matrices. RLBL applies a recurrent structure for modeling long-term contexts. It models several items in each hidden layer and employs position-specific transition matrices for modeling short-term contexts. Moreover, considering continuous time difference in behavioral history is a key factor for dynamic prediction, we further extend RLBL and replace position-specific transition matrices with time-specific transition matrices, and accordingly propose a Time-Aware Recurrent Log-BiLinear (TA-RLBL) model. Experimental results show that the proposed RLBL model and TA-RLBL model yield significant improvements over the competitive compared methods on three datasets, i.e., Movielens-1M dataset, Global Terrorism Database and Tmall dataset with different numbers of behavior types.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑