arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.05490cs.LG
收藏

面向时序集合预测的连续时间用户偏好建模

Continuous-Time User Preference Modelling for Temporal Sets Prediction

Beihang University(北京航空航天大学);the University of Tennessee(田纳西大学)

Le Yu, Zihang Liu, Leilei Sun, Bowen Du, Chuanren Liu, Weifeng Lv

AI总结:

针对时序集合预测中用户偏好演化捕捉不足的问题,提出带记忆库的连续时间用户偏好建模框架,结合个性化行为学习与集合批处理算法,在多数据集上实现性能与效率提升。

摘要:

给定一组集合序列(每个集合带有时间戳且包含任意数量的元素),时序集合预测旨在预测下一个集合中的元素。现有时序集合预测研究主要聚焦于元素建模,并基于用户交互过的元素隐式表征其偏好。然而,用户偏好通常处于持续演化状态,这种用户偏好的间接学习范式无法充分捕捉其演化趋势。为此,我们提出一种面向时序集合预测的连续时间用户偏好建模框架,通过维护一个存储所有用户与元素状态的记忆库,显式建模每个用户的演化偏好。具体而言,我们首先将所有用户-集合交互按时间非降序排列,构建一条全局序列,随后按时间顺序从每个用户-集合交互中学习。针对每一次交互,我们基于相关用户与元素的当前编码消息及历史记忆,持续更新二者的记忆状态。此外,我们提出个性化用户行为学习模块,基于每个用户的历史序列挖掘用户专属特征,该模块从用户与元素双重视角聚合过往交互过的元素。最后,我们设计了集合批处理算法以提升模型效率,该算法可预先生成时间一致的批次,在训练与评估阶段平均分别实现3.5倍与3.0倍的加速。在四个真实世界数据集上的实验表明,我们的方法在直推式与归纳式两种设置下均优于现有最优方法,同时该方法具备良好的可解释性。

英文摘要:

Given a sequence of sets, where each set has a timestamp and contains an arbitrary number of elements, temporal sets prediction aims to predict the elements in the subsequent set. Previous studies for temporal sets prediction mainly focus on the modelling of elements and implicitly represent each user's preference based on his/her interacted elements. However, user preferences are often continuously evolving and the evolutionary trend cannot be fully captured with the indirect learning paradigm of user preferences. To this end, we propose a continuous-time user preference modelling framework for temporal sets prediction, which explicitly models the evolving preference of each user by maintaining a memory bank to store the states of all the users and elements. Specifically, we first construct a universal sequence by arranging all the user-set interactions in a non-descending temporal order, and then chronologically learn from each user-set interaction. For each interaction, we continuously update the memories of the related user and elements based on their currently encoded messages and past memories. Moreover, we present a personalized user behavior learning module to discover user-specific characteristics based on each user's historical sequence, which aggregates the previously interacted elements from dual perspectives according to the user and elements. Finally, we develop a set-batch algorithm to improve the model efficiency, which can create time-consistent batches in advance and achieve 3.5x and 3.0x speedups in the training and evaluation process on average. Experiments on four real-world datasets demonstrate the superiority of our approach over state-of-the-arts under both transductive and inductive settings. The good interpretability of our method is also shown.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑