多兴趣细粒度网络用户建模
Multiple Interest and Fine Granularity Network for User Modeling
摘要:
用户建模在工业推荐系统中起着基础性的作用,无论是在匹配阶段还是在排名阶段,无论是在客户体验还是业务收入方面。如何从用户的历史行为序列中有效地提取用户的多种兴趣,以提高推荐结果的相关性和个性化,是用户建模的一个难题。现有的基于深度学习的方法大多利用项目id和类别id,但忽略了颜色和材质等细粒度特征,这阻碍了对用户兴趣的细粒度建模。本文提出了多兴趣细粒度网络模型(Multiple interest and Fine granularity Net-work,MFN),该模型针对用户的多个细粒度兴趣,从用户多个兴趣之间的相似关系和组合关系两个方面进行建模,具体地说,对于相似关系的建模,我们利用了两组嵌入,其中一个是来自预训练模型(例如Glove)的固定嵌入以给出注意力权重,另一个是与MFN一起训练的可训练嵌入。为了对组合关系进行建模,利用自关注层来构建不同兴趣表示的高阶组合。在网络构建中,我们设计了一个兴趣提取模块,利用注意力机制从用户历史行为序列中捕获多种兴趣表征,并利用辅助损失来增强兴趣表征的区分度。然后利用层次网络对不同粒度的多个兴趣向量与目标项之间的注意关系进行建模。我们评估MFNon公共和工业数据集。实验结果表明,所提出的最大似然数表示方法比现有的表示方法具有更好的性能。
英文摘要:
User modeling plays a fundamental role in industrial recommender systems, either in the matching stage and the ranking stage, in terms of both the customer experience and business revenue. How to extract users' multiple interests effectively from their historical behavior sequences to improve the relevance and personalization of the recommend results remains an open problem for user modeling.Most existing deep-learning based approaches exploit item-ids and category-ids but neglect fine-grained features like color and mate-rial, which hinders modeling the fine granularity of users' interests.In the paper, we present Multiple interest and Fine granularity Net-work (MFN), which tackle users' multiple and fine-grained interests and construct the model from both the similarity relationship and the combination relationship among the users' multiple interests.Specifically, for modeling the similarity relationship, we leverage two sets of embeddings, where one is the fixed embedding from pre-trained models (e.g. Glove) to give the attention weights and the other is trainable embedding to be trained with MFN together.For modeling the combination relationship, self-attentive layers are exploited to build the higher order combinations of different interest representations. In the construction of network, we design an interest-extract module using attention mechanism to capture multiple interest representations from user historical behavior sequences and leverage an auxiliary loss to boost the distinction of the interest representations. Then a hierarchical network is applied to model the attention relation between the multiple interest vectors of different granularities and the target item. We evaluate MFNon both public and industrial datasets. The experimental results demonstrate that the proposed MFN achieves superior performance than other existed representing methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。