arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.14827cs.IR
收藏

用于推荐的存储高效嵌入

Memory-efficient Embedding for Recommendations

Xiangyu Zhao, Haochen Liu, Hui Liu, Jiliang Tang, Weiwei Guo, Jun Shi, Sida Wang, Huiji Gao, Bo Long

摘要:

实际的大规模推荐系统通常包含来自用户、项目、上下文信息及其交互的数千个特征字段。他们中的大多数经验分配一个统一的维度,所有的特征字段,这是内存效率低下。因此,它是非常希望分配不同的嵌入维度不同的特征字段根据其重要性和可预测性。由于大量的特征字段和嵌入维数与特征分布和神经网络架构之间的微妙关系,在实际推荐系统中手动分配嵌入维数可能非常困难。为此,我们提出了一个AutoML为基础的框架(AutoDim)在本文中,它可以自动选择尺寸为不同的特征字段中的数据驱动的方式。具体来说,我们首先提出了一个端到端的可微框架,可以计算的权重在各种维度的特征字段在软和连续的方式与AutoML为基础的优化算法;然后,我们推导出一个硬和离散嵌入组件架构根据最大的权重和重新训练整个推荐框架。我们在基准数据集上进行了大量的实验,以验证AutoDim框架的有效性。

英文摘要:

Practical large-scale recommender systems usually contain thousands of feature fields from users, items, contextual information, and their interactions. Most of them empirically allocate a unified dimension to all feature fields, which is memory inefficient. Thus it is highly desired to assign different embedding dimensions to different feature fields according to their importance and predictability. Due to the large amounts of feature fields and the nuanced relationship between embedding dimensions with feature distributions and neural network architectures, manually allocating embedding dimensions in practical recommender systems can be very difficult. To this end, we propose an AutoML based framework (AutoDim) in this paper, which can automatically select dimensions for different feature fields in a data-driven fashion. Specifically, we first proposed an end-to-end differentiable framework that can calculate the weights over various dimensions for feature fields in a soft and continuous manner with an AutoML based optimization algorithm; then we derive a hard and discrete embedding component architecture according to the maximal weights and retrain the whole recommender framework. We conduct extensive experiments on benchmark datasets to validate the effectiveness of the AutoDim framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑