arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.09078cs.IRcs.AI
收藏

AutoField:深度推荐系统中的自动化特征选择

AutoField: Automating Feature Selection in Deep Recommender Systems

City University of Hong Kong(香港城市大学);University of Science and Technology of China(中国科学技术大学);Tencent Inc(腾讯公司)

Yejing Wang, Xiangyu Zhao, Tong Xu, Xian Wu

摘要:

特征质量对推荐性能有重要影响。因此,特征选择是开发基于深度学习的推荐系统的关键过程。然而,大多数现有的深度推荐系统专注于设计复杂的神经网络,而忽略了特征选择过程。通常情况下,他们只是将所有可能的功能输入到他们提出的深度架构中,或者由人类专家手动选择重要功能。前者会导致非平凡的嵌入参数和额外的推理时间,而后者需要大量的专家知识和人力劳动。在这项工作中,我们提出了一个AutoML框架,可以自适应地选择必要的特征字段,以自动的方式。具体来说,我们首先设计了一个可微分控制器网络,它能够自动调整选择特定特征字段的概率;然后,只使用选定的特征字段来重新训练深度推荐模型。在三个基准数据集上的实验证明了该框架的有效性。我们进行进一步的实验,以研究其属性,包括可转移性,关键组件,和参数的敏感性。

英文摘要:

Feature quality has an impactful effect on recommendation performance. Thereby, feature selection is a critical process in developing deep learning-based recommender systems. Most existing deep recommender systems, however, focus on designing sophisticated neural networks, while neglecting the feature selection process. Typically, they just feed all possible features into their proposed deep architectures, or select important features manually by human experts. The former leads to non-trivial embedding parameters and extra inference time, while the latter requires plenty of expert knowledge and human labor effort. In this work, we propose an AutoML framework that can adaptively select the essential feature fields in an automatic manner. Specifically, we first design a differentiable controller network, which is capable of automatically adjusting the probability of selecting a particular feature field; then, only selected feature fields are utilized to retrain the deep recommendation model. Extensive experiments on three benchmark datasets demonstrate the effectiveness of our framework. We conduct further experiments to investigate its properties, including the transferability, key components, and parameter sensitivity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑