arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.03276cs.LGcs.AIcs.IRstat.ML
收藏

自适应因子分解网络:学习自适应顺序特征交互

Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions

Shanghai Jiao Tong University(上海交通大学)

Weiyu Cheng, Yanyan Shen, Linpeng Huang

摘要:

已经提出了各种基于因子分解的方法来利用二阶或高阶交叉特征来提高预测模型的性能。它们通常在预定义的最大阶数下枚举所有交叉特征,然后通过模型训练来识别有用的特征交互,这具有两个缺点。首先,他们必须在高阶交叉特征的表达能力和计算成本之间做出权衡,从而导致次优预测。其次,枚举所有交叉特征,包括不相关的特征,可能会引入噪声特征组合,降低模型性能。在这项工作中,我们提出了自适应因子分解网络(AFN),一个新的模型,学习任意阶交叉功能自适应数据。AFN的核心是对数转换层,将特征组合中每个特征的功率转换为要学习的系数。在四个真实数据集上的实验结果证明了AFN对最新技术的优越预测性能。

英文摘要:

Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum order, and then identify useful feature interactions through model training, which suffer from two drawbacks. First, they have to make a trade-off between the expressiveness of higher-order cross features and the computational cost, resulting in suboptimal predictions. Second, enumerating all the cross features, including irrelevant ones, may introduce noisy feature combinations that degrade model performance. In this work, we propose the Adaptive Factorization Network (AFN), a new model that learns arbitrary-order cross features adaptively from data. The core of AFN is a logarithmic transformation layer to convert the power of each feature in a feature combination into the coefficient to be learned. The experimental results on four real datasets demonstrate the superior predictive performance of AFN against the start-of-the-arts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑