FinalMLP:一种用于CTR预测的增强型双流MLP模型
FinalMLP: An Enhanced Two-Stream MLP Model for CTR Prediction
AI总结:
本文发现简单组合两个MLP的双流模型即可取得优异CTR预测性能,进而提出FinalMLP,通过特征门控和交互聚合层增强双流MLP,在多个基准和在线A/B测试中超越复杂双流CTR模型。
摘要:
点击率(CTR)预测是在线广告和推荐系统的基础任务之一。虽然多层感知机(MLP)是许多深度CTR预测模型的核心组件,但人们普遍认识到,仅使用普通的MLP网络在学习乘法特征交互方面效率较低。因此,许多双流交互模型(如DeepFM和DCN)被提出,通过将MLP网络与另一个专用网络集成来增强CTR预测。由于MLP流隐式地学习特征交互,现有研究主要侧重于增强互补流中的显式特征交互。相比之下,我们的实证研究表明,一个经过良好调优的双流MLP模型,即简单地组合两个MLP,甚至可以取得令人惊讶的良好性能,这一点在现有工作中从未被报道过。基于这一观察,我们进一步提出了特征门控和交互聚合层,它们可以很容易地插入以构建增强型双流MLP模型FinalMLP。通过这种方式,它不仅能够实现差异化的特征输入,还能有效地融合两个流之间的流级交互。我们在四个公开基准数据集上的评估结果以及在我们工业系统中进行的在线A/B测试表明,FinalMLP比许多复杂的双流CTR模型取得了更好的性能。我们的源代码将在MindSpore/models上提供。
英文摘要:
Click-through rate (CTR) prediction is one of the fundamental tasks for online advertising and recommendation. While multi-layer perceptron (MLP) serves as a core component in many deep CTR prediction models, it has been widely recognized that applying a vanilla MLP network alone is inefficient in learning multiplicative feature interactions. As such, many two-stream interaction models (e.g., DeepFM and DCN) have been proposed by integrating an MLP network with another dedicated network for enhanced CTR prediction. As the MLP stream learns feature interactions implicitly, existing research focuses mainly on enhancing explicit feature interactions in the complementary stream. In contrast, our empirical study shows that a well-tuned two-stream MLP model that simply combines two MLPs can even achieve surprisingly good performance, which has never been reported before by existing work. Based on this observation, we further propose feature gating and interaction aggregation layers that can be easily plugged to make an enhanced two-stream MLP model, FinalMLP. In this way, it not only enables differentiated feature inputs but also effectively fuses stream-level interactions across two streams. Our evaluation results on four open benchmark datasets as well as an online A/B test in our industrial system show that FinalMLP achieves better performance than many sophisticated two-stream CTR models. Our source code will be available at MindSpore/models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。