arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.14945cs.LGcs.IR
收藏

用户分割的自适应学习:通过二分神经交互实现从通用到特定的表示

Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction

INF Technology (Shanghai) Co., Ltd(INF科技(上海)有限公司);Shanghai University of Engineering Science(上海工程技术大学);Ant Group(蚂蚁集团)

Xiaoyu Tan, Yongxin Deng, Chao Qu, Siqiao Xue, Xiaoming Shi, James Zhang, Xihe Qiu

AI总结:

提出一种通过信息瓶颈和二分图神经交互的自适应学习框架,实现从通用到用户分割特定的表示学习,显著提升CTR/CVR预测性能。

摘要:

近期,用户表示学习模型已广泛应用于点击率(CTR)和转化率(CVR)预测中。通常,模型会学习一个通用的用户表示,作为后续特定场景模型的输入。然而,在众多工业应用(例如推荐和营销)中,业务总是将这些应用作为不同用户分割之间的各种在线活动来运营。这些分割通常由领域专家创建。由于用户分布(即用户分割)和后续任务中的业务目标存在差异,仅基于通用表示进行学习可能会对模型性能和鲁棒性产生不利影响。在本文中,我们提出了一种新颖的学习框架,该框架首先通过信息瓶颈学习通用的用户表示。然后,通过神经交互合并并学习分割特定或任务特定的表示。我们利用二分图架构设计交互学习过程,以建模上下文集群与每个用户分割之间的表示学习和合并。我们提出的方法在两个开源基准、两个离线业务数据集上进行了评估,并部署在两个在线营销应用中以预测用户的CVR。结果表明,我们的方法能够实现卓越的性能并超越基线方法。

英文摘要:

Recently, models for user representation learning have been widely applied in click-through-rate (CTR) and conversion-rate (CVR) prediction. Usually, the model learns a universal user representation as the input for subsequent scenario-specific models. However, in numerous industrial applications (e.g., recommendation and marketing), the business always operates such applications as various online activities among different user segmentation. These segmentation are always created by domain experts. Due to the difference in user distribution (i.e., user segmentation) and business objectives in subsequent tasks, learning solely on universal representation may lead to detrimental effects on both model performance and robustness. In this paper, we propose a novel learning framework that can first learn general universal user representation through information bottleneck. Then, merge and learn a segmentation-specific or a task-specific representation through neural interaction. We design the interactive learning process by leveraging a bipartite graph architecture to model the representation learning and merging between contextual clusters and each user segmentation. Our proposed method is evaluated in two open-source benchmarks, two offline business datasets, and deployed on two online marketing applications to predict users' CVR. The results demonstrate that our method can achieve superior performance and surpass the baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑