arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.21209cs.IR
收藏

基于互信息的多场景推荐分解参数生成网络:MI-DPG

MI-DPG: Decomposable Parameter Generation Network Based on Mutual Information for Multi-Scenario Recommendation

Ant Group(蚂蚁集团)

Wenzhuo Cheng, Ke Ding, Xin Dong, Yong He, Liang Zhang, Linjian Mo

AI总结:

MI-DPG通过分解参数生成场景特定权重矩阵,提升多场景推荐预测性能,引入互信息正则化增强参数多样性。

摘要:

转换率(CVR)预测模型在推荐和广告系统中起关键作用。最近多场景推荐研究显示,学习统一模型可提升整体性能。然而,如何在低模型参数成本下提升跨场景预测性能仍具挑战,现有方法难以稳健建模多场景多样性。本文提出MI-DPG用于多场景CVR预测,通过学习每个场景的场景条件动态模型参数,以更高效有效的方式进行。具体而言,我们引入辅助网络生成场景条件动态加权矩阵,该矩阵通过结合分解的场景特定和场景共享低秩矩阵并利用参数效率获得。对每个场景,通过加权矩阵加权骨干模型参数,有助于为不同场景专门化模型参数。这不仅能调节骨干模型的完整参数空间,还能提升模型有效性。此外,我们设计了互信息正则化,通过最大化场景感知输入与场景条件动态加权矩阵之间的互信息,增强不同场景间的参数多样性。实验表明,MI-DPG在三个真实世界数据集上显著优于先前的多场景推荐模型。

英文摘要:

Conversion rate (CVR) prediction models play a vital role in recommendation and advertising systems. Recent research on multi-scenario recommendation shows that learning a unified model to serve multiple scenarios is effective for improving overall performance. However, it remains challenging to improve model prediction performance across scenarios at low model parameter cost, and current solutions are hard to robustly model multi-scenario diversity. In this paper, we propose MI-DPG for the multi-scenario CVR prediction, which learns scenario-conditioned dynamic model parameters for each scenario in a more efficient and effective manner. Specifically, we introduce an auxiliary network to generate scenario-conditioned dynamic weighting matrices, which are obtained by combining decomposed scenario-specific and scenario-shared low-rank matrices with parameter efficiency. For each scene, weighting the backbone model parameters by the weighting matrix helps to specialize the model parameters for different scenarios. It can not only modulate the complete parameter space of the backbone model but also improve the model effectiveness. Furthermore, we design a mutual information regularization to enhance the diversity of model parameters across different scenarios by maximizing the mutual information between the scenario-aware input and the scene-conditioned dynamic weighting matrix. Experiments from three real-world datasets show that MI-DPG significantly outperforms previous multi-scenario recommendation models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑