arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.08309cs.IR
收藏

通过基于三种步骤范式的大型用户模型解锁工业推荐系统中的扩展定律

Unlocking Scaling Law in Industrial Recommendation Systems with a Three-step Paradigm based Large User Model

Alibaba Group(阿里巴巴集团)

Bencheng Yan, Shilei Liu, Zhiyuan Zeng, Zihao Wang, Yizhen Zhang, Yujin Yuan, Langming Liu, Jiaqi Liu, Di Wang, Wenbo Su, Wang Pengjie, Jian Xu, Bo Zheng

AI总结:

本文提出一种基于三种步骤范式的大型用户模型,通过解决工业推荐系统中的扩展定律限制,实现了可扩展的推荐性能提升。

摘要:

近期自回归大语言模型(LLMs)的进步取得了显著成就,这主要归功于其可扩展性,通常称为

英文摘要:

Recent advancements in autoregressive Large Language Models (LLMs) have achieved significant milestones, largely attributed to their scalability, often referred to as the "scaling law". Inspired by these achievements, there has been a growing interest in adapting LLMs for Recommendation Systems (RecSys) by reformulating RecSys tasks into generative problems. However, these End-to-End Generative Recommendation (E2E-GR) methods tend to prioritize idealized goals, often at the expense of the practical advantages offered by traditional Deep Learning based Recommendation Models (DLRMs) in terms of in features, architecture, and practices. This disparity between idealized goals and practical needs introduces several challenges and limitations, locking the scaling law in industrial RecSys. In this paper, we introduce a large user model (LUM) that addresses these limitations through a three-step paradigm, designed to meet the stringent requirements of industrial settings while unlocking the potential for scalable recommendations. Our extensive experimental evaluations demonstrate that LUM outperforms both state-of-the-art DLRMs and E2E-GR approaches. Notably, LUM exhibits excellent scalability, with performance improvements observed as the model scales up to 7 billion parameters. Additionally, we have successfully deployed LUM in an industrial application, where it achieved significant gains in an A/B test, further validating its effectiveness and practicality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑