arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.13631cs.IR
收藏

GEMs: 通过多流解码器打破生成推荐中的长序列障碍

GEMs: Breaking the Long-Sequence Barrier in Generative Recommendation with a Multi-Stream Decoder

Kuaishou Inc.(快手公司)

Yu Zhou, Chengcheng Guo, Kuo Cai, Ji Liu, Qiang Luo, Ruiming Tang, Han Li, Kun Gai, Guorui Zhou

AI总结:

GEMs通过多流解码器框架,有效解决生成推荐中长序列处理难题,提升推荐准确性和推理效率。

摘要:

尽管生成推荐(GR)具有强大的序列推理能力,但处理极长的用户行为序列时面临显著挑战:高计算成本迫使实际序列长度受限,阻碍模型捕捉用户终身兴趣;同时,注意力机制固有的"近期偏见"进一步削弱了从长期历史中学习的能力。为克服这一瓶颈,我们提出了GEMs(生成推荐的多流解码器),一种新颖且统一的框架,旨在通过多流视角捕捉用户的终身交互序列来打破长序列障碍。具体而言,GEMs将用户行为分为三个时间流——近期、中期和生命周期,并为每个流采用定制的推理方案:一个单阶段实时提取器用于即时动态,一个轻量级索引器用于交叉注意力以在准确性和成本之间取得平衡,以及一个两阶段离线-在线压缩模块用于终身建模。这些流通过无参数融合策略整合,以实现整体兴趣表示。在大规模工业数据集上的广泛实验表明,GEMs在推荐准确性上显著优于最先进的方法。值得注意的是,GEMs是首个成功部署在高并发工业环境中的终身GR框架,实现了在处理超过100,000次交互的用户序列时的优越推理效率。

英文摘要:

While generative recommendations (GR) possess strong sequential reasoning capabilities, they face significant challenges when processing extremely long user behavior sequences: the high computational cost forces practical sequence lengths to be limited, preventing models from capturing users' lifelong interests; meanwhile, the inherent "recency bias" of attention mechanisms further weakens learning from long-term history. To overcome this bottleneck, we propose GEMs (Generative rEcommendation with a Multi-stream decoder), a novel and unified framework designed to break the long-sequence barrier by capturing users' lifelong interaction sequences through a multi-stream perspective. Specifically, GEMs partitions user behaviors into three temporal streams$\unicode{x2014}$Recent, Mid-term, and Lifecycle$\unicode{x2014}$and employs tailored inference schemes for each: a one-stage real-time extractor for immediate dynamics, a lightweight indexer for cross attention to balance accuracy and cost for mid-term sequences, and a two-stage offline-online compression module for lifelong modeling. These streams are integrated via a parameter-free fusion strategy to enable holistic interest representation. Extensive experiments on large-scale industrial datasets demonstrate that GEMs significantly outperforms state-of-the-art methods in recommendation accuracy. Notably, GEMs is the first lifelong GR framework successfully deployed in a high-concurrency industrial environment, achieving superior inference efficiency while processing user sequences of over 100,000 interactions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑