arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.02453cs.IRcs.AI
收藏

稀疏与稠密相结合:基于级联稀疏-稠密表示的统一生成式推荐

Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representations

Baidu Inc.(百度公司)

Yuhao Yang, Zhi Ji, Zhaopeng Li, Yi Li, Zhonglin Mo, Yue Ding, Kai Chen, Zijian Zhang, Jie Li, Shuanglong Li, Lin Liu

AI总结:

针对生成式推荐中阶段分离导致的信息损失问题,提出COBRA框架,通过级联交替生成稀疏ID与稠密向量并结合BeamFusion策略,在真实广告平台上显著提升了推荐效果。

摘要:

生成式模型近期在推荐系统中受到关注,它们通过直接从用户交互序列中预测物品标识符来工作。然而,现有方法由于量化和序列建模等阶段的分离,存在显著的信息损失,阻碍了其达到序列稠密检索技术的建模精度和准确性。整合生成式与稠密检索方法仍是一个关键挑战。为此,我们引入了级联组织的双表示生成式检索(Cascaded Organized Bi-Represented generAtive retrieval, COBRA)框架,通过级联过程创新地整合了稀疏语义ID和稠密向量。该方法交替生成这些表示,首先生成稀疏ID,将其作为条件来辅助稠密向量的生成。端到端训练实现了稠密表示的动态优化,捕获了用户-物品交互中的语义洞察和协同信号。在推理阶段,COBRA采用由粗到细的策略,从稀疏ID生成开始,通过生成式模型将其细化为稠密向量。我们进一步提出了BeamFusion,这是一种结合束搜索和最近邻分数的创新方法,旨在增强推理灵活性和推荐多样性。在公开数据集和离线测试上的大量实验验证了该方法的鲁棒性。在拥有超过2亿日活用户的真实广告平台上进行的在线A/B测试表明,关键指标得到了显著提升,凸显了COBRA的实际优势。

英文摘要:

Generative models have recently gained attention in recommendation systems by directly predicting item identifiers from user interaction sequences. However, existing methods suffer from significant information loss due to the separation of stages such as quantization and sequence modeling, hindering their ability to achieve the modeling precision and accuracy of sequential dense retrieval techniques. Integrating generative and dense retrieval methods remains a critical challenge. To address this, we introduce the Cascaded Organized Bi-Represented generAtive retrieval (COBRA) framework, which innovatively integrates sparse semantic IDs and dense vectors through a cascading process. Our method alternates between generating these representations by first generating sparse IDs, which serve as conditions to aid in the generation of dense vectors. End-to-end training enables dynamic refinement of dense representations, capturing both semantic insights and collaborative signals from user-item interactions. During inference, COBRA employs a coarse-to-fine strategy, starting with sparse ID generation and refining them into dense vectors via the generative model. We further propose BeamFusion, an innovative approach combining beam search with nearest neighbor scores to enhance inference flexibility and recommendation diversity. Extensive experiments on public datasets and offline tests validate our method's robustness. Online A/B tests on a real-world advertising platform with over 200 million daily users demonstrate substantial improvements in key metrics, highlighting COBRA's practical advantages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑