arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.15005cs.CLcs.IR
收藏

通过推理和蒸馏学习用户兴趣以实现跨领域新闻推荐

Learning User Interests via Reasoning and Distillation for Cross-Domain News Recommendation

Microsoft(微软公司);Emory University(埃默里大学)

Mengdan Zhu, Yufan Zhao, Tao Di, Yulan Yan, Liang Zhao

AI总结:

本文提出通过推理和蒸馏学习用户兴趣的方法,提升跨领域新闻推荐的性能和可扩展性。

摘要:

新闻推荐在在线新闻平台中发挥着关键作用,通过帮助用户发现相关内容。跨领域新闻推荐进一步需要从异构信号中推断用户的潜在信息需求,这些信号往往超出了直接新闻消费的范围。一个关键挑战在于在大规模生产系统中保持可扩展性的同时,超越表面行为以捕捉更深层次、可重用的用户兴趣。在本文中,我们提出了一种强化学习框架,用于训练大型语言模型生成高质量的兴趣驱动新闻搜索查询列表,这些查询来源于跨领域的用户信号。我们将查询列表生成问题建模为一个策略优化问题,并采用GRPO结合多个奖励信号。我们系统地研究了两个计算维度:推理时间采样和模型容量,并实证观察到随着计算资源的增加,性能表现出一致的提升,呈现出缩放行为。最后,我们进行在线策略蒸馏,将从大型、计算密集型教师模型中学习到的策略转移到一个适合可扩展部署的紧凑学生模型中。广泛的离线实验、消融研究以及在生产新闻推荐系统中的大规模在线A/B测试证明了在兴趣建模质量和下游推荐性能方面的一致提升。

英文摘要:

News recommendation plays a critical role in online news platforms by helping users discover relevant content. Cross-domain news recommendation further requires inferring user's underlying information needs from heterogeneous signals that often extend beyond direct news consumption. A key challenge lies in moving beyond surface-level behaviors to capture deeper, reusable user interests while maintaining scalability in large-scale production systems. In this paper, we present a reinforcement learning framework that trains large language models to generate high-quality lists of interest-driven news search queries from cross-domain user signals. We formulate query-list generation as a policy optimization problem and employ GRPO with multiple reward signals. We systematically study two compute dimensions: inference-time sampling and model capacity, and empirically observe consistent improvements with increased compute that exhibit scaling-like behavior. Finally, we perform on-policy distillation to transfer the learned policy from a large, compute-intensive teacher to a compact student model suitable for scalable deployment. Extensive offline experiments, ablation studies and large-scale online A/B tests in a production news recommendation system demonstrate consistent gains in both interest modeling quality and downstream recommendation performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑