arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2602.08575cs.IR
收藏

RankGR: 基于列表级直接偏好优化的排名增强生成检索用于推荐

RankGR: Rank-Enhanced Generative Retrieval with Listwise Direct Preference Optimization in Recommendation

Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团)

Kairui Fu, Changfa Wu, Kun Yuan, Binbin Cao, Dunxian Huang, Yuliang Yan, Junjun Zheng, Jianning Zhang, Silu Zhou, Jian Wu, Kun Kuang

AI总结:

RankGR通过列表级直接偏好优化提升生成检索的推荐效果,实现更精确的用户偏好建模和高效候选评估。

摘要:

生成检索(GR)通过自回归解码目标物品的标识符,在推荐系统中 emerged 为一种有前景的范式。尽管其潜力,当前方法通常依赖于下一个令牌预测模式,将下一个互动物品的每个令牌视为唯一目标。这种狭窄的关注1) 限制了它们捕捉用户偏好细微结构的能力,2) 忽视了解码标识符与用户行为序列之间的深层交互。为应对这些挑战,我们提出了RankGR,一种基于列表级直接偏好优化的生成检索方法,用于推荐。RankGR将检索过程分解为两个互补的阶段:初始评估阶段(IAP)和精细评分阶段(RSP)。在IAP中,我们将一种新的列表级直接偏好优化策略融入GR,从而促进对层次用户偏好的更全面理解以及更有效的偏序建模。RSP然后利用轻量级评分模块,通过与输入序列的交互来细化IAP生成的前λ候选者,从而获得更精确的候选评估。两个阶段在统一的GR模型下联合优化,确保一致性和效率。此外,我们还在训练和部署中实施了若干实用改进,最终实现了一个能够每秒处理近一万次请求的实时系统。在研究和工业数据集上的广泛离线性能,以及在淘宝“Guess You Like”部分的在线收益,验证了RankGR的有效性和可扩展性。

英文摘要:

Generative retrieval (GR) has emerged as a promising paradigm in recommendation systems by autoregressively decoding identifiers of target items. Despite its potential, current approaches typically rely on the next-token prediction schema, which treats each token of the next interacted items as the sole target. This narrow focus 1) limits their ability to capture the nuanced structure of user preferences, and 2) overlooks the deep interaction between decoded identifiers and user behavior sequences. In response to these challenges, we propose RankGR, a Rank-enhanced Generative Retrieval method that incorporates listwise direct preference optimization for recommendation. RankGR decomposes the retrieval process into two complementary stages: the Initial Assessment Phase (IAP) and the Refined Scoring Phase (RSP). In IAP, we incorporate a novel listwise direct preference optimization strategy into GR, thus facilitating a more comprehensive understanding of the hierarchical user preferences and more effective partial-order modeling. The RSP then refines the top-λ candidates generated by IAP with interactions towards input sequences using a lightweight scoring module, leading to more precise candidate evaluation. Both phases are jointly optimized under a unified GR model, ensuring consistency and efficiency. Additionally, we implement several practical improvements in training and deployment, ultimately achieving a real-time system capable of handling nearly ten thousand requests per second. Extensive offline performance on both research and industrial datasets, as well as the online gains on the "Guess You Like" section of Taobao, validate the effectiveness and scalability of RankGR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑