arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.00247cs.IR
收藏

简单但高效:淘宝推荐的多场景近线检索框架

Simple but Efficient: A Multi-Scenario Nearline Retrieval Framework for Recommendation on Taobao

Yingcai Ma, Ziyang Wang, Yuliang Yan, Jian Wu, Yuning Jiang, Longbin Li, Wen Chen, Jianhang Huang

AI总结:

本文提出一种基于 Flink 的多场景近线检索框架,将其他场景的精细排序结果近实时引入匹配阶段,并在淘宝首页实现商品成交额提升 5%。

摘要:

在推荐系统中,匹配阶段正变得越来越关键,它是整个推荐流程的上限。最近,一些研究开始探索利用多场景信息进行推荐,例如基于模型和基于数据的方法。然而,匹配阶段面临巨大挑战,因为它需要超大规模检索并满足低延迟要求。因此,该阶段所采用的方法(协同过滤和双塔模型)通常被设计得较为轻量,这阻碍了对广泛信息的充分利用。另一方面,排序阶段拥有最复杂的模型和最强的打分能力,但由于移动设备屏幕尺寸有限,大部分排序结果可能无法获得曝光或被展示。在本文中,我们引入了一个创新的多场景近线检索框架。它通过 Flink 利用来自不同场景的排序日志,使我们能够将近实时的其他场景的精细排序结果纳入匹配阶段。此外,我们提出了一个流式打分模块,该模块从候选池中筛选出一个关键子集。该方法已在中国顶级电商平台“猜你喜欢”(淘宝 APP 首页)上实现,并显示出显著改进——最值得注意的是,商品成交额提升了 5%。此外,所提出的方法不仅不依赖模型,而且效率很高,表明它可以快速部署到不同场景中并展现出良好的性能。

英文摘要:

In recommendation systems, the matching stage is becoming increasingly critical, serving as the upper limit for the entire recommendation process. Recently, some studies have started to explore the use of multi-scenario information for recommendations, such as model-based and data-based approaches. However, the matching stage faces significant challenges due to the need for ultra-large-scale retrieval and meeting low latency requirements. As a result, the methods applied at this stage (collaborative filtering and two-tower models) are often designed to be lightweight, hindering the full utilization of extensive information. On the other hand, the ranking stage features the most sophisticated models with the strongest scoring capabilities, but due to the limited screen size of mobile devices, most of the ranked results may not gain exposure or be displayed. In this paper, we introduce an innovative multi-scenario nearline retrieval framework. It operates by harnessing ranking logs from various scenarios through Flink, allowing us to incorporate finely ranked results from other scenarios into our matching stage in near real-time. Besides, we propose a streaming scoring module, which selects a crucial subset from the candidate pool. Implemented on the "Guess You Like" (homepage of the Taobao APP), China's premier e-commerce platform, our method has shown substantial improvements-most notably, a 5% uptick in product transactions. Furthermore, the proposed approach is not only model-free but also highly efficient, suggesting it can be quickly implemented in diverse scenarios and demonstrate promising performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑