arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.07272cs.IRcs.LGcs.SE
收藏

RePlay:一款用于实验和生产场景的推荐系统框架

RePlay: a Recommendation Framework for Experimentation and Production Use

Sber AI Lab(Sber AI实验室);Sber(Sber公司)

Alexey Vasilev, Anna Volodkevich, Denis Kulandin, Tatiana Bysheva, Anton Klenitskiy

AI总结:

本研究推出开源推荐框架RePlay,支持Pandas、Polars、Spark多技术栈的端到端推荐流水线,可适配大规模数据与集群部署,助力数据科学家无缝切换研究与生产模式。

摘要:

使用单一工具构建和对比推荐系统,可大幅缩短新模型的上市时间,且此类工具得出的对比结果一致性更强。因此,近期涌现出众多面向推荐领域研究者的工具与库。但遗憾的是,这类框架大多主要面向研究者设计,因无法处理大规模数据集或架构不适配,需经过修改才能投入生产使用。在本次演示中,我们介绍开源工具包RePlay——这一框架包含构建推荐系统的端到端流水线,可直接用于生产场景。RePlay还支持在流水线的每个阶段选用适配的技术栈:Pandas、Polars或Spark,以此实现计算扩展并部署到集群上。综上,RePlay能让数据科学家使用相同接口,轻松从研究模式切换至生产模式。

英文摘要:

Using a single tool to build and compare recommender systems significantly reduces the time to market for new models. In addition, the comparison results when using such tools look more consistent. This is why many different tools and libraries for researchers in the field of recommendations have recently appeared. Unfortunately, most of these frameworks are aimed primarily at researchers and require modification for use in production due to the inability to work on large datasets or an inappropriate architecture. In this demo, we present our open-source toolkit RePlay - a framework containing an end-to-end pipeline for building recommender systems, which is ready for production use. RePlay also allows you to use a suitable stack for the pipeline on each stage: Pandas, Polars, or Spark. This allows the library to scale computations and deploy to a cluster. Thus, RePlay allows data scientists to easily move from research mode to production mode using the same interfaces.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑