arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.09512cs.LGcs.IRstat.CO
收藏

基于项目位置模型和基于位置模型插值的学习排序离政策评价

Off-policy evaluation for learning-to-rank via interpolating the item-position model and the position-based model

Amazon Music ML(亚马逊音乐机器学习部门);Cornell University(康奈尔大学)

Alexander Buchholz, Ben London, Giuseppe di Benedetto, Thorsten Joachims

摘要:

工业推荐系统的一个关键需求是在将推荐策略部署到生产环境之前离线评估推荐策略的能力。不幸的是,广泛使用的政策外评估方法要么对用户的行为做出强烈的假设,这可能导致过度的偏见,要么他们做出较少的假设,并遭受较大的方差。我们通过开发一种新的估计器来解决这个问题,该估计器缓解了两种最流行的排名策略估计器的问题,即基于位置的模型和项目位置模型。特别是,新的估计,称为国际刑警组织,解决了一个潜在的错误指定的基于位置的模型的偏差,同时提供了一个适应性的偏差方差权衡相比,项目位置模型。我们提供的理论论据以及实证结果,突出了我们的新的估计方法的性能。

英文摘要:

A critical need for industrial recommender systems is the ability to evaluate recommendation policies offline, before deploying them to production. Unfortunately, widely used off-policy evaluation methods either make strong assumptions about how users behave that can lead to excessive bias, or they make fewer assumptions and suffer from large variance. We tackle this problem by developing a new estimator that mitigates the problems of the two most popular off-policy estimators for rankings, namely the position-based model and the item-position model. In particular, the new estimator, called INTERPOL, addresses the bias of a potentially misspecified position-based model, while providing an adaptable bias-variance trade-off compared to the item-position model. We provide theoretical arguments as well as empirical results that highlight the performance of our novel estimation approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑