秩无关上下文位置偏差估计
Ranker-agnostic Contextual Position Bias Estimation
摘要:
学习排名(LTR)算法是无处不在的,是探索媒体提供商的广泛目录所必需的。为了避免用户检查所有结果,其首选项用于提供相对较小的子集。如果显式评级不可用,则可以从与所呈现的内容的交互中推断用户偏好。然而,直接使用隐式反馈可能会导致学习错误的相关性模型,被称为有偏见的LTR。隐性反馈和真实关联之间的不匹配是由于各种滋扰,与位置偏见最相关的。位置偏差模型认为,与所呈现的项目缺乏相互作用不仅归因于项目不相关,而且因为项目没有被检查。本文介绍了一种用于对物品在不同上下文中被看到的概率进行建模的方法,例如,对于不同的用户,使用一个估计器。我们建议的方法,表示为上下文(EM)为基础的回归,是排名不可知的,能够正确地学习潜在的检查概率,而只使用隐式反馈。我们的实证结果表明,本文介绍的方法优于其他现有的位置偏差估计的相对误差时,检查概率不同的查询。此外,当用于消除隐式排名数据的偏差时,即使不存在对检查概率的上下文依赖性,估计值也提供排名性能提升。
英文摘要:
Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The user preferences can be inferred from the interactions with the presented content if explicit ratings are unavailable. However, directly using implicit feedback can lead to learning wrong relevance models and is known as biased LTR. The mismatch between implicit feedback and true relevances is due to various nuisances, with position bias one of the most relevant. Position bias models consider that the lack of interaction with a presented item is not only attributed to the item being irrelevant but because the item was not examined. This paper introduces a method for modeling the probability of an item being seen in different contexts, e.g., for different users, with a single estimator. Our suggested method, denoted as contextual (EM)-based regression, is ranker-agnostic and able to correctly learn the latent examination probabilities while only using implicit feedback. Our empirical results indicate that the method introduced in this paper outperforms other existing position bias estimators in terms of relative error when the examination probability varies across queries. Moreover, the estimated values provide a ranking performance boost when used to debias the implicit ranking data even if there is no context dependency on the examination probabilities.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。