arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1209.1983cs.IRcs.PF
收藏

一种新的推荐系统评价协议

Toward a New Protocol to Evaluate Recommender Systems

Frank Meyer, Françoise Fessant, Fabrice Clérot, Eric Gaussier

摘要:

在本文中,我们提出了一种方法来分析的性能和附加值的自动推荐系统在工业背景下。我们表明,推荐系统是多方面的,可以围绕4个结构化功能:帮助用户决定,帮助用户比较,帮助用户发现,帮助用户探索。然后提出了一个全局离线协议来评估推荐系统。该方案基于对上述每个功能的适当评价措施的定义。评价协议的有用性和信任的建议的角度进行了讨论。引入了一种称为平均影响度量的新度量。该度量评估个性化推荐的影响。我们使用两种经典方法,K-最近邻(KNN)和矩阵分解(MF),使用众所周知的数据集:Netflix。提出了用户和项目的分割,以精细地分析算法的表现好或坏。我们表明,性能是强烈依赖于段,并有没有明确的RMSE和推荐的质量之间的相关性。

英文摘要:

In this paper, we propose an approach to analyze the performance and the added value of automatic recommender systems in an industrial context. We show that recommender systems are multifaceted and can be organized around 4 structuring functions: help users to decide, help users to compare, help users to discover, help users to explore. A global off line protocol is then proposed to evaluate recommender systems. This protocol is based on the definition of appropriate evaluation measures for each aforementioned function. The evaluation protocol is discussed from the perspective of the usefulness and trust of the recommendation. A new measure called Average Measure of Impact is introduced. This measure evaluates the impact of the personalized recommendation. We experiment with two classical methods, K-Nearest Neighbors (KNN) and Matrix Factorization (MF), using the well known dataset: Netflix. A segmentation of both users and items is proposed to finely analyze where the algorithms perform well or badly. We show that the performance is strongly dependent on the segments and that there is no clear correlation between the RMSE and the quality of the recommendation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑