arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1504.08175cs.IR
收藏

流媒体环境下推荐系统的评价

Evaluation of recommender systems in streaming environments

João Vinagre, Alípio Mário Jorge, João Gama

摘要:

推荐系统的评估通常是用有限的数据集来完成的。这意味着传统的评估方法仅适用于离线实验,其中数据和模型是固定的。然而,在现实世界的系统中,用户反馈是以不可预测的速率连续生成的。鉴于这种设置,一个重要的问题是如何评估算法在这样的流数据环境。在本文中,我们提出了一个prequential评价协议的推荐系统,适用于流数据环境,但也适用于固定设置。使用该协议,我们能够监控算法准确性随时间的演变。此外,我们能够进行可靠的比较评估的算法,通过计算显著性测试在一个滑动窗口。我们认为,除了适合于流数据,prequential评价允许检测的现象,否则将保持在离线和在线推荐系统的评估中被忽视。

英文摘要:

Evaluation of recommender systems is typically done with finite datasets. This means that conventional evaluation methodologies are only applicable in offline experiments, where data and models are stationary. However, in real world systems, user feedback is continuously generated, at unpredictable rates. Given this setting, one important issue is how to evaluate algorithms in such a streaming data environment. In this paper we propose a prequential evaluation protocol for recommender systems, suitable for streaming data environments, but also applicable in stationary settings. Using this protocol we are able to monitor the evolution of algorithms' accuracy over time. Furthermore, we are able to perform reliable comparative assessments of algorithms by computing significance tests over a sliding window. We argue that besides being suitable for streaming data, prequential evaluation allows the detection of phenomena that would otherwise remain unnoticed in the evaluation of both offline and online recommender systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑