arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.13091cs.IRcs.ITmath.IT
收藏

Top-N推荐中的可预测性限制

Limits of Predictability in Top-N Recommendation

En Xu, Zhiwen Yu, Ying Zhang, Bin Guo, Lina Yao

摘要:

Top-N推荐的目的是从一个大的项目集合中向每个消费者推荐一个由N个项目组成的小集合,其准确率是评价推荐系统性能的最常用指标之一。虽然提出了大量的算法来通过从用户的历史购买数据中学习用户偏好来推动Top-N准确度,但自然会提出一个可预测性问题-是否存在这种Top-N准确度的上限。这项工作通过研究一组特定的用户行为数据的规律性程度来研究这种可预测性。量化前N个推荐的可预测性需要同时量化具有最高概率的N个行为的准确性的限制。这大大增加了问题的难度。为此,首先挖掘出N个行为之间概率最大的关联,并基于信息论描述用户行为分布。然后,我们采用Fano不等式进行标度,得到Top-N可预测性。对真实世界的数据进行了大量的实验,与最先进的方法相比,观察到了显着的改进。我们不仅完成了对N个目标的可预报性计算,而且得到了比现有方法更接近真实值的可预报性。我们希望我们的研究结果,以帮助这些研究领域的定量要求的Top-N的可预测性是必需的。

英文摘要:

Top-N recommendation aims to recommend each consumer a small set of N items from a large collection of items, and its accuracy is one of the most common indexes to evaluate the performance of a recommendation system. While a large number of algorithms are proposed to push the Top-N accuracy by learning the user preference from their history purchase data, a predictability question is naturally raised - whether there is an upper limit of such Top-N accuracy. This work investigates such predictability by studying the degree of regularity from a specific set of user behavior data. Quantifying the predictability of Top-N recommendations requires simultaneously quantifying the limits on the accuracy of the N behaviors with the highest probability. This greatly increases the difficulty of the problem. To achieve this, we firstly excavate the associations among N behaviors with the highest probability and describe the user behavior distribution based on the information theory. Then, we adopt the Fano inequality to scale and obtain the Top-N predictability. Extensive experiments are conducted on the real-world data where significant improvements are observed compared to the state-of-the-art methods. We have not only completed the predictability calculation for N targets but also obtained predictability that is much closer to the true value than existing methods. We expect our results to assist these research areas where the quantitative requirement of Top-N predictability is required.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑