arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1204.1832cs.IRcs.PF
收藏

竞争性群体推荐系统的数学建模及其在同行评议系统中的应用

Mathematical Modeling of Competitive Group Recommendation Systems with Application to Peer Review Systems

Hong Xie, John C. S. Lui

摘要:

在本文中,我们提出了一个数学模型来捕捉各种因素,可能会影响竞争群体推荐系统的准确性。我们将此模型应用于同行评审系统,即,会议或研究资助审查,这是我们科学界的一个重要组成部分。我们探讨了一些重要的问题,即,每篇论文的评论数量如何影响整体推荐的准确性?评分汇总政策是否会影响最终推荐?评审员的偏好如何影响最终推荐的准确性?为了回答这些重要的问题,我们正式分析我们的模型。通过这些分析,我们获得的见解如何设计一个随机算法,这是计算效率和渐近准确的竞争群体推荐系统的准确性评估。我们得到了一些有趣的观察结果:即,对于中等级别的会议,每篇论文三篇评论足以获得高准确度的推荐。对于著名的会议,一篇论文可能需要至少7篇评论才能达到高准确性。我们还提出了一个异构的审查策略,需要相等或更少的审查工作量,但可以提高超过一个同质的审查策略的建议准确性高达30%。我们相信我们的模型和方法是研究竞争性群体推荐系统的重要基石。

英文摘要:

In this paper, we present a mathematical model to capture various factors which may influence the accuracy of a competitive group recommendation system. We apply this model to peer review systems, i.e., conference or research grants review, which is an essential component in our scientific community. We explore number of important questions, i.e., how will the number of reviews per paper affect the accuracy of the overall recommendation? Will the score aggregation policy influence the final recommendation? How reviewers' preference may affect the accuracy of the final recommendation? To answer these important questions, we formally analyze our model. Through this analysis, we obtain the insight on how to design a randomized algorithm which is both computationally efficient and asymptotically accurate in evaluating the accuracy of a competitive group recommendation system. We obtain number of interesting observations: i.e., for a medium tier conference, three reviews per paper is sufficient for a high accuracy recommendation. For prestigious conferences, one may need at least seven reviews per paper to achieve high accuracy. We also propose a heterogeneous review strategy which requires equal or less reviewing workload, but can improve over a homogeneous review strategy in recommendation accuracy by as much as 30% . We believe our models and methodology are important building blocks to study competitive group recommendation systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑