F1000Prime同行评议的评分者间信度和聚合效度
Inter-rater reliability and convergent validity of F1000Prime peer review
摘要：
同行评议是现代科学的支柱。F1000Prime是一个生物医学文献（来自医学和生物学期刊的论文）的出版后同行评审系统。本研究旨在探讨F1000Prime同侪互评系统中同侪推荐信的评者间信度与聚合效度。该研究基于约10万篇论文，并附有教师的建议。即使主体间性在科学中发挥着重要作用，对F1000 Prime同行评议系统可靠性的分析表明，教师之间的一致性水平相当低。这一结果与大多数其他已发表在期刊同行评审系统上的研究一致。采用Logistic回归模型对F1000Prime同行评议系统的聚合效度进行了研究。结果显示，高被引论文在学院成员选择的论文中所占的比例明显高于预期。此外，更好的推荐分数也与更好的论文表现有关。
英文摘要：
Peer review is the backbone of modern science. F1000Prime is a post-publication peer review system of the biomedical literature (papers from medical and biological journals). This study is concerned with the inter-rater reliability and convergent validity of the peer recommendations formulated in the F1000Prime peer review system. The study is based on around 100,000 papers with recommendations from Faculty members. Even if intersubjectivity plays a fundamental role in science, the analyses of the reliability of the F1000Prime peer review system show a rather low level of agreement between Faculty members. This result is in agreement with most other studies which have been published on the journal peer review system. Logistic regression models are used to investigate the convergent validity of the F1000Prime peer review system. As the results show, the proportion of highly cited papers among those selected by the Faculty members is significantly higher than expected. In addition, better recommendation scores are also connected with better performance of the papers.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
