arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1911.03379cs.DL
收藏

在学术出版中使用公开的、非匿名的同行评议会引入偏见吗?来自F1000出版后开放同行评审出版模式的证据

Does the use of open, non-anonymous peer review in scholarly publishing introduce bias? Evidence from the F1000 post-publication open peer review publishing model

Mike Thelwall, Verena Weigert, Liz Allen, Zena Nyakoojo, Eleanor-Rose Papas

摘要:

本研究探讨是否有任何偏见的证据,在两个领域的共同批评的开放,非匿名同行评议-和使用的出版后,同行评议系统由开放获取学术出版平台F1000 Research。第一,是否有证据表明,一个位于特定国家的审稿人对同一个国家的作者的作品进行了评估?第二,审稿人是否会因为能够看到评论并知道前一个审稿人的来源而受到影响?研究方法:仔细检查发表在F1000 Research上的开放式同行评审评论,我们评估了两个经常被引用的对评审员的潜在影响的程度,这可能是完全可归因的开放式同行评审出版模式所提供的透明度的结果:作者和评审员的国家从属关系,以及评审员在提交自己的报告之前查看先前发表的评审员报告的能力。对2019年7月8日之前发表于F1000 Research的所有第一版文章研究了这些潜在影响的影响。在文章最多的20个国家中,有16个国家的评论者倾向于给予更积极的评价。其中1例差异有统计学意义。只有3个国家有相反的趋势。其次,没有证据表明存在从众偏见。当审评员在同行审评报告中提到以前的审评时,他们并不更有可能给出相同的总体判断。虽然可能阅读先前发表的评审员报告的时间较长的评审员同意先前评审员判断的可能性略低,但这可能是由于这些文章难以判断,而不是故意不符合。

英文摘要:

This study examines whether there is any evidence of bias in two areas of common critique of open, non-anonymous peer review - and used in the post-publication, peer review system operated by the open-access scholarly publishing platform F1000Research. First, is there evidence of bias where a reviewer based in a specific country assesses the work of an author also based in the same country? Second, are reviewers influenced by being able to see the comments and know the origins of previous reviewer? Methods: Scrutinising the open peer review comments published on F1000Research, we assess the extent of two frequently cited potential influences on reviewers that may be the result of the transparency offered by a fully attributable, open peer review publishing model: the national affiliations of authors and reviewers, and the ability of reviewers to view previously-published reviewer reports before submitting their own. The effects of these potential influences were investigated for all first versions of articles published by 8 July 2019 to F1000Research. In 16 out of the 20 countries with the most articles, there was a tendency for reviewers based in the same country to give a more positive review. The difference was statistically significant in one. Only 3 countries had the reverse tendency. Second, there is no evidence of a conformity bias. When reviewers mentioned a previous review in their peer review report, they were not more likely to give the same overall judgement. Although reviewers who had longer to potentially read a previously published reviewer reports were slightly less likely to agree with previous reviewer judgements, this could be due to these articles being difficult to judge rather than deliberate non-conformity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑