arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.01270cs.DL
收藏

科技评论中共识的社会结构

The Social Structure of Consensus in Scientific Review

Misha Teplitskiy, Daniel Acuna, Aida Elamrani-Raoult, Konrad Kording, James Evans

摘要:

科学作品的创造者和评价者之间的个人联系无处不在,偏见的可能性永远存在。虽然已经证明,联系会使对(不确定的)未来表现的预期判断产生偏差,但我们不知道这种偏差是否会出现在评估已经完成的工作的科学有效性这一更具体的任务中,如果是这样,为什么会这样。这项研究提供的证据表明,神经科学手稿的作者和审稿人之间的个人联系与偏见的判断有关,并探讨了驱动这种效应的机制。使用提交给PLOS ONE杂志的7,981篇神经科学手稿的评论,该杂志指示评论者仅根据科学有效性来评估手稿,我们发现评论者在1.0 - 4.0的接近度范围内,在合作作者网络中支持作者约0.11分。《公共科学图书馆·综合》的有效性审查以及远距离和非常远的审查者所表现出的大量偏袒,他们都应该从裙带关系中获益甚少,指出了不同"思想流派"科学家之间实质性分歧的核心作用。“结果表明,消除同行评议中的偏见不能简单地通过回避关系密切的评审员来实现,并强调了招聘嵌入不同专业网络的评审员的价值。

英文摘要:

Personal connections between creators and evaluators of scientific works are ubiquitous, and the possibility of bias ever-present. Although connections have been shown to bias prospective judgments of (uncertain) future performance, it is unknown whether such biases occur in the much more concrete task of assessing the scientific validity of already completed work, and if so, why. This study presents evidence that personal connections between authors and reviewers of neuroscience manuscripts are associated with biased judgments and explores the mechanisms driving the effect. Using reviews from 7,981 neuroscience manuscripts submitted to the journal PLOS ONE, which instructs reviewers to evaluate manuscripts only on scientific validity, we find that reviewers favored authors close in the co-authorship network by ~0.11 points on a 1.0 - 4.0 scale for each step of proximity. PLOS ONE's validity-focused review and the substantial amount of favoritism shown by distant vs. very distant reviewers, both of whom should have little to gain from nepotism, point to the central role of substantive disagreements between scientists in different "schools of thought." The results suggest that removing bias from peer review cannot be accomplished simply by recusing the closely-connected reviewers, and highlight the value of recruiting reviewers embedded in diverse professional networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑