arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.04875cs.DLcs.CY
收藏

同行评议制度中的反常现象--以《高能物理学报》为例

Anomalies in the peer-review system: A case study of the journal of High Energy Physics

Sandipan Sikdar, Matteo Marsili, Niloy Ganguly, Animesh Mukherjee

摘要:

同行评议制度长期以来一直依赖于使科学界注意到高质量的研究,并防止有缺陷的研究进入文献。同行审查制度的必要性经常受到辩论,因为在许多情况下,它未能完成任务,在大多数情况下,编辑和审查人员被认为对未能正确判断工作质量负有责任。这就提出了一个问题:“同行审查制度能否得到改进?“由于编辑和审稿人是审稿系统最重要的支柱,我们在这项工作中,试图解决一个相关的问题-鉴于编辑或审稿人的编辑/审稿历史“,我们可以确定表现不佳的?“,经编辑/审查的论文所收到的引文被用作量化业绩的替代指标。我们把这样的审稿人和编辑称为异常,我们相信识别和删除他们将提高同行评议系统的性能。利用1997年至2015年期间提交的29,000篇论文,95名编辑和4,035名审稿人及其评审历史组成的高能物理杂志(JHEP)的大规模数据集,我们确定了几个指向审稿人和编辑异常行为的因素。事实上,异常的编辑和审稿人分别占编辑和审稿人总数的26.8%和14.5%,并且大多数异常审稿人的绩效随着时间的推移而下降。

英文摘要:

Peer-review system has long been relied upon for bringing quality research to the notice of the scientific community and also preventing flawed research from entering into the literature. The need for the peer-review system has often been debated as in numerous cases it has failed in its task and in most of these cases editors and the reviewers were thought to be responsible for not being able to correctly judge the quality of the work. This raises a question "Can the peer-review system be improved?" Since editors and reviewers are the most important pillars of a reviewing system, we in this work, attempt to address a related question - given the editing/reviewing history of the editors or re- viewers "can we identify the under-performing ones?", with citations received by the edited/reviewed papers being used as proxy for quantifying performance. We term such review- ers and editors as anomalous and we believe identifying and removing them shall improve the performance of the peer- review system. Using a massive dataset of Journal of High Energy Physics (JHEP) consisting of 29k papers submitted between 1997 and 2015 with 95 editors and 4035 reviewers and their review history, we identify several factors which point to anomalous behavior of referees and editors. In fact the anomalous editors and reviewers account for 26.8% and 14.5% of the total editors and reviewers respectively and for most of these anomalous reviewers the performance degrades alarmingly over time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑