arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.00177cs.CYcs.IRcs.LG
收藏

在双盲审查期间通过arXiv提交对作者进行去匿名化

De-anonymization of authors through arXiv submissions during double-blind review

University of Toronto(多伦多大学);Vector Institute(Vector研究所)

Homanga Bharadhwaj, Dylan Turpin, Animesh Garg, Ashton Anderson

摘要:

在本文中,我们研究了正在进行双盲评审过程的论文的arXiv预印本的发布效果。特别是,我们提出了以下研究问题:通过arXiv预印本对作者进行去匿名化与在(名义上)双盲场地接受研究论文之间的关系是什么?有两个条件:论文发表在arXiv之前的审查阶段和论文没有,我们研究了他们的作者的声誉与审查分数和接受决定之间的相关性。通过分析ICLR 2020和ICLR 2019提交的数据集(n=5050),我们发现在arXiv上发布的高声誉论文与接受率之间存在统计学显著的正相关性。为了更好地理解这种观察到的关联,我们根据审稿人自定义的置信度分数进行了额外的分析,并观察到不太自信的审稿人更有可能为知名作者的论文分配高的评审分数,为不太知名的作者的论文分配低的评审分数,其中声誉是根据Google Scholar引用次数来量化的。我们事先强调,我们的结果是纯粹的相关性,我们既不能也不打算作出任何因果关系的主张。本文附带的博客文章和我们的抓取代码将链接到项目网站https://sites.google.com/view/deanon-arxiv/home

英文摘要:

In this paper, we investigate the effects of releasing arXiv preprints of papers that are undergoing a double-blind review process. In particular, we ask the following research question: What is the relation between de-anonymization of authors through arXiv preprints and acceptance of a research paper at a (nominally) double-blind venue? Under two conditions: papers that are released on arXiv before the review phase and papers that are not, we examine the correlation between the reputation of their authors with the review scores and acceptance decisions. By analyzing a dataset of ICLR 2020 and ICLR 2019 submissions (n=5050), we find statistically significant evidence of positive correlation between percentage acceptance and papers with high reputation released on arXiv. In order to understand this observed association better, we perform additional analyses based on self-specified confidence scores of reviewers and observe that less confident reviewers are more likely to assign high review scores to papers with well known authors and low review scores to papers with less known authors, where reputation is quantified in terms of number of Google Scholar citations. We emphasize upfront that our results are purely correlational and we neither can nor intend to make any causal claims. A blog post accompanying the paper and our scraping code will be linked in the project website https://sites.google.com/view/deanon-arxiv/home

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑