arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2609.19552cs.CYcs.DL

资助亚军胜过金票

Funding the runners-up beats a golden ticket

  • Indiana University School of Medicine(印第安纳大学医学院)

机构由 AI 辅助整理,请以论文原文为准。

Haining Wang

AI总结:

本研究通过比较少数派支持排名与小组均值排名等规则,发现金票机制在计算机科学会议被拒投稿中并未带来引文优势,小组均值排名更优。

AI中文摘要:

金票允许一位评审人将一份本会被评审小组其余成员否决的提案推进。我们通过将少数派支持排名与其他分配相同数量名额的规则进行比较,来评估其基于分数的合理性。我们在2017年至2024年间计算机科学会议的10,625份被拒投稿上进行了此项研究,以后续引用百分位数作为结果指标。少数派支持排名衡量的是在根据评审小组均值和评审人数调整后,两个最高分数之间的差距。在预算为当年录取数量的10%时,小组均值排名所选投稿的平均引用百分位数比少数派支持排名高出7.75个百分点(95%自助法区间为4.35至11.09)。在其他样本期间和引文窗口中,差异更大。在该预算下,少数派支持排名相当于在正负5个百分点范围内的抽签。另外两项分析,即调整后的最高分排名和匹配比较,发现在考虑小组均值后,少数派支持没有明显的引文优势。在配对比较中,基于分数方差的排名也优于少数派支持排名。估计覆盖了69.8%的符合条件的被拒投稿,其后续引用可被验证。这些比较将小组均值排名确定为评估金票是否选出了本会被忽视的工作的基准。

英文摘要:

A golden ticket allows one reviewer to advance a proposal that the rest of a panel would reject. We assess its score-based rationale by comparing minority-support ranking with other rules for allocating the same number of places. We do so on 10,625 rejected submissions to a computer-science conference between 2017 and 2024, using later citation percentiles as the outcome. Minority-support ranking measured the gap between the two highest scores after adjustment for the panel mean and reviewer count. At a budget of 10% of the year's accepted count, panel-mean ranking selected submissions with a mean citation percentile 7.75 points higher than minority-support ranking (95% bootstrap interval 4.35 to 11.09). The difference was larger in the other sample periods and citation windows examined. At that budget, minority-support ranking was equivalent to a lottery within a margin of plus or minus 5 percentile points. Two further analyses, adjusted highest-score ranking and a matched comparison, found no clear citation advantage from minority support once the panel mean was accounted for. Ranking on score variance also outperformed minority-support ranking in a paired comparison. Estimates cover the 69.8% of eligible rejections whose later citations could be verified. These comparisons identify panel-mean ranking as a benchmark for evaluating whether golden tickets select work that would otherwise be overlooked.

补充信息

↑