Merit or networks? What decides where research is published
功绩还是关系网?什么决定了研究成果的发表地点
Ning Li
AI总结 利用经济学工作论文数据,通过LLM评估论文思想质量,结合执行质量、关系网络、作者能力和语言模型文本得分,构建五因素生产函数,揭示发表过程中功绩与关系的作用机制。
详情
科学出版奖励的是思想的质量还是关系的优势?这个问题在追求声望的科学界普遍存在,但几十年来一直难以研究,因为论文的质量无法在其发表命运之前被衡量,而不使用该命运作为标尺。我们通过直接测量论文的思想质量来打破这一限制,在发表之前,使用一个经过学科训练的LLM评估器,该评估器在不看到作者姓名或结果的情况下对思想进行评分。以经济学为案例,我们将这种文本可读的思想质量评分与执行质量评分、关系指数、作者能力指数和现成的语言模型文本评分相结合,为6208篇经济学工作论文的期刊定位估计了一个五投入生产函数。这些投入不是竞争对手,而是沿着声望阶梯的一个序列。执行设定了功绩底线,并且是总体最大的投入。文本可读的思想质量则对中间的阶梯进行分级。关系设定了一个偏袒上限,主要在最顶端、最具选择性的期刊附近产生影响。关系通过两个加性渠道发挥作用:有关系的作者撰写的论文得分更高,并且在同等分数下,他们的论文仍然更有可能获得更好的发表位置。然而,这种优势是有限的。关系提高了每个阶梯的几率,但并未使顶端成为普通思想的典型结果,即使是得分最高的论文在进入可见的期刊阶梯时也面临实际摩擦。这一结果将功绩主义和关系网络对科学出版的解释嵌套在一起,而不是在两者之间做出选择。
Does scientific publishing reward the quality of ideas or the advantage of connections? The question is universal to prestige-driven science, yet it has resisted decades of study because a paper's quality could not be gauged ahead of its publication fate without using that fate as the yardstick. We break this constraint by measuring a paper's idea quality directly from its text, before publication, using a discipline-trained LLM evaluator that scores the idea without seeing author names or outcomes. Using economics as a case study, we combine this text-legible idea-quality score with an execution-quality rubric, a connection index, an author-ability index, and an off-the-shelf language-model text score to estimate a five-input production function for journal placement across 6,208 economics working papers. The inputs are not rivals but a sequence along the ladder of prestige. Execution sets a meritocratic floor and is the largest input overall. Text-legible idea quality grades the rungs in between. Connections set a favoritism ceiling that bites mainly near the apex, the most selective journals. Connections work through two additive channels: connected authors write papers that score higher, and at equal scores their papers are still more likely to place better. Yet this advantage is bounded. Connections raise the odds of every rung without making the apex the typical outcome for ordinary ideas, and even the highest-scoring papers face real friction reaching the visible journal ladder. The result nests, rather than chooses between, the meritocracy and network accounts of how science is published.