数据集伪影是科学颠覆性下降的隐性驱动因素
Dataset Artefacts are the Hidden Drivers of the Declining Disruptiveness in Science
AI总结:
本文通过重新分析发现,Park 等人报告的颠覆性下降主要由零参考文献的数据库条目这一数据集伪影驱动,而非真实的科学颠覆性变化。
摘要:
Park 等人 [1] 报告了科学和技术知识的颠覆性随时间推移而下降。他们的主要发现基于对近 4500 万篇论文和 390 万项专利计算 CD 指数,CD 指数是引文网络中颠覆性的度量 [2]。由于一个事实性的绘图错误,零参考文献的数据库条目在 CD 指数分布中被省略,从而隐藏了大量 CD 指数最大值为 1 的离群值,同时这些条目仍保留在分析中 [1]。我们的重新分析表明,所报告的颠覆性下降可归因于这些零参考文献数据库条目的相对下降。值得注意的是,手稿中包含的稳健性检验未能发现这一点。回归调整未能控制这些隐藏离群值,因为它们对应于 CD 指数中的不连续性。对蒙特卡洛模拟的恰当评估揭示,由于隐藏离群值的保留,即使是随机引文行为也能复现所观察到的颠覆性下降。最后,虽然这些据称零参考文献的论文和专利是所报告下降的隐性驱动因素,但它们的源文档绝大多数确实做出了参考文献,从而暴露了它们纯粹是数据集伪影。
英文摘要:
Park et al. [1] reported a decline in the disruptiveness of scientific and technological knowledge over time. Their main finding is based on the computation of CD indices, a measure of disruption in citation networks [2], across almost 45 million papers and 3.9 million patents. Due to a factual plotting mistake, database entries with zero references were omitted in the CD index distributions, hiding a large number of outliers with a maximum CD index of one, while keeping them in the analysis [1]. Our reanalysis shows that the reported decline in disruptiveness can be attributed to a relative decline of these database entries with zero references. Notably, this was not caught by the robustness checks included in the manuscript. The regression adjustment fails to control for the hidden outliers as they correspond to a discontinuity in the CD index. Proper evaluation of the Monte-Carlo simulations reveals that, because of the preservation of the hidden outliers, even random citation behaviour replicates the observed decline in disruptiveness. Finally, while these papers and patents with supposedly zero references are the hidden drivers of the reported decline, their source documents predominantly do make references, exposing them as pure dataset artefacts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。