arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1306.0114physics.soc-phcs.DL
收藏

论未来科学影响的可预测性

On the Predictability of Future Impact in Science

Orion Penner, Raj Kumar Pan, Alexander M. Petersen, Kimmo Kaski, Santo Fortunato

摘要:

正确评估科学家过去的研究影响和未来影响的潜力是招聘决策和其他评估过程的关键。虽然候选人的未来影响是这些决定的主要关注点,但大多数措施只是量化了以前工作的影响。最近,有人认为线性回归模型能够预测科学家未来的影响。通过将该未来影响模型应用于来自三个学科的762个职业:物理学,生物学和数学,我们发现了当前模型中一些微妙但关键的缺陷。具体来说,像h指数这样的累积非递减指标包含内在自相关性,导致其“预测能力”被显著高估。此外,这些模型的预测能力在很大程度上取决于科学家的职业年龄,对年轻研究人员的估计最不准确。我们的研究结果怀疑这些模型的适用性,并表明需要进一步的调查,然后才能在招聘决策中使用。

英文摘要:

Correctly assessing a scientist's past research impact and potential for future impact is key in recruitment decisions and other evaluation processes. While a candidate's future impact is the main concern for these decisions, most measures only quantify the impact of previous work. Recently, it has been argued that linear regression models are capable of predicting a scientist's future impact. By applying that future impact model to 762 careers drawn from three disciplines: physics, biology, and mathematics, we identify a number of subtle, but critical, flaws in current models. Specifically, cumulative non-decreasing measures like the h-index contain intrinsic autocorrelation, resulting in significant overestimation of their "predictive power". Moreover, the predictive power of these models depend heavily upon scientists' career age, producing least accurate estimates for young researchers. Our results place in doubt the suitability of such models, and indicate further investigation is required before they can be used in recruiting decisions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑