arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1304.0627physics.soc-phcs.DLphysics.data-an
收藏

在预测科学家未来的影响时需要谨慎

The case for caution in predicting scientists' future impact

Orion Penner, Raj K. Pan, Alexander M. Petersen, Santo Fortunato

摘要:

我们对Acuna等人提出的职业可预测性模型进行了压力测试[Nature 489,201-202 2012],将他们的模型应用于100名物理学助理教授的纵向职业数据集,其中两名来自美国前50名物理系。Acuna模型声称可以预测h(t+Δt),即科学家在未来t年的h指数,使用在职业年龄t时采取的5个累积职业测量的线性组合。在这里,我们研究如何“可预测性”取决于跨多个年龄组的职业数据的聚合。我们证实,当将所有年龄组聚合在一起时,Acuna模型在预测未来大约6年的h(t+Δt)方面做得很好。然而,当使用特定年龄组的子集进行计算时(例如,仅使用t=3的数据),我们发现模型的预测能力显着下降,特别是当应用于职业生涯早期时。对于年轻的职业,该模型在预测未来影响方面做得更差,因此暴露了严重的局限性。这种限制尤其令人担忧,因为在可能采用定量方法的情况下,早期职业决定即使不是大多数,也占很大一部分。

英文摘要:

We stress-test the career predictability model proposed by Acuna et al. [Nature 489, 201-202 2012] by applying their model to a longitudinal career data set of 100 Assistant professors in physics, two from each of the top 50 physics departments in the US. The Acuna model claims to predict h(t+Δt), a scientist's h-index Δt years into the future, using a linear combination of 5 cumulative career measures taken at career age t. Here we investigate how the "predictability" depends on the aggregation of career data across multiple age cohorts. We confirm that the Acuna model does a respectable job of predicting h(t+Δt) up to roughly 6 years into the future when aggregating all age cohorts together. However, when calculated using subsets of specific age cohorts (e.g. using data for only t=3), we find that the model's predictive power significantly decreases, especially when applied to early career years. For young careers, the model does a much worse job of predicting future impact, and hence, exposes a serious limitation. The limitation is particularly concerning as early career decisions make up a significant portion, if not the majority, of cases where quantitative approaches are likely to be applied.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑