arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.08591cs.DL
收藏

大学排名具有统计意义吗?中国高校及其与USA的比较

Are University Rankings Statistically Significant? A Comparison among Chinese Universities and with the USA

Loet Leydesdorff, Caroline S. Wagner, Lin Zhang

摘要:

目的:我们解决大学排名中的差异在统计上是否显着的问题。我们提出了衡量不同大学之间的统计显著性的方法,并通过实证数据说明了结果。设计/方法/办法:基于z检验和重叠置信区间,并使用2020年莱顿大学排名中包含的205所中国大学的数据,我们认为中国研究型大学可以分为三个主要群体。调查结果:当205所中国大学的样本与2020年莱顿排名中的197所美国大学合并时,结果类似地显示了三个主要群体:高,中,低。使用这些数据(莱顿排名和Web-of-Science),中国大学的z分数明显低于美国大学,尽管有一些重叠。研究局限性:我们的经验表明,排名的差异可能是由于数据,模型或对数据的建模效果的变化。当我们使用不同的方法时,科学计量分组并不总是稳定的。R & D政策的影响:大学之间的差异可以测试其统计意义。统计数据使排名中小数的值相对化。人们可以在政策辩论中使用低/中/高的方案,并将个别大学的更细粒度排名留给运营管理和当地环境。创意/价值:在关于大学排名的讨论中,我们认为,差异是否具有统计意义的问题没有得到充分解决。

英文摘要:

Purpose: We address the question of whether differences are statistically significant in the rankings of universities. We propose methods measuring the statistical significance among different universities and illustrate the results by empirical data. Design/methodology/approach: Based on z-testing and overlapping confidence intervals, and using data about 205 Chinese universities included in the Leiden Rankings 2020, we argue that three main groups of Chinese research universities can be distinguished. Findings: When the sample of 205 Chinese universities is merged with the 197 US universities included in Leiden Rankings 2020, the results similarly indicate three main groups: high, middle, low. Using this data (Leiden Rankings and Web-of-Science), the z-scores of the Chinese universities are significantly below those of the US universities albeit with some overlap. Research limitations: We show empirically that differences in ranking may be due to changes in the data, the models, or the modeling effects on the data. The scientometric groupings are not always stable when we use different methods. R&D policy implications: Differences among universities can be tested for their statistical significance. The statistics relativize the values of decimals in the rankings. One can operate with a scheme of low/middle/high in policy debates and leave the more fine-grained rankings of individual universities to operational management and local settings. Originality/value: In the discussion about the rankings of universities, the question of whether differences are statistically significant, is, in our opinion, insufficiently addressed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑