几个指标的收敛有效性测量的破坏性与里程碑分配的物理论文的专家
Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by experts
摘要:
这项研究的重点是最近推出的一种衡量科学破坏性的指标。破坏性研究通过开辟新的研究路线而偏离当前的研究路线。在目前的研究中,我们包括了最初提出的这种新类型的指标(Wu,Wang,& Evans,2019)和DI1的几个变体:DI5,DI1n,DI5n和DEP。由于指标应该衡量他们打算衡量的东西,我们调查了指标的收敛有效性。我们使用了一系列里程碑式的论文,由《物理评论快报》的编辑选择和发表,并调查了这个基于人类(专家)的列表是否与几个中断指标变体的值有关,如果是这样,哪些变体与专家判断的相关性最高。我们使用二元统计,多元回归模型,(粗)精确匹配(CEM)调查的收敛有效性的指标。结果表明,各指标与编辑的里程碑论文任务的相关性不同。表现最好的不是最初提出的破坏指数(DI1),而是Bornmann,Devarakonda,Tekles和Chacko(2019)引入的变体DI5。在本研究的CEM分析中,Bu,Waltman和Huang(2019)引入的DEP变体也显示出有利的结果。
英文摘要:
This study focuses on a recently introduced type of indicator measuring disruptiveness in science. Disruptive research diverges from current lines of research by opening up new lines. In the current study, we included the initially proposed indicator of this new type (Wu, Wang, & Evans, 2019) and several variants with DI1: DI5, DI1n, DI5n, and DEP. Since indicators should measure what they propose to measure, we investigated the convergent validity of the indicators. We used a list of milestone papers, selected and published by editors of Physical Review Letters, and investigated whether this human (experts - based list is related to values of the several disruption indicators variants and - if so - which variants show the highest correlation with expert judgements. We used bivariate statistics, multiple regression models, and (coarsened) exact matching (CEM) to investigate the convergent validity of the indicators. The results show that the indicators correlate differently with the milestone paper assignments by the editors. It is not the initially proposed disruption index that performed best (DI1), but the variant DI5 which has been introduced by Bornmann, Devarakonda, Tekles, and Chacko (2019). In the CEM analysis of this study, the DEP variant - introduced by Bu, Waltman, and Huang (2019) - also showed favorable results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。