本文探讨了作者级文献计量指标与研究者“测量”之间的关系,并以五个学术资历和四个学科为例。使用聚类方法,学科和资历适当的作者级指标进行检查。天文学、环境科学、哲学和公共卫生领域的741名研究人员的出版物和引文数据收集在Web of Science(WoS)中。使用这些数据计算了44项个人业绩指标。使用IBM SPSS第22版进行两步聚类分析,然后进行风险分析和有序逻辑回归以探索聚类成员。指标得分是根据研究人员个人的简历进行调整的。四个不同的集群的基础上的指标得分排名研究人员为低,中,高和极高的性能。结果表明,不同的指标是适当的划分在不同学科的排名性能。在天文学的h2指标,总pp顶道具在环境科学,Q2在哲学和电子指数在公共卫生。回归和比值分析显示,个体水平指标得分主要取决于研究人员首次在WoS中注册的年数,出版物数量和引用数量。资历分类是次要的,因此没有确定任何资历适当的指标。事实证明,如果初步数据准备充分,聚类方法在确定学科适当指标方面是有用的,但需要其他分析加以补充,以验证结果。研究人员在其简历上的表现与研究人员基于文献计量指标的表现之间存在普遍脱节。
英文摘要:
This paper explores the relationship between author-level bibliometric indicators and the researchers the "measure", exemplified across five academic seniorities and four disciplines. Using cluster methodology, the disciplinary and seniority appropriateness of author-level indicators is examined. Publication and citation data for 741 researchers across Astronomy, Environmental Science, Philosophy and Public Health was collected in Web of Science (WoS). Forty-four indicators of individual performance were computed using the data. A two-step cluster analysis using IBM SPSS version 22 was performed, followed by a risk analysis and ordinal logistic regression to explore cluster membership. Indicator scores were contextualized using the individual researcher's curriculum vitae. Four different clusters based on indicator scores ranked researchers as low, middle, high and extremely high performers. The results show that different indicators were appropriate in demarcating ranked performance in different disciplines. In Astronomy the h2 indicator, sum pp top prop in Environmental Science, Q2 in Philosophy and e-index in Public Health. The regression and odds analysis showed individual level indicator scores were primarily dependent on the number of years since the researcher's first publication registered in WoS, number of publications and number of citations. Seniority classification was secondary therefore no seniority appropriate indicators were confidently identified. Cluster methodology proved useful in identifying disciplinary appropriate indicators providing the preliminary data preparation was thorough but needed to be supplemented by other analyses to validate the results. A general disconnection between the performance of the researcher on their curriculum vitae and the performance of the researcher based on bibliometric indicators was observed.
National, disciplinary and temporal variations in the extent to which articles with more authors have more impact: Evidence from a geometric field normalised citation indicator
A review of the literature on citation impact indicators
引文影响力指标在当今学术评价中发挥着重要作用,因此在文献计量学和科学计量学文献中受到了广泛的关注。本文提供了一个深入的文献综述引文影响指标。首先,概述了可用于计算引文影响指标的书目数据库(Web of Science,Scopus和Google Scholar)的文献。接下来,选定的主题在文献中的引用影响指标进行了详细审查。第一个专题是选择纳入引文影响指标计算的出版物和引文。第二个主题是引文影响指标的标准化,特别是领域差异的标准化。论文的第三个主题是合著论文的统计方法,最后一个主题是期刊的引文影响指标。最后,本文提出了一些建议,为今后的研究。
Characteristics of International versus Non-International Scientific Publication Media in Team- and Author-Based Data
国际出版物和引文数据库Web of Science和Scopus的覆盖面扩大到地方社会科学媒体,这是对这些数据库在评价和供资系统中的使用增加的一个可喜的反应。以前提供的大多数国际期刊是制定现行标准文献计量指标的基础。同样的指标在应用于新引入或扩展的媒体类别时可能不再能衡量完全相同的概念,这些类别可能具有与国际期刊不同的特点。本文探讨了有和没有国际维度的媒体在团队和作者层面上的出版数据的差异。研究结果将国际出版物类别与研究质量联系起来,这对于验证其在旨在促进质量的评估或资助模式中的使用非常重要。
Scientists are embedded in social and information networks that influence and are influenced by the quality of their scientific work, its impact, and the recognition they receive. Here we quantify the systematic relationship between a scientist's position in the network of scientific collaborations and the citations they receive. As expected, we find that authors closer to others in this network are, on average, more highly cited than those further away from others. We construct a novel indicator, the s-index, that explicitly captures performance linked to network position along two compliment…
In 2018, the European Strategic Forum for research infrastructures (ESFRI) was tasked by the Competitiveness Council, a configuration of the Council of the EU, to develop a common approach for monitoring of Research Infrastructures' performance. To this end, ESFRI established a working group, which has proposed 21 Key Performance Indicators (KPIs) to monitor the progress of the Research Infrastructures (RIs) addressed towards their objectives. The RIs were then asked to assess their relevance for their institution. The paper aims to identify the relevance of certain indicators for particular g…
The academic performance indicators of the Doctor of Science title, the highest and most prestigious qualification awarded by the Hungarian Academy of Sciences (HAS), are key in the national assessment system. The types of performance indicators, as well as their minimum values, are incorporated into the application requirements of academic promotions, scientific qualifications, and research scholarships. HAS has proposed a reform of these performance indicators, to align with the current national and global trends. The proposed modifications are generally based on arbitrary decisions and the …
Accurate measurement of research productivity should take account of both the number of co-authors of every scientific work and of the different contributions of the individuals. For researchers in the life sciences, common practice is to indicate such contributions through position in the authors list. In this work, we measure the distortion introduced to bibliometric ranking lists for scientific productivity when the number of co-authors or their position in the list is ignored. The field of observation consists of all Italian university professors working in the life sciences, with scientif…
This paper presents and describes the methodological opportunities offered by bibliometric data to produce indicators of scientific mobility. Large bibliographic datasets of disambiguated authors and their affiliations allow for the possibility of tracking the affiliation changes of scientists. Using the Web of Science as data source, we analyze the distribution of types of mobile scientists for a selection of countries. We explore the possibility of creating profiles of international mobility at the country level, and discuss potential interpretations and caveats. Five countries (Canada, The …
University of Michigan(密歇根大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
To train algorithms for supervised author name disambiguation, many studies have relied on hand-labeled truth data that are very laborious to generate. This paper shows that labeled training data can be automatically generated using information features such as email address, coauthor names, and cited references that are available from publication records. For this purpose, high-precision rules for matching name instances on each feature are decided using an external-authority database. Then, selected name instances in target ambiguous data go through the process of pairwise matching based on …
One of the features of modern science is the formation of stable large collaborations of researchers working together within the projects that require the concentration of huge financial and human resources. Results of such common work are published in scientific papers by large co-authorship teams that include sometimes thousands of names. The goal of this work is to study the influence of such publications on the values of scientometric indicators calculated for individuals, research groups and science of Ukraine in general. Bibliometric data related to Ukraine, some academic institutions an…
Author name disambiguation results are often evaluated by measures such as Cluster-F, K-metric, Pairwise-F, Splitting & Lumping Error, and B-cubed. Although these measures have distinctive evaluation schemes, this paper shows that they can be calculated in a single framework by a set of common steps that compare truth and predicted clusters through two hash tables recording information about name instances with their predicted cluster indices and frequencies of those indices per truth cluster. This integrative calculation reduces greatly calculation runtime, which is scalable to a clustering t…