在过去的几十年里，卓越研究的主题受到越来越多的关注（在科学政策中），越来越多的文献计量学研究已经出版，涉及优秀论文。然而，在这些研究中使用了许多不同的方法来识别优秀论文。本定量分析的文献已经进行，以获得这些方法的概述和“平均”或“最常见”的文献计量学的做法的指示。在Web of Science上搜索得到了321篇论文，涉及“高引用”，“最多引用”，“顶级引用”和“最频繁引用”。在321篇文献中，有16篇无法用于本研究。在本研究分析的约80%的论文中，提供了一个定量定义来识别优秀论文。对于涉及绝对数量的定义，选择一定数量的顶级引用论文（58%）或引用次数最少的论文（17%）。大约23%的人从事百分位等级的工作。在这些论文中，有一个前7.6%（算术平均值）或前3%（中位数）的算术平均值。排名前1%的人在论文中使用频率最高，其次是排名前10%的人。有了本研究中提出的阈值，未来将有可能根据文献计量学家的“平均”或“最常见”实践来识别优秀论文。
英文摘要：
As the subject of research excellence has received increasing attention (in science policy) over the last few decades, increasing numbers of bibliometric studies have been published dealing with excellent papers. However, many different methods have been used in these studies to identify excellent papers. The present quantitative analysis of the literature has been carried out in order to acquire an overview of these methods and an indication of an "average" or "most frequent" bibliometric practice. The search in the Web of Science yielded 321 papers dealing with "highly cited", "most cited", "top cited" and "most frequently cited". Of the 321 papers, 16 could not be used in this study. In around 80% of the papers analyzed in this study, a quantitative definition has been provided with which to identify excellent papers. With definitions which relate to an absolute number, either a certain number of top cited papers (58%) or papers with a minimum number of citations are selected (17%). Around 23% worked with percentile rank classes. Over these papers, there is an arithmetic average of the top 7.6% (arithmetic average) or of the top 3% (median). The top 1% is used most frequently in the papers, followed by the top 10%. With the thresholds presented in this study, in future, it will be possible to identify excellent papers based on an "average" or "most frequent" practice among bibliometricians.
Characterizing the highly cited articles: a large-scale bibliometric analysis of the top 1% most cited research
我们对2007年至2016年期间约10，000篇科学文章进行了大规模分析，以研究影响引文的文献计量学或正式方面。进行横向分析，将文章分解为100多个科学领域和两组，一个实验组和一个对照组，每组随机抽取约5000份文件。实验组包括每个领域和出版年份中引用次数最多的前1%文章（高引用文章）的随机样本，对照组包括期刊引用报告（Web of Science数据库中的科学和社会科学引用索引）中剩余文章的随机样本。作为主要的结果，高被引的文章不同于非高被引的文章在大多数的文献计量学方面考虑。文章组之间在许多变量和领域存在显著差异，低于0.01水平。高被引论文发表在影响因子较高的期刊上（高于33个百分点），合著率高出25%。高被引文章在页数（增加10%）和参考文献（增加35%）方面也更长。最后，高被引文章的标题略短（低3%），但相反，摘要较长（高10%）。
A comprehensive bibliometric analysis of the scientific production of Chemical Engineering area has been carried out using the Web of Science database for the period 2000-2011 through three complementary studies. Part 2 demonstrated a displacement of the most cited publications to the Far East, especially due to China, however, this displacement is less important to that observed for total scientific production (Part 1). United States is still the country with the highest number of articles among the 1,000 most cited (31.5%), largely above what expected from their number of publications, follo…
Detecting the historical roots of tribology research: a bibliometric analysis
在这项研究中，摩擦学的历史根源进行了调查，使用一种新开发的科学计量方法称为参考出版年光谱。这项研究是基于摩擦学研究出版物中引用的参考文献。数据来源为Science Citation Index Expanded。结果表明，RPYS具有识别重要出版物的潜力：本研究中被识别为高引用（参考）出版物的大多数出版物是摩擦学领域的里程碑式出版物。
How to analyse percentile impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes and top-cited papers
Do we measure novelty when we analyze unusual combinations of cited references? A validation study of bibliometric novelty indicators based on F1000Prime data
Bibliometrics provides accurate, cheap and simple descriptions of research systems and should lay the foundations for research policy. However, disconnections between bibliometric knowledge and research policy frequently misguide the research policy in many countries. A way of correcting these disconnections might come from the use of simple indicators of research performance. One such simple indicator is the number of highly cited researchers, which can be used under the assumption that a research system that produces and employs many highly cited researchers will be more successful than othe…
Which early works are cited most frequently in climate change research literature? A bibliometric approach based on Reference Publication Year Spectroscopy
Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references
信息科学的许多研究都着眼于科学的发展。在这项研究中，我们重新审视了科学的增长问题。为此，我们（i）使用截至2012年出版的当前数据，（ii）分析所有学科的数据，并分别分析自然科学和医学与健康科学。此外，数据分析采用先进的统计技术-分段回归分析-可以识别科学史上具有相似增长率的特定部分。该研究基于两组不同的文献计量学数据：（1）每个出版年在Web of Science（WoS，Thomson Reuters）中作为源项的出版物数量;（2）每个引用参考年源项出版物中引用的参考文献数量。我们已经研究了自17世纪中期以来科学发展的速度。在我们对引用文献的分析中，我们确定了科学发展的三个增长阶段，每个阶段的增长率都是前一阶段的三倍：从18世纪中期的不到1%，到两次世界大战之间的2%到3%，到2012年的8%到9%。
Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison
本研究探讨了基于高被引文献计数的文献计量学指标在多大程度上会受到数据源选择的影响。最初的假设是，依赖于期刊选择标准的数据库可能不一定能准确地代表所有学科领域的高引用文献，而包容性数据库，让每个文件都有机会站在自己的优点上，可能更适合识别高引用文献。为了验证这一假设，我们对2006年发表的2,515篇高被引文献进行了分析，这些文献是在广泛的主题类别层面上进行的，检查这些文献是否也被Web of Science和Scopus所覆盖，以及不同来源提供的引用计数是否相似。结果表明，社会科学和人文科学领域的高被引文献中有很大一部分（8.6%~ 28.2%）对Web of Science和Scopus是不可见的。在自然科学、生命科学和健康科学领域，Web of Science和Scopus中缺失高被引文献的比例要低得多。此外，在所有领域，与Web of Science和Scopus引文计数相比，Google Scholar引文计数的斯皮尔曼相关系数非常强（.83-.99）。主要结论是，在包容性数据库谷歌学术中提供的高被引文献的数据确实揭示了Web of Science和Scopus在几个研究领域的重大覆盖缺陷。因此，使用这些选择性的数据库来计算基于高被引文献数量的文献计量指标，可能会在覆盖率较低的领域产生有偏见的评估。
Although not explicitly declared, most research rankings of countries and institutions are supposed to reveal their contribution to the advancement of knowledge. However, such advances are based on very highly cited publications with very low frequency, which can only very exceptionally be counted with statistical reliability. Percentile indicators enable calculations of the probability or frequency of such rare publications using counts of much more frequent publications; the general rule is that rankings based on the number of top 10% or 1% cited publications (Ptop 10%, Ptop 1%) will also be…
Introducing CitedReferencesExplorer (CRExplorer): A program for Reference Publication Year Spectroscopy with Cited References Standardization
我们介绍了一个新的工具-CitedReferencesExplorer（CRExplorer，www.crexplorer.net）-它可以用来消除歧义和分析引用的参考文献（CR）的出版物集下载从Web of Science（WoS）。该工具特别适合于识别那些经常被某一领域的研究人员引用的出版物，从而研究例如研究领域或主题的历史根源。CRExplorer简化了关键出版物的识别，使用户能够同时使用用于识别最常引用的参考出版物年份（RPY）的图表和最常引用的RPY的参考文献列表。该计划的另一个重点是CR的标准化。在文献计量学中，同一CR在WOS中存在多个变体是一个严重的问题。在这项研究中，CRExplorer是用来研究所有的论文发表在信息计量学杂志的CR。分析的重点是1980年和1990年之间发表的最重要的论文。
A comprehensive bibliometric analysis of the scientific production of Chemical Engineering area has been carried out using the Web of Science database for the period 2000-2011 through three complementary studies. Part 3 has analyzed the distribution of words in article titles, keyword plus and author keywords of both total scientific production and the 1,000 most cited publications. The main areas of Chemical Engineering have been identified; they are mainly related to chemical reaction engineering such as catalysis, reactors, kinetics, and unit operations such as adsorption. Furthermore, a to…
Are the authors of highly cited articles also the most productive ones?
各国政府越来越多地决定实施旨在促进和奖励优秀科研成果的政策措施。事实上，这正是国家研究评估工作的预期目的。这些方法通常基于对最佳研究产品质量的分析;然而，一种不同的分析和干预方法基于对科学家个人生产力的衡量，即他们在所观察期间的整个科学生产的总体影响。这项工作分析了这两种方法的融合，询问最有生产力的科学家是否以及如何衡量高引用文章;反之亦然，高引用文章的比例是由生产力“非顶级”的科学家实现的。要做到这一点，我们使用文献计量学指标，适用于2004-2008年出版物撰写的意大利大学的学者和索引在Web of Science。
Entrepreneurs play crucial roles in global sustainable development, but limited financial resources constrain their performance and survival rate. Entrepreneurial finance discipline is, therefore, born to explore the connection between finance and entrepreneurship. Despite the global presence of entrepreneurship, the literature of entrepreneurial finance is suspected to be Western ideologically homogenous. Thus, the objective of this study is to examine the existence of Western ideological homogeneity in entrepreneurial finance literature. Employing the mindsponge mechanism and bibliometric an…
Blockchain is a shared, immutable ledger that has attracted the attention of researchers and practitioners across innumerable sectors, with its implications for modernizing payment systems having the possibility of inciting a digital revolution. In the scope of this study, 1,511 publications were obtained from Scopus to conduct a systematic review of the research space through bibliometric and network analyses. The main aim of this study was to determine key authors, significant studies, and collaboration patterns, to reveal the distributions and impacts of publications in the blockchain-based…
Evaluation of journals for quality is one of the dominant themes of bibliometrics since journals are the primary venue of vetting and distribution of scholarship. There are many criticisms of quantifying journal impact with bibliometrics including disciplinary differences among journals, what source materials are used, time windows for the inclusion of works to measure, and skewness of citation distributions (Lariviere & Sugimoto, 2019). However, despite various attempts to remediate these in newly proposed indicators such as SJR, SNIP, and Eigenfactor (Walters, 2017) indicators still remain b…
How well does I3 perform for impact measurement compared to other bibliometric indicators? The convergent validity of several (field-normalized) indicators
Following Henry Small in his approach to co-citation analysis, highly cited sources are seen as concept symbols of research fronts. But instead of co-cited sources I cluster citation links, which are the thematically least heterogenous elements in bibliometric studies. To obtain clusters representing topics characterised by concepts I restrict link clustering to citation links to highly cited sources. Clusters of citation links between papers in a political-science subfield (International Relations) and 300 of their sources most cited in the period 2006-2015 are constructed by a local memetic …
A comprehensive bibliometric analysis of Chemical Engineering area has been carried out through the analysis of the scientific production covered in Web of Science during the period 2000-2011. Three complementary studies have been carried out. Part 1 analyzes total scientific production in the area. An important displacement of the scientific production to the Far East has occurred, mainly by the increase in publications from China (the world most productive country since 2008) but also from countries such as India and Iran. Although the share of publications from Europe, and especially from N…
Recently, graph neural networks have become a hot topic in machine learning community. This paper presents a Scopus based bibliometric overview of the GNNs research since 2004, when GNN papers were first published. The study aims to evaluate GNN research trend, both quantitatively and qualitatively. We provide the trend of research, distribution of subjects, active and influential authors and institutions, sources of publications, most cited documents, and hot topics. Our investigations reveal that the most frequent subject categories in this field are computer science, engineering, telecommun…
The false myth of the rise in self-citations, and the impressively positive effect of bibliometric evaluations on the increase of the impact of Italian research
This review summarizes papers which analyze impact of self-citation on research evaluation. We introduce a generalized definition of self-citation and its variants: author, institutional, country, journal, discipline, publisher self-citation. Formulae of the basic self-citation measures are given, namely self-citing and self-cited rates. World literature on author, institutional, country and journal self-citation is studied in more detail. Current views on the role and impact of self-citation are compiled and analyzed. It is found that there is a general consensus on some points: (a) pathologi…
On the causes of subject-specific citation rates in Web of Science
在文献计量学中众所周知，每篇论文的平均引用次数在不同学科之间存在很大差异。不同的引用文化（特别是每篇论文的平均引用次数不同，因此被引用的概率不同）被广泛认为是这种差异的原因。基于1990年，1995年，2000年，2005年和2010年发表的所有Web of Science（WoS）记录，我们证明了几乎所有学科在其论文的附录中显示出相似的参考文献数量。我们的研究结果表明，平均引用率的影响更大的程度上的论文（引用作为参考）被列入WoS作为链接的数据库记录。例如，人文学科相对较低的引用率根本不是每篇论文平均引用数量较低的结果，而是由引用WoS涵盖的核心期刊上发表的论文的链接引用比例较低造成的。
How much do different ways of calculating percentiles influence the derived performance indicators? - A case study
文献计量指标可以通过比较特定的引文记录与参考文献集的数量来确定。然而，在计算引文数量时存在着一种模糊性，因为通常在百分位数等级之间的边界处会发现大量具有相同引用计数的论文。本案例研究的引用期刊欧洲物理学快报（EPL）在比较所有的物理论文从Web of Science显示的偏差，由于不同的方式来处理并列论文的高被引出版物的百分比的评估。如果被引用次数达到阈值的论文都被认为是高引用或都被认为不是高引用，则可能会出现强烈的偏倚。
Nowadays, semantic interoperability is a new keyword in the Internet of Things (IoT) for the exchange of information between sources. The constant need for interaction and cooperation has resulted in the creation of the Semantic Web with the help of tools and reasoners which manage personal information. Given the significance of the IoT and the increasing use of semantic techniques in this field, the present bibliometric investigation was conducted in the domain of semantic reasoning in the IoT. Bibliometrics involves analyzing bibliographic data of scientific sources, and it can be employed t…
This paper presents the results of a systematic review of the literature on the impact of social media in learning and teaching through bibliometric based Citation analysis. The objective of the review was to map the evolution of the current literature and identify the leading sources of knowledge in terms of the most influential journals, authors, and articles. From a total of 50 top most relevant articles selected from the Scopus database, a detailed citation analysis was conducted. The study explored the overall theoretical foundation of social media research involving in learning and study…
Digitization of publications, advancement in communication technology, and the availability of bibliographic data have made it easier for the researchers to study the growth and dynamics of any discipline. We present a study on "Econophysics" metadata extracted from the Web of Science managed by the Clarivate Analytics from 2000-2019. The study highlights the growth and dynamics of the discipline by measures of a number of publications, citations on publications, other disciplines contribution, institutions participation, country-wise spread, etc. We investigate the impact of self-citations on…
Which cities produce excellent papers worldwide more than can be expected? A new mapping approach--using Google Maps--based on statistical significance testing
本文提出的方法允许使用免费提供的程序进行统计分析，揭示世界各地的卓越中心。基于Web of Science数据，可以在高被引论文大量发表的城市中确定特定领域的卓越性。与迄今为止出版的映射方法相比，我们的方法更注重分析，允许对预期数量的城市（样本中）的优秀论文的观察数量进行评估。使用这种测试，这种方法不仅可以识别出产出中的顶级表现者，而且可以识别出“真正的宝石”。“这些城市的作者发表的被引用论文比预期的要多得多。正如本文中的物理、化学和心理学的例子所示，这些城市并不一定有很高的优秀论文产出。
The field of Energy System Analysis (ESA) has experienced exponential growth in the number of publications since at least the year 2000. This paper presents a comprehensive bibliometric analysis on ESA by employing different algorithms in Matlab and R. The focus of results is on quantitative indicators relating to number and type of publication outputs, collaboration links between institutions, authors and countries, and dynamic trends within the field. The five and twelve most productive countries have 50% and 80% of ESA publications respectively. The dominant institutions are even more conce…
In this study, we investigated the academic literature on quantum technologies (QT) using bibliometric tools. We used a set of 49,823 articles obtained from the Web of Science (WoS) database using a search query constructed through expert opinion. Analysis of this revealed that QT is deeply rooted in physics, and the majority of the articles are published in physics journals. Keyword analysis revealed that the literature could be clustered into three distinct sets, which are (i) quantum communication/cryptography, (ii) quantum computation, and (iii) physical realizations of quantum systems. We…
Revolutions in science: The proposal of an approach for the identification of most important researchers, institutions, and countries based on Reference Publication Year Spectroscopy (RPYS)
Ranking and mapping of universities and research-focused institutions worldwide based on highly-cited papers: A visualization of results from multi-level models
