This paper quantifies to which extent preprints in arXiv accelerate scholarly communication. The following subject fields were investigated up to the year 2012: High Energy Physics (HEP), Mathematics, Astrophysics, Quantitative Biology, and Library and Information Science (LIS). Publication and citation data was downloaded from Scopus and matched with corresponding preprints in arXiv. Furthermore, the INSPIRE HEP database was used to retrieve citation data for papers related to HEP. The bibliometric analysis deals with the growth in numbers of articles published having a previous preprint in arXiv and the publication delay, which is defined as the chronological distance between the deposit of a preprint in arXiv and its formal journal publication. Likewise, the citation delay is analyzed, which describes the time it takes until the first citation of preprints, and articles, respectively. Total citation numbers are compared for sets of articles with a previous preprint and those without. The results show that in all fields but biology a significant citation advantage exists in terms of speed and citation rates for articles with a previous preprint version on arXiv.
In this work, we try to answer the question of which method, peer review vs bibliometrics, better predicts the future overall scholarly impact of scientific publications. We measure the agreement between peer review evaluations of Web of Science indexed publications submitted to the first Italian research assessment exercise and long-term citations of the same publications. We do the same for an early citation-based indicator. We find that the latter shows stronger predictive power, i.e., it more reliably predicts late citations in all the disciplinary areas examined, and for any citation time…
In this study we analyse the key driving factors of preprints in enhancing scholarly communication. To this end we use four groups of metrics, one referring to scholarly communication and based on bibliometric indicators (Web of Science and Scopus citations), while the others reflect usage (usage counts in Web of Science), capture (Mendeley readers) and social media attention (Tweets). Hereby we measure two effects associated with preprint publishing: publication delay and impact. We define and use several indicators to assess the impact of journal articles with previous preprint versions in a…
Citing is an important aspect of scientific discourse and important for quantifying the scientific impact quantification of researchers. Previous works observed that citations are made not only based on the pure scholarly contributions but also based on non-scholarly attributes, such as the affiliation or gender of authors. In this way, citation bias is produced. Existing works, however, have not analyzed preprints with respect to citation bias, although they play an increasingly important role in modern scholarly communication. In this paper, we investigate whether preprints are affected by c…
The study of how science is discussed and how scholarly actors interact on social media has increasingly become popular in the field of scientometrics in recent years. While most prior studies focused on research outputs discussed on global platforms, such as Twitter or Facebook, the presence of scholarly journals on local platforms was seldom studied, especially in the Chinese social media context. To fill this gap, this study investigates the uptake of WeChat (a Chinese social network app) by the Chinese scholarly journals indexed by the Chinese Social Sciences Citation Index (CSSCI). The re…
The large scale of scholarly publications poses a challenge for scholars in information seeking and sensemaking. Bibliometrics, information retrieval (IR), text mining and NLP techniques could help in these search and look-up activities, but are not yet widely used. This workshop is intended to stimulate IR researchers and digital library professionals to elaborate on new approaches in natural language processing, information retrieval, scientometrics, text mining and recommendation techniques that can advance the state-of-the-art in scholarly document understanding, analysis, and retrieval at…
Revisiting gender bias research in bibliometrics: Standardizing methodological variability using Scholarly Data Analysis (SoDA) Cards
School of Information Sciences, University of Illinois Urbana–Champaign（伊利诺伊大学厄巴纳-香槟分校信息科学学院）；School of Information, University of Michigan - Ann Arbor（密歇根大学安娜堡分校信息学院）；School of Social Sciences and Technology, Technical University of Munich（慕尼黑工业大学社会科学与技术学院）
In high energy physics, scholarly papers circulate primarily through online preprint archives based on a centralized repository, arXiv, that physicists simply refer to as "the archive". This is not just a tool for preservation and memory, but also a space of flows where written objects are detected and their authors made available for scrutiny. In this work I analyze the reading and publishing practices of two subsets of high energy physicists: theorists and experimentalists. In order to be recognized as legitimate and productive members of their community, they need to abide by the temporalit…
The migration of scholars is a major driver of innovation and of diffusion of knowledge. Although large-scale bibliometric data have been used to measure international migration of scholars, our understanding of internal migration among researchers is very limited. This is partly due to a lack of data aggregated at a suitable sub-national level. In this study, we analyze internal migration in Mexico based on over 1.1 million authorship records from the Scopus database. We trace the movements of scholars between Mexican states, and provide key demographic measures of internal migration for the …
This paper explores the characteristics of DataCite to determine its possibilities and potential as a new bibliometric data source to analyze the scholarly production of open data. Open science and the increasing data sharing requirements from governments, funding bodies, institutions and scientific journals has led to a pressing demand for the development of data metrics. As a very first step towards reliable data metrics, we need to better comprehend the limitations and caveats of the information provided by sources of open data. In this paper, we critically examine records downloaded from t…
Linking research results to grants is an essential prerequisite for an effective monitoring and evaluation of funding programs. For the EU research funding programs, there are multiple datasets linking scholarly publications to the individual grants, including both open data and those from commercial bibliometric databases. In this paper, we systematically compare openly available data from two data sources: on one hand those reported by the Grant holders (and subsequently published by the European Commission on open data portal) and those from the OpenAIRE Research Graph which collect data fr…
Semantic Web: Who is who in the field - A bibliometric analysis
语义Web是旨在通过以可理解的方式表示数据以供机器调解数据和服务来增强人机交互的主要努力之一。这是一个快速发展的多学科领域。本研究通过收集1960-2009年期间Web of Science（WOS）和Scopus的数据，对该领域进行了全面的文献计量学分析。它总共利用了Scopus的44，157篇论文和651，673次引用，以及WOS的22，951篇论文和571，911次引用。基于这些论文和引文，它评估了语义网（SW）的研究性能，确定最富有成效的球员，主要的学术交流媒体，高被引作者，有影响力的论文和新兴的明星。
Bibliometric methods for the analysis of highly specialized subjects are increasingly investigated and debated. Information and assessments well-focused at the specialty level can help make important decisions in research and innovation policy. This paper presents a novel method to approximate the specialty to which a given publication record belongs. The method partially combines sets of key values for four publication data fields: source, title, authors and references. The approach is founded in concepts defining research disciplines and scholarly communication, and in empirically observed r…
Analysis of the Publication and Document Types in OpenAlex, Web of Science, Scopus, PubMed and Semantic Scholar
Göttingen State and University Library, University of Göttingen（哥廷根州立大学图书馆，哥廷根大学）；GESIS – Leibniz Institute for the Social Sciences（GESIS-莱布尼茨社会科学研究所）；German Centre for Higher Education Research and Science Studies, DZHW（德国高等教育研究与科学研究中心，DZHW）
本研究分析了OpenAlex、Web of Science、Scopus、PubMed和Semantic Scholar中文档和出版物类型的分类差异，揭示了不同数据库在分类策略和数据整理上的显著差异。
Nationally oriented scientific-scholarly journals are considered from a methodological-informetric viewpoint, analysing data extracted from Scimago Journal Rank based on Scopus. An operational definition is proposed of a journal's degree of national orientation based on the geographical distribution of its publishing or citing authors, and the role of international collaboration and a country's total publication output. A comprehensive analysis is presented of trends up until 2019 in national orientation and citation impact of national journals entering Scopus, extending outcomes in earlier st…
Digital Object Identifiers (DOIs) are regarded as persistent; however, they are sometimes deleted. Deleted DOIs are an important issue not only for persistent access to scholarly content but also for bibliometrics, because they may cause problems in correctly identifying scholarly articles. However, little is known about how much of deleted DOIs and what causes them. We identified deleted DOIs by comparing the datasets of all Crossref DOIs on two different dates, investigated the number of deleted DOIs in the scholarly content along with the corresponding document types, and analyzed the facto…
New thinking needs to emerge about how to reform publishing along lines that best meet two perennial needs of scientific communication. This paper discusses a model that addresses these two needs with respect to physics. Given the considerable barriers that its realization in pristine form faces, the model aspires merely to be a heuristic or guidepost. It provides an analytical framework for criticizing aspects of the current publishing ecosystem, helps diagnose problems in current efforts to reform it, including those emanating from the open access movement, and raises consciousness about cer…
Visualization of the massive data is a challenging endeavor. Extracting data and providing graphical representations can aid in its effective utilization in terms of interpretation and knowledge discovery. Publishing research articles has become a way of life for academicians. The scholarly publications can shape-up the professional growth of authors and also expand the research and technological growth of a country, continent and other demographic regions. Scholarly articles have grown in gigantic numbers that are published in different domains by various journals. Information related to arti…
Measures for research activity and impact have become an integral ingredient in the assessment of a wide range of entities (individual researchers, organizations, instruments, regions, disciplines). Traditional bibliometric indicators, like publication and citation based indicators, provide an essential part of this picture, but cannot describe the complete picture. Since reading scholarly publications is an essential part of the research life cycle, it is only natural to introduce measures for this activity in attempts to quantify the efficiency, productivity and impact of an entity. Citation…
Unraveling the Ai2 Asta Scholarly Research Assistant Citation System
The iMetrics Lab. Department of Audiovisual Communication, Documentation and History of Art, Universitat Politècnica de València（瓦伦西亚理工大学）；Departament de Biblioteconomia, Documentació i Comunicació Audiovisual, Universitat de Barcelona（巴塞罗那大学）
Measuring research data reuse in scholarly publications using generative artificial intelligence: Open Science Indicator development and preliminary results
Overlay journals are characterised by their articles being published on open access repositories, often already starting in their initial preprint form as a prerequisite for submission to the journal prior to initiating the peer-review process. In this study we aimed to identify currently active overlay journals and examine their characteristics. We utilised an explorative web search and contacted key service providers for additional information. The final sample consisted of 34 overlay journals. While the results show that new overlay journals have been actively established within recent year…
Objective. To analyse quantitatively the articles published during 2008_2017 about the academic social networking site ResearchGate. Methods. A scoping bibliometric review of documents retrieved using Google Scholar was conducted, limited to publications that contained the word "ResearchGate" in their title and were published from 2008 to 2017. Results. The search yielded 159 documents, once a preliminary list of 386 documents retrieved from Google Scholar was filtered, which eliminated about 60% of the results that were bibliographic citations and not documents. Papers in journals were the mo…
A New Era in Citation and Bibliometric Analyses: Web of Science, Scopus, and Google Scholar
学术机构、联邦机构、出版商、编辑、作者和图书馆员越来越多地依赖引文分析来做出招聘、晋升、任期、资金和/或审稿人以及期刊评估和选择决策。几十年来，科学信息研究所（ISI）的引文数据库一直被用作起点，通常也是定位引文和/或进行引文分析的唯一工具。然而，ISI数据库（或Web of Science）可能不再足以作为唯一甚至主要的引文来源，因为现在可以使用新的数据库和工具进行引文搜索。这些新的数据库和工具是否是对Web of Science（WoS）的补充或替代，值得探讨。本文以15名图书馆学和信息学教师为例，研究了使用Scopus和Google Scholar（GS）对WoS测量的学者引文数量和排名的影响。本文讨论了WoS，Scopus和GS的优点和缺点，它们的重叠和独特性，引文的质量和语言，以及引文分析结果的影响。该项目涉及研究小组发表的约1，100篇学术著作和测试小组（另外10名教师）发表的200多篇著作的引文搜索。总共审查了10 000多份引用和据称引用的文件。WoS数据的收集和处理时间约为100小时，Scopus为200小时，GS为3,000小时。
Scientific collaboration is often not perfectly reciprocal. Scientifically strong countries/institutions/laboratories may help their less prominent partners with leading scholars, or finance, or other resources. What is interesting in such type of collaboration is that (1) it may be measured by bibliometrics and (2) it may shed more light on the scholarly level of both collaborating organizations themselves. In this sense measuring institutions in collaboration sometimes may tell more than attempts to assess them as stand-alone organizations. Evaluation of collaborative patterns was explained …
Unleashing the Power of AI. A Systematic Review of Cutting-Edge Techniques in AI-Enhanced Scientometrics, Webometrics, and Bibliometrics
Tarbiat Modares University（塔比阿特莫达雷斯大学）；Alzahra University（阿尔扎赫拉大学）；Université de Montreal（蒙特利尔大学）；University of Leicester（莱斯特大学）；Bucharest University of Economic Studies（布加勒斯特经济研究大学）
OpenCitations is an infrastructure organization for open scholarship dedicated to the publication of open citation data as Linked Open Data using Semantic Web technologies, thereby providing a disruptive alternative to traditional proprietary citation indexes. Open citation data are valuable for bibliometric analysis, increasing the reproducibility of large-scale analyses by enabling publication of the source data. Following brief introductions to the development and benefits of open scholarship and to Semantic Web technologies, this paper describes OpenCitations and its datasets, tools, servi…
In recent months the COVID-19 (also known as SARS-CoV-2 and Coronavirus) pandemic has spread throughout the world. In parallel, extensive scholarly research regarding various aspects of the pandemic has been published. In this work, we analyse the changes in biomedical publishing patterns due to the pandemic. We study the changes in the volume of publications in both peer reviewed journals and preprint servers, average time to acceptance of papers submitted to biomedical journals, international (co-)authorship of these papers (expressed by diversity and volume), and the possible association be…
Many journals post accepted articles online before they are formally published in an issue. Early citation impact evidence for these articles could be helpful for timely research evaluation and to identify potentially important articles that quickly attract many citations. This article investigates whether Microsoft Academic can help with this task. For over 65,000 Scopus in-press articles from 2016 and 2017 across 26 fields, Microsoft Academic found 2-5 times as many citations as Scopus, depending on year and field. From manual checks of 1,122 Microsoft Academic citations not found in Scopus,…
