Citations are the cornerstone of knowledge propagation and the primary means of assessing the quality of research, as well as directing investments in science. Science is increasingly becoming "data-intensive", where large volumes of data are collected and analyzed to discover complex patterns through simulations and experiments, and most scientific reference works have been replaced by online curated datasets. Yet, given a dataset, there is no quantitative, consistent and established way of knowing how it has been used over time, who contributed to its curation, what results have been yielded or what value it has.
The development of a theory and practice of data citation is fundamental for considering data as first-class research objects with the same relevance and centrality of traditional scientific products. Many works in recent years have discussed data citation from different viewpoints: illustrating why data citation is needed, defining the principles and outlining recommendations for data citation systems, and providing computational methods for addressing specific issues of data citation.
The current panorama is many-faceted and an overall view that brings together diverse aspects of this topic is still missing. Therefore, this paper aims to describe the lay of the land for data citation, both from the theoretical (the why and what) and the practical (the how) angle.
Analyzing data citation practices using the Data Citation Index
我们提出了一个分析的数据引用实践的基础上，数据引用索引从汤森路透。该数据库于2012年启动，旨在将数据集和数据研究与从其他引文索引收到的引文联系起来。DCI从Web of Science索引的论文中收集研究数据的引用。它依赖于数据储存库提供的信息，因为在许多情况下，数据引用做法不一致或不存在。这项研究的结果表明，在大多数研究领域，数据引用的做法是远远不够的。研究人员引用数据的方式存在一些差异：在科学和工程以及技术领域，数据集被引用最多，而在社会科学和艺术以及人文科学领域，数据研究发挥了更大的作用。总共有88.1%的记录没有被引用，但一些存储库显示出非常低的未引用率。尽管数据引用在大多数领域都很少见，但它们在晶体学和基因组学等学科中得到了扩展。最后，我们强调DCI可以发挥的作用，鼓励一致的，标准化的研究数据的引用;一个角色，将提高其价值的一种手段，从数据汇集到出版的研究过程。
Data and software citations are crucial for the transparency of research results and for the transmission of credit. But they are hard to track, because of the absence of a common citation standard. As a consequence, the FORCE11 recently proposed data and software citation principles as guidance for authors. Zenodo is recognized for the implementation of DOIs for software on a large scale. The minting of complementary DOIs for the version and concept allows measuring the impact of dynamic software. This article investigates characteristics of 5,456 citations to Zenodo data and software that we…
Association between quality of clinical practice guidelines and citations given to their references
有人建议，不同类型的文件的文献计量学分析可能会揭示新的方面的研究业绩。在医学研究中，许多研究类型在研究过程中发挥着不同的作用，研究类型的证据水平与不同的引用率有关。这项研究的重点是临床实践指南，这些指南应该收集关于给定主题的最高证据，以便为从业者提供最佳建议。使用AGREE评分测量的临床实践指南的质量与这些指南中使用的参考文献的引用进行比较，因为假设更好的指南是基于更高引用的参考文献。AGREE评分是从对一些疾病和治疗的临床实践指南的评论中收集的。他们的参考文献来自Web of Science，引用计数使用面向项目的z得分和PPtop-10%指标进行标准化。两项引文指标与临床实践指南的AGREE评分呈正相关，并发现了一些潜在的混杂因素。虽然不能排除混杂因素，但结果表明确定的混杂因素的可能性较低。研究结果为引文分析提供了新的视角和应用。
Citing data and software is a means to give scholarly credit and to facilitate access to research objects. Citation principles encourage authors to provide full descriptions of objects, with stable links, in their papers. As Jupyter notebooks aggregate data, software, and other objects, they may facilitate or hinder citation, credit, and access to data and software. We report on a study of references to Jupyter notebooks in astronomy over a 5-year period (2014-2018). References increased rapidly, but fewer than half of the references led to Jupyter notebooks that could be located and opened. J…
Citation analysis may severely underestimate the impact of clinical research as compared to basic research
背景：引文分析已成为医学科学研究绩效评估的重要工具。然而，不同的医学研究领域可能有相当不同的引用实践，即使在同一个医学领域。正因为如此，目前还不清楚在何种程度上基于引文的文献计量学指标允许有效的比较活跃在不同领域的医学研究的研究单位。方法：介绍了一种可视化方法，揭示了医学研究领域之间的引用实践的差异。该方法从大量出版物的标题和摘要中提取术语，并使用这些术语来可视化医学领域的结构，并表明该领域内的研究领域在其平均引用影响方面如何彼此不同。结果：提供了32个医学领域的可视化，定义的基础上在Web of Science数据库的期刊主题类别。分析集中在三个领域。在每一个领域中，研究领域之间的引用实践都有很大的差异。低影响力的研究领域往往侧重于临床干预研究，而高影响力的研究领域往往更侧重于基础和诊断研究。结论：流行的文献计量学指标，如h指数和影响因子，并不能纠正医学领域之间引用实践的差异。因此，这些指标不能用来进行准确的外地间比较。更复杂的文献计量学指标确实纠正了领域差异，但仍然没有考虑到引用实践中的领域内异质性。因此，与基础和诊断研究相比，临床干预研究的引文影响可能被大大低估。
In this article, we discuss the outcomes of an experiment where we analysed whether and to what extent the introduction, in 2012, of the new research assessment exercise in Italy (a.k.a. Italian Scientific Habilitation) affected self-citation behaviours in the Italian research community. The Italian Scientific Habilitation attests to the scientific maturity of researchers and in Italy, as in many other countries, is a requirement for accessing to a professorship. To this end, we obtained from ScienceDirect 35,673 articles published from 1957 and 2016 by the participants to the 2012 Italian Sci…
In multiple academic disciplines, having a perceived gender of `woman' is associated with a lower than expected rate of citations. In some fields, that disparity is driven primarily by the citations of men and is increasing over time despite increasing diversification of the profession. It is likely that complex social interactions and individual ideologies shape these disparities. Computational models of select factors that reproduce empirical observations can help us understand some of the minimal driving forces behind these complex phenomena and therefore aid in their mitigation. Here, we p…
In course of the organization of Workshop III entitled "Cited References Analysis Using CRExplorer" at the International Conference of the International Society for Scientometrics and Informetrics (ISSI2021), we have prepared three reference publication year spectroscopy (RPYS) analyses: (i) papers published in Journal of Informetrics; (ii) papers regarding the topic altmetrics; and (iii) papers published by Ludo Waltman (we selected this researcher since he received the Derek de Solla Price Memorial Medal during the ISSI2021 conference). The first RPYS analysis has been presented live at the …
The historical and contemporary under-attribution of women's contributions to scientific scholarship is well-known and well-studied, with effects that are felt today in myriad ways by women scientists. One measure of this under-attribution is the so-called citation gap between men and women: the under-citation of papers authored by women relative to expected rates coupled with a corresponding over-citation of papers authored by men relative to expected rates. We explore the citation gap in contemporary physics, analyzing over one million articles published over the last 25 years in 35 physics …
University of California, San Diego（加州大学圣地亚哥分校）；University of Toronto（多伦多大学）；Dunlap Institute for Astronomy & Astrophysics, University of Toronto（多伦多大学邓普尔天文与天体物理研究所）；University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；FAIR Data Innovations Hub, California Medical Innovations Institute（公平数据创新中心，加州医疗创新研究所）；National Center for Supercomputing Applications, University of Illinois Urbana-Champaign（美国国家超级计算应用中心，伊利诺伊大学厄巴纳-香槟分校）；SciOS；University of California Berkeley（加州大学伯克利分校）；Center for Astrophysics | Harvard & Smithsonian（哈佛&史密森尼天体物理中心）；Astrophysics Source Code Library | University of Maryland College Park（天体物理学源代码库，马里兰大学帕克分校）；Universität Heidelberg, Zentrum für Astronomie (ZAH), Institut für Theoretische Astrophysik（海德堡大学，天文学中心（ZAH），理论天体物理研究所）；Institute for Cyber-Enabled Research, Michigan State University（密歇根州立大学网络使能研究所）；The US Research Software Engineer Association（美国研究软件工程师协会）；San Diego Supercomputer Center, University of California, San Diego（加州大学圣地亚哥分校圣地亚哥超级计算中心）；Center for Computational Astrophysics, Flatiron Institute（平顿研究所计算天体物理中心）
Like many scientific disciplines, neuroscience has increasingly attempted to confront pervasive gender imbalances within the field. While much of the conversation has centered around publishing and conference participation, recent research in other fields has called attention to the prevalence of gender bias in citation practices. Because of the downstream effects that citations can have on visibility and career advancement, understanding and eliminating gender bias in citation practices is vital for addressing inequity in a scientific community. In this study, we sought to determine whether t…
Citation indexes are by now part of the research infrastructure in use by most scientists: a necessary tool in order to cope with the increasing amounts of scientific literature being published. Commercial citation indexes are designed for the sciences and have uneven coverage and unsatisfactory characteristics for humanities scholars, while no comprehensive citation index is published by a public organization. We argue that an open citation index for the humanities is desirable, for four reasons: it would greatly improve and accelerate the retrieval of sources, it would offer a way to interli…
Linking to Data - Effect on Citation Rates in Astronomy
带有数据链接的文章和没有数据链接的文章之间的引用率是否存在差异？除了从纯学术的角度来看是有趣的，这个问题也是高度相关的推进科学的过程。数据共享不仅有助于索赔的核实过程，而且有助于在档案数据中发现新的发现。然而，链接到数据仍然远远没有成为一种“实践”，特别是当作者在写作和提交过程中提供这些链接时。你需要有一个意愿和一个出版机制，以创造这样的做法。显示与数据链接的文章获得更高的引用率可能会增加科学家采取额外步骤将数据源链接到他们的出版物的意愿。在这个演示中，我们将展示这确实是这样的情况：与数据链接的文章比没有这样的链接的文章有更高的引用率。ADS由NASA Grant NNX 09 AB 39 G资助。
Standardizing and incentivizing the use of digital object identifiers (DOIs) to aggregate and identify both data analyzed and data generated by a research project will advance the field of astronomy to match best practices in other research fields like geosciences and medicine. Increase in the use of DOIs will prepare the discipline for changing expectations among funding agencies and publishers, who increasingly expect accurate and thorough data citation to accompany scientific outputs. The use of DOIs ensures a robust, sustainable, and interoperable approach to data citation in which due cre…
Scientific journals are an important choice of publication venue for most authors. Publishing in prestigious journal plays a decisive role for authors in hiring and promotions. In last decade, citation pressure has become intact for all scientific entities more than ever before. Unethical publication practices has started to manipulate widely used performance metric such as "impact factor" for journals and citation based indices for authors. This threatens the integrity of scientific quality and takes away deserved credit of legitimate authors and their authentic publications. In this paper we…
Citation parsing is fundamental for search engines within academia and the protection of intellectual property. Meticulous extraction is further needed when evaluating the similarity of documents and calculating their citation impact. Citation parsing involves the identification and dissection of citation strings into their bibliography components such as "Author", "Volume","Title", etc. This meta-data can be difficult to acquire accurately due to the thousands of different styles and noise that can be applied to a bibliography to create the citation string. Many approaches exist already to ac…
In this paper, we analyse the current availability of open citations data in one particular dataset, namely COCI (the OpenCitations Index of Crossref open DOI-to-DOI citations; http://opencitations.net/index/coci) provided by OpenCitations. The results of these analyses show a persistent gap in the coverage of the currently available open citation data. In order to address this specific issue, we propose a strategy whereby the community (e.g. scholars and publishers) can directly involve themselves in crowdsourcing open citations, by uploading their citation data via the OpenCitations infrastr…
The rise of software as a research object is mirrored in the increasing interests towards quantitative studies of scientific software. However, due to the inconsistent practice of citing software, most of the existing studies analyzing the impact of scientific software are based on identification of software name mentions in full-text publications. Despite its limitations, citation data have a much larger quantity and broader coverage of scientific fields than full-text data and thus could support findings in much larger scopes. This paper presents an analysis aiming to evaluate the extent to …
Open citation data can improve the transparency and robustness of scientific portfolio analysis, improve science policy decision-making, stimulate downstream commercial activity, and increase the discoverability of scientific articles. Once sparsely populated, public-domain citation databases crossed a threshold of one billion citations in February 2021, during the COVID-19 pandemic. Shortly thereafter, the threshold of one billion public-domain citations from the Crossref database alone. Since the relative advantage of withholding data in closed databases has diminished with the flood of publ…
Systemic Gendered Citation Imbalance in Computer Science: Evidence from Conferences and Journals
Tokyo Metropolitan University（东京都立大学）；The University of Osaka（大阪大学）；Nara Institute of Science and Technology（奈良先端科学技术大学院大学）；Eindhoven University of Technology（埃因霍温理工大学）
The paper analyses Russian Index of Science Citation (RISC), a national citation database. We continue our previous study (Moskaleva et al., 2018) and focus on difference between bibliometric indicators calculated on, so to say, "the best" journals, so called RISC Core, and those which take into account all Russian journals available. Such a difference may show focuses of insitutional actors on different document types, publication strategies etc.
In this article, we focus on the importance of open research information as the foundation for transparent and responsible research assessment and discovery of research outputs. We introduce work in which we support the open research information commons by enabling, in particular, independent and small Open Access journals to provide metadata to several open data hubs (Open Citations, Wikidata, Open Research Knowledge Graph). In this context, we present The OPTIMETA Way, a means to integrate metadata collection, enrichment, and distribution in an effective and quality-ensured way that enables …
As an important biomedical database, PubMed provides users with free access to abstracts of its documents. However, citations between these documents need to be collected from external data sources. Although previous studies have investigated the coverage of various data sources, the quality of citations is underexplored. In response, this study compares the coverage and citation quality of five freely available data sources on 30 million PubMed documents, including OpenCitations Index of CrossRef open DOI-to-DOI citations (COCI), Dimensions, Microsoft Academic Graph (MAG), National Institutes…
In this paper, we present COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations (http://opencitations.net/index/coci). COCI is the first open citation index created by OpenCitations, in which we have applied the concept of citations as first-class data entities, and it contains more than 445 million DOI-to-DOI citation links derived from the data available in Crossref. These citations are described in RDF by means of the newly extended version of the OpenCitations Data Model (OCDM). We introduce the workflow we have developed for creating these data, and also show the additional …
We present a large-scale analysis of the accuracy of citation data in the Web of Science and Scopus databases. The analysis is based on citations given in publications in Elsevier journals. We reveal significant data quality problems for both databases. Missing and incorrect references are important problems in Web of Science. Duplicate publications are a serious problem in Scopus.
