科学计量学研究中再现性问题的探讨第1部分：直接再现性
Exploration of reproducibility issues in scientometric research Part 1: Direct reproducibility
摘要：
这是一项小规模探索性研究的第一部分，旨在开始评估科学计量学研究特有的再现性问题。这一努力的动机是希望产生经验数据，为科学计量学中关于可重复性的辩论提供信息。而不是试图重现研究，我们探讨如何评估“原则上”的可重复性的基础上发表的论文的内容进行了严格的审查。研究的第一部分侧重于直接再现性-即使用相同的数据，方法和程序再现原始研究产生的特定证据的能力。第二部分（Velden et al. 2018）致力于概念再现性-即通过使用不同数据，方法和程序的替代方法验证知识声明的稳健性。该研究是探索性的：它只调查了非常有限数量的出版物，并为我们开发用于识别已发表研究的潜在再现性问题的工具：这些是研究类型的分类和对再现性威胁的分类。我们选择了科学计量学中的五篇出版物作为样本，涵盖了理论、方法和实证性质的各种研究类型。基于我们在探索性综述中所做的观察，我们总结了这篇论文，并提出了关于如何处理和评估科学计量学中直接再现性的状态的开放性问题，这些问题将在莱顿STI 2018的“科学计量学中的再现性”专题讨论中讨论。
英文摘要：
This is the first part of a small-scale explorative study in an effort to start assessing reproducibility issues specific to scientometrics research. This effort is motivated by the desire to generate empirical data to inform debates about reproducibility in scientometrics. Rather than attempt to reproduce studies, we explore how we might assess "in principle" reproducibility based on a critical review of the content of published papers. The first part of the study focuses on direct reproducibility - that is the ability to reproduce the specific evidence produced by an original study using the same data, methods, and procedures. The second part (Velden et al. 2018) is dedicated to conceptual reproducibility - that is the robustness of knowledge claims towards verification by an alternative approach using different data, methods and procedures. The study is exploratory: it investigates only a very limited number of publications and serves us to develop instruments for identifying potential reproducibility issues of published studies: These are a categorization of study types and a taxonomy of threats to reproducibility. We work with a select sample of five publications in scientometrics covering a variation of study types of theoretical, methodological, and empirical nature. Based on observations made during our exploratory review, we conclude this paper with open questions on how to approach and assess the status of direct reproducibility in scientometrics, intended for discussion at the special track on "Reproducibility in Scientometrics" at STI2018 in Leiden.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
