Measures for research activity and impact have become an integral ingredient in the assessment of a wide range of entities (individual researchers, organizations, instruments, regions, disciplines). Traditional bibliometric indicators, like publication and citation based indicators, provide an essential part of this picture, but cannot describe the complete picture. Since reading scholarly publications is an essential part of the research life cycle, it is only natural to introduce measures for this activity in attempts to quantify the efficiency, productivity and impact of an entity. Citations and reads are significantly different signals, so taken together, they provide a more complete picture of research activity. Most scholarly publications are now accessed online, making the study of reads and their patterns possible. Click-stream logs allow us to follow information access by the entire research community, real-time. Publication and citation datasets just reflect activity by authors. In addition, download statistics will help us identify publications with significant impact, but which do not attract many citations. Click-stream signals are arguably more complex than, say, citation signals. For one, they are a superposition of different classes of readers. Systematic downloads by crawlers also contaminate the signal, as does browsing behavior. We discuss the complexities associated with clickstream data and how, with proper filtering, statistically significant relations and conclusions can be inferred from download statistics. We describe how download statistics can be used to describe research activity at different levels of aggregation, ranging from organizations to countries. These statistics show a correlation with socio-economic indicators. A comparison will be made with traditional bibliometric indicators. We will argue that astronomy is representative of more general trends.
Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics
本文分析了预印本促进学术交流的关键驱动因素。为此,我们使用了四组指标,一组指的是学术交流,并基于文献计量指标(Web of Science和Scopus引文),而其他指标反映了使用(Web of Science中的使用计数),捕获(Mendeley读者)和社交媒体关注(推文)。因此,我们衡量两个影响与预印本出版:出版延迟和影响。我们定义并使用几个指标来评估arXiv中先前预印本版本的期刊文章的影响。特别是,这些指标衡量了几次arXiv预印本出版过程和期刊版本审查过程的特点,以及预印本引用的老化模式。此外,我们比较了在arXiv中没有任何先前预印本版本的预印本和非OA文章之间观察到的模式。我们可以观察到,预印本的“早期浏览”和“开放获取”效应有助于预印本的可衡量的引用和读者优势。预印版本的文章更有可能在社交媒体中被提及,并且具有更短的Altmetric注意延迟。使用和捕获被证明只有适度的,但更强的相关性与引用比推文。不同指标之间回归线的斜率不同,反映了使用、获取和引用数据的数量级不同。
Characteristics of International versus Non-International Scientific Publication Media in Team- and Author-Based Data
国际出版物和引文数据库Web of Science和Scopus的覆盖面扩大到地方社会科学媒体,这是对这些数据库在评价和供资系统中的使用增加的一个可喜的反应。以前提供的大多数国际期刊是制定现行标准文献计量指标的基础。同样的指标在应用于新引入或扩展的媒体类别时可能不再能衡量完全相同的概念,这些类别可能具有与国际期刊不同的特点。本文探讨了有和没有国际维度的媒体在团队和作者层面上的出版数据的差异。研究结果将国际出版物类别与研究质量联系起来,这对于验证其在旨在促进质量的评估或资助模式中的使用非常重要。
The Distribution of the Asymptotic Number of Citations to Sets of Publications by a Researcher or From an Academic Department Are Consistent With a Discrete Lognormal Model
Evaluation of the citation matching algorithms of CWTS and iFQ in comparison to Web of Science
文献计量研究小组,例如科学和技术研究中心和研究信息和质量保证研究所,提供的文献计量研究结果经常用于研究评估过程。他们的数据库使用Web of Science(WoS)引用数据,他们根据自己的匹配算法进行匹配-在CWTS的情况下用于他们研究中的标准使用,在iFQ的情况下用于实验。由于WoS中的不匹配引用问题由于参考文献中的不准确或数据提取过程中引入的不准确而持续存在,因此确定这些引用匹配算法中这些不准确的纠正程度是很重要的。本文评估的算法CWTS和IFQ相比,WoS在定量和定性分析。分析建立在方法和手动验证语料库的以前的研究。CWTS算法的性能最好,紧随其后的是iFQ。WoS算法仍然表现得很好(F1得分:96.41%),但在匹配包含不准确性的参考文献时表现出不足。另一个问题是WoS在源文章中错误地提供了引用的参考信息。
Scores of a specific field-normalized indicator calculated with different approaches of field-categorization: Are the scores different or similar?
字段标准化引文评分的使用是一种文献计量学标准。使用不同的字段规范化方法,但字段分类系统的选择也决定了最终的字段规范化引用分数。使用Web of Science数据,我们使用相同的公式但不同的字段分类系统来计算字段标准化引用分数,以回答所得分数是否不同或相似的问题。使用了六个字段分类系统:三个基于引用关系,一个基于语义相似性得分(即,主题相关性测量),一个关于期刊集,一个关于智力分类。基于期刊集和知识分类的系统至少在中等水平上达成一致。基于引用关系的三个集合中有两个也同意至少中等水平。基于引文关系和语义相似性得分,第三组数据存在较大差异。主要的政策含义是,在没有更深入地了解用于得出这些值或排名的分类系统的情况下,不应比较标准化的引用影响力分数或基于它们的排名。