意大利国家科学资格(英语:Italian National Scientific Qualification)是申请国立大学终身副教授或教授职位的先决条件。该证书旨在证明一个人已经达到了合适的科学成熟度水平,可以申请教授职位。为每个科学学科指定的五人小组负责通过影响和生产力的量化指标以及通过评估其研究概况来评估申请人。对评价标准的适当性,特别是对使用文献计量学评价个别研究人员的问题提出了许多关切。其他关切涉及到最后评价报告被认为质量不佳。在本文中,我们评估的应用方法的适当性,并提供给申请人的反馈质量的条件下的benefit。我们认为,在使用文献计量学指标评价个别研究人员的最佳做法是不完全符合的,此外,最终报告的质量有很大的差异,在各小组,建议采取措施,以防止草率的做法,在未来的研究。
英文摘要:
The Italian National Scientific Qualification (ASN) was introduced as a prerequisite for applying for tenured associate or full professor positions at state-recognized universities. The ASN is meant to attest that an individual has reached a suitable level of scientific maturity to apply for professorship positions. A five member panel, appointed for each scientific discipline, is in charge of evaluating applicants by means of quantitative indicators of impact and productivity, and through an assessment of their research profile. Many concerns were raised on the appropriateness of the evaluation criteria, and in particular on the use of bibliometrics for the evaluation of individual researchers. Additional concerns were related to the perceived poor quality of the final evaluation reports. In this paper we assess the ASN in terms of appropriateness of the applied methodology, and the quality of the feedback provided to the applicants. We argue that the ASN is not fully compliant with the best practices for the use of bibliometric indicators for the evaluation of individual researchers; moreover, the quality of final reports varies considerably across the panels, suggesting that measures should be put in place to prevent sloppy practices in future ASN rounds.
Do open citations give insights on the qualitative peer-review evaluation in research assessments? An analysis of the Italian National Scientific Qualification
Refrain from adopting the combination of citation and journal metrics to grade publications, as used in the Italian national research assessment exercise (VQR 2011-2014)
The false myth of the rise in self-citations, and the impressively positive effect of bibliometric evaluations on the increase of the impact of Italian research