arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.06495cs.DLstat.OT
收藏

解释研究评估的结果:几何方法

Interpreting the outcomes of research assessments: a geometrical approach

Beniamino Cappelletti-Montano, Silvia Columbu, Stefano Montaldo, Monica Musio

摘要:

研究评价和学术机构(科学领域、系、大学等)评估的比较是近年来高等教育系统的主要问题之一。一些国家评估机构采用的一种方法是,通过评估有限数量的出版物来评估研究质量,每种出版物都被评为$n$类。该方法为每个机构生成出版物在$n$类中的分布。在本文中,我们引入了一个自然的几何方法来比较这些评估,通过引入一个特设的距离从一个机构的性能,以最好的可能实现的评估。此外,为了避免比较非同质机构的方法学错误,我们引入了基于这样的距离的{ \em几何分数}。后者代表一个与被评估机构具有相同配置的理想机构表现最差的概率。我们应用我们的方法,基于几何分数,排名,在两个特定的科学领域,意大利大学使用的评估工作VQR 2011-2014的结果。

英文摘要:

Research evaluations and comparison of the assessments of academic institutions (scientific areas, departments, universities etc.) are among the major issues in recent years in higher education systems. One method, followed by some national evaluation agencies, is to assess the research quality by the evaluation of a limited number of publications in a way that each publication is rated among $n$ classes. This method produces, for each institution, a distribution of the publications in the $n$ classes. In this paper we introduce a natural geometric way to compare these assessments by introducing an ad hoc distance from the performance of an institution to the best possible achievable assessment. Moreover, to avoid the methodological error of comparing non-homogeneous institutions, we introduce a {\em geometric score} based on such a distance. The latter represents the probability that an ideal institution, with the same configuration as the one under evaluation, performs worst. We apply our method, based on the geometric score, to rank, in two specific scientific areas, the Italian universities using the results of the evaluation exercise VQR 2011-2014.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑