arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.21790cs.CYcs.AI
收藏

减少英国高等教育研究官僚主义:生成式AI能否协助内部质量评估?

Reducing research bureaucracy in UK higher education: Can generative AI assist with the internal evaluation of quality?

Salford Business School, University of Salford(索尔福德大学索尔福德商学院)

Gordon Fletcher, Saomai Vu Khan, Aldus Greenhill Fletcher

AI总结:

本文研究生成式AI在英国高等教育研究质量内部评估中的应用,通过AI评分与实际结果对比,展示AI在提高评估效率和一致性方面的潜力。

摘要:

本文探讨了生成式人工智能(GenAI)在帮助英国高等教育机构进行研究质量内部审查过程中的潜力,特别是在准备研究卓越框架(REF)时。通过可行系统模型中的功能替代视角,我们使用ChatGPT对REF 2021提交的商业与管理论文进行评分和排序,"逆向工程"评估过程,通过将AI生成的评分与已知机构结果进行比较。通过对822篇论文在11个机构中的严格测试,我们确定了与报告REF结果一致的评分界限:49%在1*到2*之间,59%在2*到3*之间,69%在3*到4*之间。结果表明,AI可以提供一致的评估,帮助识别需要额外人工审查的边缘评估案例,同时减少传统内部审查过程的大量资源负担。我们主张通过一种细致的混合方法进行应用,以保持学术诚信,同时应对与研究评估官僚主义相关的数百万英镑成本。尽管承认这些局限性,包括潜在的AI偏见,本研究提出了一种有前景的框架,用于更高效、一致的评估,可能改变当前的研究评估方法。

英文摘要:

This paper examines the potential for generative artificial intelligence (GenAI) to assist with internal review processes for research quality evaluations in UK higher education and particularly in preparation for the Research Excellence Framework (REF). Using the lens of function substitution in the Viable Systems Model, we present an experimental methodology using ChatGPT to score and rank business and management papers from REF 2021 submissions, "reverse engineering" the assessment by comparing AI-generated scores with known institutional results. Through rigourous testing of 822 papers across 11 institutions, we established scoring boundaries that aligned with reported REF outcomes: 49% between 1* and 2*, 59% between 2* and 3*, and 69% between 3* and 4*. The results demonstrate that AI can provide consistent evaluations that help identify borderline evaluation cases requiring additional human scrutiny while reducing the substantial resource burden of traditional internal review processes. We argue for application through a nuanced hybrid approach that maintains academic integrity while addressing the multi-million pound costs associated with research evaluation bureaucracy. While acknowledging these limitations including potential AI biases, the research presents a promising framework for more efficient, consistent evaluations that could transform current approaches to research assessment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑