机械TA 2:一个支持TA的同行评分系统
Mechanical TA 2: A System for Peer Grading with TA Support
摘要:
Mechanical TA 2(MTA 2)是一个开源的基于Web的同行评分应用程序,它利用可信的TA评分器来激励高质量的同行评审。以前的MTA原型实现证明了这个概念的价值,但既不适合大规模使用,也不容易扩展; MTA 2是一个完整的系统重新实现,克服了这些障碍。MTA 2服务于两个相互关联的目的:促进实际的同行评分,并作为不同同行评分机制的实验平台。该系统的特点是采用模块化设计,便于定制;支持根据学生的同侪评分能力将学生分为不同的群体;自动校准和抽查机制;学生能够对成绩提出上诉,并就个人评论提供反馈。
英文摘要:
Mechanical TA 2 (MTA2) is an open source web-based peer grading application that leverages trusted TA graders to incentivize high-quality peer review. A previous, prototype implementation of MTA proved the value of the concept, but was neither suitable for use at scale nor easily extensible; MTA2 is a complete reimplementation of the system that overcomes these hurdles. MTA2 serves two, interconnected purposes: facilitating practical peer grading and serving as a testbed for experimentation with different peer grading mechanisms. The system is characterized by a modular design that makes customization easy; support for dividing students into different pools based on their peer-grading prowess; mechanisms for automated calibration and spot checking; and the ability for students to appeal grades and to give feedback about individual reviews.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。