标记我的作品编程课程自动评分系统
Mark My Works Autograder for Programming Courses
AI总结:
Mark My Works通过结合传统单元测试与大语言模型生成解释,为编程课程提供更详细的自动评分和教学反馈。
摘要:
大型编程课程难以及时提供详细的代码反馈。我们开发了Mark My Works,一个结合传统单元测试与大语言模型生成解释的本地自动评分系统。该系统使用基于角色的提示来分析提交内容,评估代码质量,并生成教学反馈,同时保持推理过程的透明性。我们在一个包含191名学生的工程课程中试点了该系统,将AI生成的评估与人工评分在79份提交上进行比较。尽管AI评分与人工评分之间没有线性相关性(r = -0.177,p = 0.124),但两种系统都表现出相似的左偏分布,表明尽管评分哲学不同,它们仍能识别相似的质量层次。AI系统表现出更保守的评分(均值:59.95 vs 80.53人工),但生成了显著更多的技术反馈。
英文摘要:
Large programming courses struggle to provide timely, detailed feedback on student code. We developed Mark My Works, a local autograding system that combines traditional unit testing with LLM-generated explanations. The system uses role-based prompts to analyze submissions, critique code quality, and generate pedagogical feedback while maintaining transparency in its reasoning process. We piloted the system in a 191-student engineering course, comparing AI-generated assessments with human grading on 79 submissions. While AI scores showed no linear correlation with human scores (r = -0.177, p = 0.124), both systems exhibited similar left-skewed distributions, suggesting they recognize comparable quality hierarchies despite different scoring philosophies. The AI system demonstrated more conservative scoring (mean: 59.95 vs 80.53 human) but generated significantly more detailed technical feedback.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。