人与自动反馈对学生理解AI概念和编程风格的影响
Effects of Human vs. Automatic Feedback on Students' Understanding of AI Concepts and Programming Style
摘要：
自动评分工具的使用在大型本科编程课程中几乎无处不在，最近的工作集中在提高自动生成反馈的质量上。然而，在接受计算机生成的反馈和人类书面反馈时，直接比较学生成绩的数据相对缺乏。本文通过将一个90名学生的班级分成两个反馈组，并分析两组学生的表现差异来解决这一差距。这门课是人工智能的入门课，有硬件编程作业。一组学生收到了关于他们编程作业的详细的计算机生成的反馈，描述了算法逻辑的哪些部分缺失;另一组学生还收到了人类撰写的反馈，描述了他们的程序语法如何与他们的逻辑问题相关，以及改进他们代码的定性（风格）建议。测验和考试问题的结果表明，人类的反馈有助于学生获得更好的概念理解，但分析发现，小组在最终项目上的合作能力没有差异。课程成绩分布显示，接受人类书面反馈的学生总体表现更好;这种效果在每组的中间两个四分位数中最为明显。这些结果表明，反馈的语法逻辑关系可能是一个主要的机制，人类的反馈提高学生的成绩。
英文摘要：
The use of automatic grading tools has become nearly ubiquitous in large undergraduate programming courses, and recent work has focused on improving the quality of automatically generated feedback. However, there is a relative lack of data directly comparing student outcomes when receiving computer-generated feedback and human-written feedback. This paper addresses this gap by splitting one 90-student class into two feedback groups and analyzing differences in the two cohorts' performance. The class is an intro to AI with programming HW assignments. One group of students received detailed computer-generated feedback on their programming assignments describing which parts of the algorithms' logic was missing; the other group additionally received human-written feedback describing how their programs' syntax relates to issues with their logic, and qualitative (style) recommendations for improving their code. Results on quizzes and exam questions suggest that human feedback helps students obtain a better conceptual understanding, but analyses found no difference between the groups' ability to collaborate on the final project. The course grade distribution revealed that students who received human-written feedback performed better overall; this effect was the most pronounced in the middle two quartiles of each group. These results suggest that feedback about the syntax-logic relation may be a primary mechanism by which human feedback improves student outcomes.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
