Programming education should aim to provide students with a broad range of skills that they will later use while developing software. An important aspect in this is their ability to write code that is not only correct but also of high quality. Unfortunately, this is difficult to control in the setting of a massive open online course. In this paper, we carry out an analysis of the code quality of submissions from JetBrains Academy - a platform for studying programming in an industry-like project-based setting with an embedded code quality assessment tool called Hyperstyle. We analyzed more than a million Java submissions and more than 1.3 million Python submissions, studied the most prevalent types of code quality issues and the dynamics of how students fix them. We provide several case studies of different issues, as well as an analysis of why certain issues remain unfixed even after several attempts. Also, we studied abnormally long sequences of submissions, in which students attempted to fix code quality issues after passing the task. Our results point the way towards the improvement of online courses, such as making sure that the task itself does not incentivize students to write code poorly.
Beyond Models: Reflections on Engineering AI-enabled Systems in a Project-Based Course
Department of Mathematics and Computer Science, University of Bremen(不莱梅大学数学与计算机科学系);School of Computing Technologies, RMIT University(皇家墨尔本理工学院计算技术学院)
Learning Program Embeddings to Propagate Feedback on Student Code
Stanford University(斯坦福大学)
提供反馈,既评估最终的工作,又给卡住的学生提供提示,对于从数千到数百万学生的大规模在线课程中的开放式作业来说是很困难的。我们引入了一个神经网络的方法来编码程序作为一个线性映射从嵌入的前置空间到嵌入的后置空间,并提出了一个算法的反馈规模使用这些线性映射作为功能。我们将我们的算法应用于Code.org Hour of Code和斯坦福大学CS1课程的评估,在那里我们将人类对学生作业的评论传播到数量级更多的提交。