arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1403.4064cs.PL
收藏

程序设计导论中性能问题的反馈生成

Feedback Generation for Performance Problems in Introductory Programming Assignments

Sumit Gulwani, Ivan Radiček, Florian Zuleger

摘要:

手动提供编程任务的反馈是一项乏味、容易出错且耗时的任务。在本文中,我们激励和解决的问题,在介绍编程作业的性能方面产生反馈。我们研究了大量功能正确的学生解决方案,介绍编程作业和观察:(1)有不同的算法策略,不同的效率水平,解决给定的问题。这些不同的策略需要不同的反馈。(2)相同的算法策略可以以无数不同的方式实现,这些方式与报告学生计划的反馈无关。我们提出了一个轻量级的程序设计语言的扩展,允许教师定义的算法策略,通过指定某些关键值,应该发生在执行的实现。我们描述了一个基于动态分析的方法来测试学生的程序是否符合教师的规格。我们的实验结果说明了我们的规约语言和我们的动态分析的有效性。在我们的一个基准测试中,包括3个编程问题的2316个功能正确的实现,我们确定了16个策略,我们能够使用我们的规约语言描述(在检查66个之后的95分钟内,即,约3%,实现)。我们的动态分析将每个实现与其相应的规范正确匹配,从而自动产生预期的反馈。

英文摘要:

Providing feedback on programming assignments manually is a tedious, error prone, and time-consuming task. In this paper, we motivate and address the problem of generating feedback on performance aspects in introductory programming assignments. We studied a large number of functionally correct student solutions to introductory programming assignments and observed: (1) There are different algorithmic strategies, with varying levels of efficiency, for solving a given problem. These different strategies merit different feedback. (2) The same algorithmic strategy can be implemented in countless different ways, which are not relevant for reporting feedback on the student program. We propose a light-weight programming language extension that allows a teacher to define an algorithmic strategy by specifying certain key values that should occur during the execution of an implementation. We describe a dynamic analysis based approach to test whether a student's program matches a teacher's specification. Our experimental results illustrate the effectiveness of both our specification language and our dynamic analysis. On one of our benchmarks consisting of 2316 functionally correct implementations to 3 programming problems, we identified 16 strategies that we were able to describe using our specification language (in 95 minutes after inspecting 66, i.e., around 3%, implementations). Our dynamic analysis correctly matched each implementation with its corresponding specification, thereby automatically producing the intended feedback.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑