arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.07427cs.HC
收藏

AI代码生成器在入门程序设计中对初学者的支持作用研究

Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming

Majeed Kazemitabaar, Justin Chow, Carl Ka To Ma, Barbara J. Ericson, David Weintrop, Tovi Grossman

摘要:

像OpenAI Codex这样的AI代码生成器有可能通过从自然语言描述中生成代码来帮助新手程序员,但是,过度依赖可能会对学习和保留产生负面影响。为了探索人工智能代码生成器对入门编程的影响,我们对69名新手(10 - 17岁)进行了一项对照实验。学习者完成了45个Python代码编写任务,其中一半的学习者可以访问Codex,每个任务之后都有一个代码修改任务。我们的研究结果表明,使用Codex显着提高了代码编写性能(完成率提高了1.15倍,得分提高了1.8倍),同时不会降低手动代码修改任务的性能。此外,在培训阶段获得Codex的学习者在一周后进行的评估后测试中表现略好,尽管这种差异没有达到统计学意义。有趣的是,学习者与较高的Scratch预测试成绩表现出显着更好的保留后测试,如果他们有事先获得法典。

英文摘要:

AI code generators like OpenAI Codex have the potential to assist novice programmers by generating code from natural language descriptions, however, over-reliance might negatively impact learning and retention. To explore the implications that AI code generators have on introductory programming, we conducted a controlled experiment with 69 novices (ages 10-17). Learners worked on 45 Python code-authoring tasks, for which half of the learners had access to Codex, each followed by a code-modification task. Our results show that using Codex significantly increased code-authoring performance (1.15x increased completion rate and 1.8x higher scores) while not decreasing performance on manual code-modification tasks. Additionally, learners with access to Codex during the training phase performed slightly better on the evaluation post-tests conducted one week later, although this difference did not reach statistical significance. Of interest, learners with higher Scratch pre-test scores performed significantly better on retention post-tests, if they had prior access to Codex.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑