arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.05034cs.CY
收藏

理解学生在解决自然语言编程任务时的认知、错误及调试方法

Understanding Student Perceptions, Mistakes, and Debugging Approaches when Solving Natural Language Programming Tasks

MPI-SWS(马克斯·普朗克软件系统研究所);University of Auckland(奥克兰大学);Abilene Christian University(阿比林基督教大学);Aalto University(阿尔托大学);Temple University(天普大学)

Victor-Alexandru Pădurean, Kaitlin Riegel, Gweneth Barbre, Musa Blake, Paul Denny, Alkis Gotovos, Juho Leinonen, Stephen MacNeil, James Prather, Adish Singla

AI总结:

研究新手程序员解决自然语言编程任务时的提示错误、沟通问题及调试策略。通过分析超900名学生尝试解决基于对话的提示问题,发现提示更易且有趣,常见错误是遗漏关键细节,失败时注重澄清意图。

摘要:

学习与代码生成人工智能模型通信是新手程序员的一项新兴技能。一种教学方法是提示问题,让学生通过为代码生成人工智能模型编写自然语言提示来解决计算任务。但对于新手程序员在提示层面的具体错误、未能传达的计算细节以及代码错误时的恢复策略知之甚少。在一门CS1课程中,我们研究了900多名学生解决基于对话的提示问题的尝试。我们分析了学生的反思、不成功的提示和报告的调试策略。与传统编码任务相比,学生通常发现提示更容易、更有趣,并且更有针对性地培养解决问题的技能。最常见的错误与关键细节的遗漏有关,这表明既没有认识到它们的重要性,也过度依赖人工智能来推断它们。当提示失败时,学生更多地关注澄清他们的意图和反思提供的问题细节,而不是跟踪生成的代码或检查测试用例。

英文摘要:

Learning to communicate with code-generating AI models is an emerging skill for novice programmers. One recent pedagogical approach, Prompt Problems, has students solve computational tasks by writing natural-language prompts for code-generating AI models. However, little is known about the specific prompt-level mistakes novice programmers make, the kinds of computational details they fail to communicate, and what strategies they use to recover when generated code is incorrect. In a CS1 course, we studied attempts by more than 900 students to solve dialogue-based Prompt Problems. We analyzed student reflections, unsuccessful prompts, and reported debugging strategies. Compared to traditional coding tasks, students generally found prompting easier, more enjoyable, and better targeted at developing problem-solving skills. The most common mistakes are related to the omission of key details, suggesting both a failure to acknowledge their importance and over-reliance on AI to infer them. When prompts failed, students focused more on clarifying their intent and reflecting on the provided problem details than on tracing generated code or examining test cases.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑