利用生成式AI实时增强编程错误信息
Enhancing Programming Error Messages in Real Time with Generative AI
AI总结：
本研究在自动评估工具Athene中集成ChatGPT反馈以增强编程错误信息，发现引入生成式AI未必提升工具效果，且界面设计对GPT-4反馈的可用性影响显著。
摘要：
生成式AI正在改变许多学科的教学方式，包括计算机科学。研究人员已经证明，生成式AI工具能够解决编程问题、编写大段代码，并用简单的语言解释复杂的代码。使用生成式AI来增强编程错误信息展现出了特别的前景。几十年来，学生和教师一直抱怨这些信息往往晦涩难懂。然而最近的研究表明，当通过GPT-4增强这些信息时，学生重复犯错的次数会减少。我们扩展了这项工作，为提交到我们的自动评估工具Athene的所有程序实现了来自ChatGPT的反馈，提供针对编译器、运行时和逻辑错误的帮助。我们的结果表明，将生成式AI添加到自动评估工具中并不一定会使其变得更好，而且界面的设计对GPT-4所提供反馈的可用性至关重要。
英文摘要：
Generative AI is changing the way that many disciplines are taught, including computer science. Researchers have shown that generative AI tools are capable of solving programming problems, writing extensive blocks of code, and explaining complex code in simple terms. Particular promise has been shown in using generative AI to enhance programming error messages. Both students and instructors have complained for decades that these messages are often cryptic and difficult to understand. Yet recent work has shown that students make fewer repeated errors when enhanced via GPT-4. We extend this work by implementing feedback from ChatGPT for all programs submitted to our automated assessment tool, Athene, providing help for compiler, run-time, and logic errors. Our results indicate that adding generative AI to an automated assessment tool does not necessarily make it better and that design of the interface matters greatly to the usability of the feedback that GPT-4 provided.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
