arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.07343cs.HCcs.AI

ChatGPT 能否在编程入门课程中担任助教角色?

Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?

IIIT Delhi(德里印度理工学院)

Anishka, Atharva Mehta, Nipun Gupta, Aarav Balachandran, Dhruv Kumar, Pankaj Jalote

AI总结:

本文通过对比 ChatGPT 与人类助教在代码评分和反馈质量上的表现,评估其作为编程入门课程虚拟助教的可行性与教育意义。

摘要:

大型语言模型(LLM)的出现预计将对教育产生重大影响。本文探讨了将 ChatGPT(一种 LLM)用作编程入门课程虚拟助教(TA)的潜力。我们通过在若干重要 TA 职能中比较 ChatGPT 与人类 TA 的表现来评估其能力。我们重点关注的 TA 职能包括:(1)为学生代码提交评分;(2)向编程入门课程的本科生提供反馈。首先,我们使用给定的评分标准评估 ChatGPT 在为学生代码提交评分方面的熟练程度,并将其表现与人类 TA 给出的分数进行比较。其次,我们分析 ChatGPT 所提供反馈的质量和相关性。该评估从代码正确性和代码质量两个角度,考察 ChatGPT 指出错误并针对学生解决方案提出改进建议的能力。最后,我们讨论了将 ChatGPT 融入计算教育对自动评分、个性化学习体验和教学支持的意义。

英文摘要:

The emergence of Large language models (LLMs) is expected to have a major impact on education. This paper explores the potential of using ChatGPT, an LLM, as a virtual Teaching Assistant (TA) in an Introductory Programming Course. We evaluate ChatGPT's capabilities by comparing its performance with that of human TAs in some of the important TA functions. The TA functions which we focus on include (1) grading student code submissions, and (2) providing feedback to undergraduate students in an introductory programming course. Firstly, we assess ChatGPT's proficiency in grading student code submissions using a given grading rubric and compare its performance with the grades assigned by human TAs. Secondly, we analyze the quality and relevance of the feedback provided by ChatGPT. This evaluation considers how well ChatGPT addresses mistakes and offers suggestions for improvement in student solutions from both code correctness and code quality perspectives. We conclude with a discussion on the implications of integrating ChatGPT into computing education for automated grading, personalized learning experiences, and instructional support.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑