ChatGPT是一位好的教师教练吗？衡量其在课堂教学评分和提供可操作见解方面的零样本性能
Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction
AI总结：
本文提出评分、识别教学亮点与错失机会、给出可操作建议三项任务，评估ChatGPT零样本指导小学数学课堂的能力，发现其反馈相关但缺乏新颖性与洞察力。
摘要：
教练指导涉及课堂观察和专家反馈，是教师培训中一个广泛且基础的组成部分。然而，由于资源和获取专业知识的途径有限，大多数教师无法获得持续、高质量的教练指导。我们探讨生成式AI是否能够通过充当自动化教师教练，成为专家反馈的一种高性价比补充。为此，我们为生成式AI提出了三项教师教练任务：（A）基于课堂观察工具对转录片段进行评分；（B）识别良好教学策略的亮点和错失的机会；（C）提供可操作的建议，以激发更多的学生推理。我们招募了数学专家教师，针对小学数学课堂转录文本评估ChatGPT在每项任务上的零样本性能。结果表明，ChatGPT生成的回应与改进教学相关，但往往缺乏新颖性或深刻见解。例如，该模型82%的建议指向转录文本中教师已经在实施该建议的位置。我们的工作强调了为教师生成有见地、新颖且真实的反馈所面临的挑战，同时为未来研究克服这些障碍、提升生成式AI教练教师的能力铺平了道路。
英文摘要：
Coaching, which involves classroom observation and expert feedback, is a widespread and fundamental part of teacher training. However, the majority of teachers do not have access to consistent, high quality coaching due to limited resources and access to expertise. We explore whether generative AI could become a cost-effective complement to expert feedback by serving as an automated teacher coach. In doing so, we propose three teacher coaching tasks for generative AI: (A) scoring transcript segments based on classroom observation instruments, (B) identifying highlights and missed opportunities for good instructional strategies, and (C) providing actionable suggestions for eliciting more student reasoning. We recruit expert math teachers to evaluate the zero-shot performance of ChatGPT on each of these tasks for elementary math classroom transcripts. Our results reveal that ChatGPT generates responses that are relevant to improving instruction, but they are often not novel or insightful. For example, 82% of the model's suggestions point to places in the transcript where the teacher is already implementing that suggestion. Our work highlights the challenges of producing insightful, novel and truthful feedback for teachers while paving the way for future research to address these obstacles and improve the capacity of generative AI to coach teachers.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
