arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09974cs.CYcs.AIcs.CLcs.HC
收藏

ChatGPT 对语言教师教案创作的有用程度如何?

To what extent is ChatGPT useful for language teacher lesson plan creation?

University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校)

Alex Dornburg, Kristin Davin

AI总结:

本研究通过不同复杂度的零样本提示测试ChatGPT生成外语教案的效果,发现教案整体质量尚可但提示细化未必提升质量,且输出存在反映新旧教学理念冲突的变异性,为外语教师使用AI工具及相关研究提供参考。

摘要:

生成式AI模型的出现为辅助教师生成教学材料带来了巨大潜力。然而,关于这些模型行为的诸多认知空白,使得为其有效使用生成基于研究的指导变得模糊不清。本研究评估了通过零样本提示(zero-shot prompting)在ChatGPT中生成的外语教师教案在提示特异性、变异性和弱点方面的趋势。通过迭代一系列复杂度递增的提示,我们发现输出的教案整体质量较高,但为提示添加额外背景信息和特异性并不一定能带来质量的相应提升。此外,我们观察到同一提示生成的输出存在极端的变异性案例。在许多情况下,这种变异性反映了20世纪与21世纪教学实践之间的冲突。这些结果表明,生成式AI模型基于有关教学实践的经典文本进行训练,可能是一个目前尚未得到充分探索的主题,这可能导致生成的内容偏向于早已被研究驳斥的教学实践。总体而言,我们的研究结果为在职和受训外语教师使用AI工具提供了直接的转化意义。更广泛地说,这些发现揭示了生成式AI输出趋势的存在,这对多个内容领域的教学材料生成具有启示意义。

英文摘要:

The advent of generative AI models holds tremendous potential for aiding teachers in the generation of pedagogical materials. However, numerous knowledge gaps concerning the behavior of these models obfuscate the generation of research-informed guidance for their effective usage. Here we assess trends in prompt specificity, variability, and weaknesses in foreign language teacher lesson plans generated by zero-shot prompting in ChatGPT. Iterating a series of prompts that increased in complexity, we found that output lesson plans were generally high quality, though additional context and specificity to a prompt did not guarantee a concomitant increase in quality. Additionally, we observed extreme cases of variability in outputs generated by the same prompt. In many cases, this variability reflected a conflict between 20th century versus 21st century pedagogical practices. These results suggest that the training of generative AI models on classic texts concerning pedagogical practices may represent a currently underexplored topic with the potential to bias generated content towards teaching practices that have been long refuted by research. Collectively, our results offer immediate translational implications for practicing and training foreign language teachers on the use of AI tools. More broadly, these findings reveal the existence of generative AI output trends that have implications for the generation of pedagogical materials across a diversity of content areas.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑