AI走进课堂:大型语言模型何时会损害学习?
AI Meets the Classroom: When Do Large Language Models Harm Learning?
AI总结:
本文通过实验室与实地实验发现,LLMs对学习结果的影响取决于使用方式:替代式使用增加学习广度但降低理解深度,补充式使用提升理解,且LLMs会扩大不同先验知识学生间的差距。
摘要:
大型语言模型(LLMs)在教育中的效果存在争议:先前研究表明,LLMs既可能有助于学习,也可能损害学习。在两项预先注册且带有激励措施的实验室实验中,我们发现LLMs对整体学习结果没有影响。在探索性分析和一项实地研究中,我们提供了证据表明LLMs对学习结果的影响取决于使用行为。用LLMs替代部分学习活动的学生(例如,通过生成练习题答案)增加了他们能够学习的主题数量,但降低了对每个主题的理解深度。将LLMs作为学习活动补充的学生(例如,通过请求解释)没有增加主题数量,但确实提高了理解水平。我们还观察到,LLMs扩大了低先验知识与高先验知识学生之间的差距。虽然LLMs显示出改善学习的巨大潜力,但其使用必须根据教育情境和学生的需求进行定制。
英文摘要:
The effect of large language models (LLMs) in education is debated: Previous research shows that LLMs can help as well as hurt learning. In two pre-registered and incentivized laboratory experiments, we find no effect of LLMs on overall learning outcomes. In exploratory analyses and a field study, we provide evidence that the effect of LLMs on learning outcomes depends on usage behavior. Students who substitute some of their learning activities with LLMs (e.g., by generating solutions to exercises) increase the volume of topics they can learn about but decrease their understanding of each topic. Students who complement their learning activities with LLMs (e.g., by asking for explanations) do not increase topic volume but do increase their understanding. We also observe that LLMs widen the gap between students with low and high prior knowledge. While LLMs show great potential to improve learning, their use must be tailored to the educational context and students' needs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。