arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.15211cs.CLcs.AI
收藏

GPT-4 Turbo基于布鲁姆修订分类法从教材生成中小学阶段问题的效果如何?

How Effective is GPT-4 Turbo in Generating School-Level Questions from Textbooks Based on Bloom's Revised Taxonomy?

IIT Kharagpur(印度理工学院卡哈拉格普尔分校)

Subhankar Maity, Aniket Deroy, Sudeshna Sarkar

AI总结:

该研究评估零样本模式下GPT-4 Turbo基于布鲁姆修订分类法从NCERT教材生成教育问题的效果,发现其高阶问题生成能力突出、与人类评估整体一致但存在层级差异,需进一步优化以适配教育需求。

摘要:

我们评估了GPT-4 Turbo在零样本模式下从NCERT(印度国家教育研究与培训委员会)教材生成教育类问题的效果。研究表明,GPT-4 Turbo能够生成需要高阶思维技能的问题,尤其是在布鲁姆修订分类法的“理解”层级上。我们发现,GPT-4 Turbo生成的问题与人类评估的问题在复杂度方面存在显著一致性,但偶尔也有差异。我们的评估还揭示了人类和机器评估问题质量的方式存在差异,且该差异与布鲁姆修订分类法的层级呈负相关趋势。这些发现表明,尽管GPT-4 Turbo是一款颇具前景的教育问题生成工具,但其效能在不同认知层级上存在差异,说明还需进一步优化才能完全满足教育标准。

英文摘要:

We evaluate the effectiveness of GPT-4 Turbo in generating educational questions from NCERT textbooks in zero-shot mode. Our study highlights GPT-4 Turbo's ability to generate questions that require higher-order thinking skills, especially at the "understanding" level according to Bloom's Revised Taxonomy. While we find a notable consistency between questions generated by GPT-4 Turbo and those assessed by humans in terms of complexity, there are occasional differences. Our evaluation also uncovers variations in how humans and machines evaluate question quality, with a trend inversely related to Bloom's Revised Taxonomy levels. These findings suggest that while GPT-4 Turbo is a promising tool for educational question generation, its efficacy varies across different cognitive levels, indicating a need for further refinement to fully meet educational standards.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑