arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.23601cs.AI

增强大语言模型生成教育任务的多样性

Enhancing Diversity of LLM-Generated Educational Tasks

MPI-SWS(马克斯·普朗克研究所-斯图加特研究所);University of Vienna(维也纳大学)

Manh Hung Nguyen, Sebastian Tschiatschek, Adish Singla

AI总结:

针对大语言模型生成教育任务时内容同质化的问题,提出基于发散-收敛思维的两阶段提示框架CreativeDC,在Python编程领域生成的任务多样性提升约1.6倍,同时保持高实用性。

摘要:

大型语言模型(LLMs)已展现出大规模生成教育内容的潜力,可协助教育工作者创建练习题或为训练教育模型合成数据。然而,LLMs存在“人工蜂群思维”效应,即生成同质化内容。这种同质性限制了LLM生成任务的多样性,而多样性在教育场景中至关重要。本文研究如何在保持任务高实用性的同时提升其多样性。受创造力文献中发散-收敛思维阶段的启发,我们提出一个包含两个推理阶段的提示框架:(1)探索创意空间,(2)满足输入要求。我们评估了CreativeDC——该框架在Python编程领域的一个实例化方法,使用自动评估指标和专家评估。结果表明,CreativeDC生成的高实用性任务数量显著多于基线(约1.6倍)。我们的工作为大规模生成和评估更多样化的任务提供了有效方法。

英文摘要:

Large language models (LLMs) have shown the potential for generating educational content at scale, assisting educators in creating practice tasks or synthesizing data for training educational models. However, LLMs suffer from the ``Artificial Hivemind'' effect, where they produce homogeneous content. This homogeneity limits the diversity of LLM-generated tasks, a crucial factor in these educational settings. In this paper, we investigate how to increase the diversity of generated tasks while keeping their utility high. Inspired by the divergent--convergent thinking stages in creativity literature, we propose a prompting framework with two reasoning stages: (1) exploring the creative space, and (2) satisfying the input requirements. We evaluate CreativeDC, a method instantiated from this framework in the domain of Python programming, using both automated metrics and expert evaluation. Results show that CreativeDC produces significantly more distinct high-utility tasks (about $1.6\times$) than baselines. Our work offers an effective approach for generating and evaluating more diverse tasks at scale.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑