arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.03374cs.CYcs.AIcs.CL
收藏

教育AI中用于认知对齐的轻量级提示工程:OneClickQuiz案例研究

Lightweight Prompt Engineering for Cognitive Alignment in Educational AI: A OneClickQuiz Case Study

Learning, Data and Robotics (LDR), esieaLab ESIEA(ESIEA 学习、数据与机器人实验室(LDR));Faculty of Science, Lebanese University(黎巴嫩大学理学院)

Antoun Yaacoub, Zainab Assaghir, Jérôme Da-Rugna

AI总结:

本研究以教育AI插件OneClickQuiz为对象,探究三种轻量级提示工程策略对AI生成问题的布鲁姆认知层级对齐效果的影响,发现详细提示更能保障认知对齐,为教育AI的提示优化提供参考。

摘要:

人工智能(AI)在教育技术中的快速融合有望革新内容创建与评估方式。然而,AI生成内容的质量及其教学对齐性仍是关键挑战。本文研究了轻量级提示工程策略对OneClickQuiz(一款利用生成式AI的Moodle插件)中AI生成问题的认知对齐效果的影响。我们在布鲁姆分类法的知识、应用和分析三个层级上,评估了三种提示变体——详细基线提示、更简洁的版本以及基于角色的方法。通过使用(先前研究提出的)自动分类模型和人工评审,我们的研究结果表明,明确、详细的提示对于实现精准的认知对齐至关重要。尽管更简洁的提示和基于角色的提示能生成清晰且相关的问题,但它们经常与预期的布鲁姆层级错位,生成的内容要么过于复杂,要么偏离了预期的认知目标。本研究强调了策略性提示工程在打造具备教学合理性的AI驱动教育解决方案中的重要性,并为在学习分析与智慧学习环境中优化AI以生成高质量内容提供了建议。

英文摘要:

The rapid integration of Artificial Intelligence (AI) into educational technology promises to revolutionize content creation and assessment. However, the quality and pedagogical alignment of AI-generated content remain critical challenges. This paper investigates the impact of lightweight prompt engineering strategies on the cognitive alignment of AI-generated questions within OneClickQuiz, a Moodle plugin leveraging generative AI. We evaluate three prompt variants-a detailed baseline, a simpler version, and a persona-based approach-across Knowledge, Application, and Analysis levels of Bloom's Taxonomy. Utilizing an automated classification model (from prior work) and human review, our findings demonstrate that explicit, detailed prompts are crucial for precise cognitive alignment. While simpler and persona-based prompts yield clear and relevant questions, they frequently misalign with intended Bloom's levels, generating outputs that are either too complex or deviate from the desired cognitive objective. This study underscores the importance of strategic prompt engineering in fostering pedagogically sound AI-driven educational solutions and advises on optimizing AI for quality content generation in learning analytics and smart learning environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑