arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.11539cs.CY
收藏

大语言模型在自动生成试题中的应用研究:以高中信息技术课程情境下的ChatGLM为例

Research on the Application of Large Language Models in Automatic Question Generation: A Case Study of ChatGLM in the Context of High School Information Technology Curriculum

Yanxin Chen, Ling He

AI总结:

本研究评估了ChatGLM在高中信息技术试题自动生成中的效果,发现其在清晰度和教师使用意愿上优于人工出题,但命中率和拟合度无显著差异,表明其有潜力提升出题效率并减轻教师负担。

摘要:

本研究探讨了大语言模型(LLMs)ChatGLM在高中信息技术考试题目自动生成中的应用效果。通过精心设计的提示工程策略,引导模型生成多样化的试题,并由领域专家进行全面评估。评估维度包括:命中率(与教学内容的契合程度)、拟合度(核心素养的体现程度)、清晰度(题目描述的明确性)以及使用意愿(教师在教学中使用该题目的意愿)。结果表明,ChatGLM在清晰度和教师使用意愿方面优于人工生成的题目,尽管在命中率和拟合度上没有显著差异。这一发现表明,ChatGLM有潜力提高试题生成效率并减轻教师负担,为未来教育评估系统的发展提供了新的视角。未来的研究可以探索对ChatGLM模型的进一步优化,以在保持高拟合度和命中率的同时,提高题目的清晰度和教师的使用意愿。

英文摘要:

This study investigates the application effectiveness of the Large Language Model (LLMs) ChatGLM in the automated generation of high school information technology exam questions. Through meticulously designed prompt engineering strategies, the model is guided to generate diverse questions, which are then comprehensively evaluated by domain experts. The evaluation dimensions include the Hitting(the degree of alignment with teaching content), Fitting (the degree of embodiment of core competencies), Clarity (the explicitness of question descriptions), and Willing to use (the teacher's willingness to use the question in teaching). The results indicate that ChatGLM outperforms human-generated questions in terms of clarity and teachers' willingness to use, although there is no significant difference in hit rate and fit. This finding suggests that ChatGLM has the potential to enhance the efficiency of question generation and alleviate the burden on teachers, providing a new perspective for the future development of educational assessment systems. Future research could explore further optimizations to the ChatGLM model to maintain high fit and hit rates while improving the clarity of questions and teachers' willingness to use them.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑