Research on the Application of Large Language Models in Automatic Question Generation: A Case Study of ChatGLM in the Context of High School Information Technology Curriculum
This study investigates the application effectiveness of the Large Language Model (LLMs) ChatGLM in the automated generation of high school information technology exam questions. Through meticulously designed prompt engineering strategies, the model is guided to generate diverse questions, which are then comprehensively evaluated by domain experts. The evaluation dimensions include the Hitting(the degree of alignment with teaching content), Fitting (the degree of embodiment of core competencies), Clarity (the explicitness of question descriptions), and Willing to use (the teacher's willingness to use the question in teaching). The results indicate that ChatGLM outperforms human-generated questions in terms of clarity and teachers' willingness to use, although there is no significant difference in hit rate and fit. This finding suggests that ChatGLM has the potential to enhance the efficiency of question generation and alleviate the burden on teachers, providing a new perspective for the future development of educational assessment systems. Future research could explore further optimizations to the ChatGLM model to maintain high fit and hit rates while improving the clarity of questions and teachers' willingness to use them.
GenAITEd Ghana: A First-of-Its-Kind Context-Aware and Curriculum-Aligned Conversational AI Agent for Teacher Education
University of Georgia(佐治亚大学);St. Joseph’s College of Education(圣约瑟夫教育学院);Bagabaga College of Education(巴加巴加教育学院);Gambaga College of Education(甘巴加教育学院);University of Education, Winneba(温尼巴教育大学);Komenda College of Education(科门达教育学院);University of Skills Training and Entrepreneurial Development(技能培训与创业发展大学);Generative AI for Education and Research in Africa (GenAI-ERA)(非洲生成式人工智能教育与研究组织(GenAI-ERA))
Should There be a Teacher In-the-Loop? A Study of Generative AI-Personalized Tasks Middle School
Department of Teaching and Learning(教学与学习系);Southern Methodist University(南方 Methodist 大学);WestEd(西斯特教育);American Institutes for Research(美国研究机构);University of Massachusetts Amherst(马萨诸塞大学阿姆赫斯特分校)
RoMathExam: A Longitudinal Dataset of Romanian Math Exams (1895-2025) with a Seven-Decade Core (1957-2025)
University of Bucharest, Faculty of Mathematics and Computer Science(布加勒斯特大学数学与计算机科学学院);Cu Drag si Sport SRL(Cu Drag si Sport公司);Softbinator Technologies(Softbinator技术公司)
Education-centered critical policy analysis of AI: Ghana's AI strategy as a case
University of Georgia(佐治亚大学);Université de Guyane(圭亚那大学);University of Manitoba(曼尼托巴大学);Gambaga College of Education(甘巴加教育学院);University for Development Studies(发展研究大学);The Open University(开放大学);St. Joseph’s College of Education(圣约瑟夫教育学院);Mampong Technical College of Education(曼庞技术教育学院);Bagabaga College of Education(巴加巴加教育学院)