arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.06253cs.CYcs.AI
收藏

基于LLM的评分量规评估:多阶段积木式编程任务中的代数能力——设计与现场评估

LLM-Driven Rubric-Based Assessment of Algebraic Competence in Multi-Stage Block Coding Tasks with Design and Field Evaluation

Hongik University(弘益大学)

Yong Oh Lee, Byeonghun Bang, Sejun Oh

AI总结:

本研究提出并现场验证了一个由LLM驱动的评分量规评估框架,用于多阶段积木式编程任务中的代数能力,与专家判断高度一致,并生成面向过程的反馈,证明了其有效性和可扩展性。

摘要:

随着在线教育平台的持续扩展,对于评估方法的需求日益增长,这些方法不仅要衡量答案的准确性,还要捕捉学生认知过程的深度,并与课程目标保持一致。本研究提出并评估了一种由大型语言模型(LLM)驱动的基于评分量规的评估框架,用于衡量代数能力和真实情境下的积木式编程任务。该问题集由数学教育专家设计,将每个问题片段与五个预定义的评分量规维度对齐,使LLM能够评估学生问题解决过程的正确性和质量。该系统在一个在线平台上实现,该平台记录所有中间响应,并利用LLM进行与评分量规一致的成就评估。为了检验所提出框架的实际有效性,我们进行了一项实地研究,涉及42名中学生参与多阶段二次方程积木式编程任务。该研究整合了学习者自我评估和专家评分,以基准测试系统的输出。基于LLM的评分量规评估与专家判断表现出高度一致性,并持续产生与评分量规一致、面向过程的反馈。这些结果证明了将LLM驱动的评分量规评估纳入在线数学和STEM教育平台的有效性和可扩展性。

英文摘要:

As online education platforms continue to expand, there is a growing need for assessment methods that not only measure answer accuracy but also capture the depth of students' cognitive processes in alignment with curriculum objectives. This study proposes and evaluates a rubric-based assessment framework powered by a large language model (LLM) for measuring algebraic competence, real-world-context block coding tasks. The problem set, designed by mathematics education experts, aligns each problem segment with five predefined rubric dimensions, enabling the LLM to assess both correctness and quality of students' problem-solving processes. The system was implemented on an online platform that records all intermediate responses and employs the LLM for rubric-aligned achievement evaluation. To examine the practical effectiveness of the proposed framework, we conducted a field study involving 42 middle school students engaged in multi-stage quadratic equation tasks with block coding. The study integrated learner self-assessments and expert ratings to benchmark the system's outputs. The LLM-based rubric evaluation showed strong agreement with expert judgments and consistently produced rubric-aligned, process-oriented feedback. These results demonstrate both the validity and scalability of incorporating LLM-driven rubric assessment into online mathematics and STEM education platforms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑