As online education platforms continue to expand, there is a growing need for assessment methods that not only measure answer accuracy but also capture the depth of students' cognitive processes in alignment with curriculum objectives. This study proposes and evaluates a rubric-based assessment framework powered by a large language model (LLM) for measuring algebraic competence, real-world-context block coding tasks. The problem set, designed by mathematics education experts, aligns each problem segment with five predefined rubric dimensions, enabling the LLM to assess both correctness and quality of students' problem-solving processes. The system was implemented on an online platform that records all intermediate responses and employs the LLM for rubric-aligned achievement evaluation. To examine the practical effectiveness of the proposed framework, we conducted a field study involving 42 middle school students engaged in multi-stage quadratic equation tasks with block coding. The study integrated learner self-assessments and expert ratings to benchmark the system's outputs. The LLM-based rubric evaluation showed strong agreement with expert judgments and consistently produced rubric-aligned, process-oriented feedback. These results demonstrate both the validity and scalability of incorporating LLM-driven rubric assessment into online mathematics and STEM education platforms.
School of Philosophy (Political Philosophy) Renmin University of China(哲学学院(政治哲学)中国人民大学);School of Government and Policy Johns Hopkins University(政府与政策学院约翰霍普金斯大学)
TPS-CalcBench: A Benchmark and Diagnostic Evaluation Framework for LLM Analytical Calculation Competence in Hypersonic Thermal Protection System Engineering
School of Civil Engineering, Beijing Jiaotong University, Beijing 100044, China(北京交通大学土木工程学院)
SWE-Game: Can Coding Agents Build the Games We Want?
Shanghai Jiao Tong University(上海交通大学);Zhongguancun Academy(中关村学院);Shanghai Innovation Institute(上海创新研究院);Shenzhen University(深圳大学);Beijing University of Posts and Telecommunications(北京邮电大学);Elbetech Technology(埃尔贝特科技)
Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agents
Department of Computer Science, New York University, CIMS, New York, USA(纽约大学计算机科学系,CIMS,纽约,美国);Department of Computer Science, Cleveland State University, Cleveland, USA(克利夫兰州立大学计算机科学系,克利夫兰,美国)
When Models Disagree: Rethinking LLM Evaluation for Public Comment Analysis
AI Lab, Princeton University Engineering and Applied Sciences(普林斯顿大学人工智能实验室、工程与应用科学学院);RAND Corporation(RAND公司);Engineering and Applied Sciences(工程与应用科学);Science, Technology, and International Affairs(科学、技术与国际事务);Georgetown University(乔治·华盛顿大学)
Generative AI Feedback, English Writing and Teacher Rubrics: A Multiple-Case Study of CyberScholar
Zhetysu University named after I. Zhansugurov(赞苏古罗夫扎特尤州大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Universidade Federal de Sergipe(塞尔希培联邦大学)
Toward LLM-Supported Automated Assessment of Critical Thinking Subskills
University of Minnesota(明尼苏达大学);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Adelaide University(阿德莱德大学);Brighter Research(Brighter研究公司);Educational Testing Service (ETS)(教育考试服务中心(ETS))