VEHME:一种用于评估手写数学表达式的视觉语言模型
VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics Expressions
AI总结:
VEHME是一种视觉语言模型,通过两阶段训练和表达式感知视觉提示模块,实现对手写数学解答的高准确率自动评估,并在开源模型中达到最优性能。
摘要:
自动评估手写数学解答是教育技术中一个具有实际应用价值的重要问题,但由于学生作业格式多样、布局非结构化以及符号复杂性,这仍然是一个重大挑战。为了应对这一挑战,我们引入了VEHME——一种用于评估手写数学表达式的视觉语言模型,旨在以高准确率和可解释的推理轨迹评估开放式手写数学答案。VEHME整合了一个两阶段训练流程:(i)使用结构化推理数据进行监督微调,以及(ii)将模型输出与多维评分目标(包括正确性、推理深度和错误定位)对齐的强化学习。为了增强空间理解,我们提出了一种表达式感知的视觉提示模块,该模块在我们合成的多行数学表达式数据集上训练,以稳健地引导视觉异构输入中的注意力。在AIHub和FERMAT数据集上的评估中,VEHME在开源模型中达到了最先进的性能,并接近专有系统的准确率,展示了其作为可扩展且易获取的自动化数学评估工具的潜力。我们的训练和实验代码可在我们的GitHub仓库中公开获取。
英文摘要:
Automatically assessing handwritten mathematical solutions is an important problem in educational technology with practical applications, but it remains a significant challenge due to the diverse formats, unstructured layouts, and symbolic complexity of student work. To address this challenge, we introduce VEHME-a Vision-Language Model for Evaluating Handwritten Mathematics Expressions-designed to assess open-form handwritten math responses with high accuracy and interpretable reasoning traces. VEHME integrates a two-phase training pipeline: (i) supervised fine-tuning using structured reasoning data, and (ii) reinforcement learning that aligns model outputs with multi-dimensional grading objectives, including correctness, reasoning depth, and error localization. To enhance spatial understanding, we propose an Expression-Aware Visual Prompting Module, trained on our synthesized multi-line math expressions dataset to robustly guide attention in visually heterogeneous inputs. Evaluated on AIHub and FERMAT datasets, VEHME achieves state-of-the-art performance among open-source models and approaches the accuracy of proprietary systems, demonstrating its potential as a scalable and accessible tool for automated math assessment. Our training and experiment code is publicly available at our GitHub repository.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。