STEM领域多模态答题卡的自动化评估
Automated Assessment of Multimodal Answer Sheets in the STEM domain
AI总结:
本研究利用AI技术(如CRAFT、YoloV5和Mistral-7B)开发自动化评估系统,通过文本比较和图表转文本表示,实现STEM领域多模态答题卡的高效准确评分。
摘要:
在教育领域,技术的融合带来了变革时代,重塑了传统的学习范式。这一演进的核心是评分过程的自动化,特别是在涵盖科学、技术、工程和数学的STEM领域。尽管在文学等学科中已实现自动化评分,但STEM评估的多样性带来了独特挑战,从定量分析到手绘图表的解读。为应对这些挑战,本研究致力于通过实施使用人工智能(AI)的自动化评估技术,开发高效可靠的评分方法。我们的贡献在于两个关键领域:首先,开发了一个稳健的系统用于评估STEM领域的文本答案,利用样本答案进行精确比较和评分,这得益于先进的算法和自然语言处理技术。其次,专注于增强STEM背景下图表(特别是流程图)的评估,通过将图表转换为文本表示,利用大型语言模型(LLM)进行细致评估。通过弥合视觉表示与语义意义之间的差距,我们的方法确保了准确评估,同时最大限度地减少了人工干预。通过整合CRAFT用于文本提取和YoloV5用于对象检测等模型,结合Mistral-7B等LLM进行文本评估,我们的方法促进了对多模态答题卡的全面评估。本文详细介绍了我们的方法论、遇到的挑战、结果和影响,强调了AI驱动方法在革新STEM教育评分实践中的潜力。
英文摘要:
In the domain of education, the integration of,technology has led to a transformative era, reshaping traditional,learning paradigms. Central to this evolution is the automation,of grading processes, particularly within the STEM domain encompassing Science, Technology, Engineering, and Mathematics.,While efforts to automate grading have been made in subjects,like Literature, the multifaceted nature of STEM assessments,presents unique challenges, ranging from quantitative analysis,to the interpretation of handwritten diagrams. To address these,challenges, this research endeavors to develop efficient and reliable grading methods through the implementation of automated,assessment techniques using Artificial Intelligence (AI). Our,contributions lie in two key areas: firstly, the development of a,robust system for evaluating textual answers in STEM, leveraging,sample answers for precise comparison and grading, enabled by,advanced algorithms and natural language processing techniques.,Secondly, a focus on enhancing diagram evaluation, particularly,flowcharts, within the STEM context, by transforming diagrams,into textual representations for nuanced assessment using a,Large Language Model (LLM). By bridging the gap between,visual representation and semantic meaning, our approach ensures accurate evaluation while minimizing manual intervention.,Through the integration of models such as CRAFT for text,extraction and YoloV5 for object detection, coupled with LLMs,like Mistral-7B for textual evaluation, our methodology facilitates,comprehensive assessment of multimodal answer sheets. This,paper provides a detailed account of our methodology, challenges,encountered, results, and implications, emphasizing the potential,of AI-driven approaches in revolutionizing grading practices in,STEM education.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。