NLP与教育:在课堂中使用语义相似度评估大规模完形填空测试中填写的空格
NLP and Education: using semantic similarity to evaluate filled gaps in a large-scale Cloze test in the classroom
AI总结:
本研究针对大规模完形填空测试的实施挑战,提出利用NLP中的词嵌入模型评估答案语义相似度的自动纠正方法,发现GloVe模型与人工评委评估相关性最高,为教育评估提供了更高效的阅读能力评估途径。
摘要:
本研究考察了完形填空测试的适用性,这是一种广泛用于评估文本理解能力的工具,同时强调了其在大规模实施中的挑战。为了解决这些局限性,提出了一种自动纠正方法,利用自然语言处理(NLP)技术,特别是词嵌入(WE)模型,来评估预期答案与提供答案之间的语义相似度。使用来自巴西学生参加的完形填空测试数据,采用了针对巴西葡萄牙语(PT-BR)的WE模型来测量答案的语义相似度。通过涉及十二名评委对学生答案进行分类的实验设置对结果进行了验证。对WE模型分数与评委评估的比较分析显示,GloVe是最有效的模型,表现出与评委评估的最高相关性。本研究强调了WE模型在评估语义相似度方面的实用性及其增强大规模完形填空测试评估的潜力。此外,它通过提供一种更高效的阅读能力评估方法,为教育评估方法论做出了贡献。
英文摘要:
This study examines the applicability of the Cloze test, a widely used tool for assessing text comprehension proficiency, while highlighting its challenges in large-scale implementation. To address these limitations, an automated correction approach was proposed, utilizing Natural Language Processing (NLP) techniques, particularly word embeddings (WE) models, to assess semantic similarity between expected and provided answers. Using data from Cloze tests administered to students in Brazil, WE models for Brazilian Portuguese (PT-BR) were employed to measure the semantic similarity of the responses. The results were validated through an experimental setup involving twelve judges who classified the students' answers. A comparative analysis between the WE models' scores and the judges' evaluations revealed that GloVe was the most effective model, demonstrating the highest correlation with the judges' assessments. This study underscores the utility of WE models in evaluating semantic similarity and their potential to enhance large-scale Cloze test assessments. Furthermore, it contributes to educational assessment methodologies by offering a more efficient approach to evaluating reading proficiency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。