arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.01753cs.LGcs.CY
收藏

评估在线学生的表现-新数据,新方法,提高准确性

Assessing the Performance of Online Students -- New Data, New Approaches, Improved Accuracy

Carnegie Mellon University(卡内基梅隆大学)

Robin Schmucker, Jingbo Wang, Shijia Hu, Tom M. Mitchell

摘要:

我们考虑的问题,评估个别学生不断变化的表现水平,因为他们通过在线课程。学生表现(SP)建模问题是构建自适应在线教学系统的关键步骤。具体来说,我们进行了一项研究,如何利用各种类型和大量的学生日志数据,训练准确的机器学习(ML)模型,预测未来的学生的表现。这项研究是第一次使用四个非常大的学生数据集最近从四个不同的智能辅导系统。我们的研究结果包括一种新的ML方法,该方法定义了基于逻辑回归的SP建模的最新技术水平,在几个方面改进了早期的方法:首先,我们通过引入可以从传统的问题-响应日志中轻松计算的新特征(例如,学生最近的答案中的模式)。其次,我们利用学生历史的特点,超越了问题-回答对(例如,诸如学生观看或跳过的视频片段的特征)以及关于课程中的先决条件结构的信息。第三,我们为课程的不同方面训练多个专门的SP模型(例如,总的来说,这些创新在这四个数据集上产生了0.808的平均AUC得分,而之前最好的逻辑回归方法得分为0.767,并且也优于最先进的深度神经网络方法。重要的是,我们在每个数据集中观察到我们的三种方法创新中的每一种都有一致的改进,这表明我们的方法具有通用性,并且也可能为其他在线辅导系统带来改进。

英文摘要:

We consider the problem of assessing the changing performance levels of individual students as they go through online courses. This student performance (SP) modeling problem is a critical step for building adaptive online teaching systems. Specifically, we conduct a study of how to utilize various types and large amounts of student log data to train accurate machine learning (ML) models that predict the performance of future students. This study is the first to use four very large sets of student data made available recently from four distinct intelligent tutoring systems. Our results include a new ML approach that defines a new state of the art for logistic regression based SP modeling, improving over earlier methods in several ways: First, we achieve improved accuracy by introducing new features that can be easily computed from conventional question-response logs (e.g., the pattern in the student 's most recent answers). Second, we take advantage of features of the student history that go beyond question-response pairs (e.g., features such as which video segments the student watched, or skipped) as well as information about prerequisite structure in the curriculum. Third, we train multiple specialized SP models for different aspects of the curriculum (e.g., specializing in early versus later segments of the student history), then combine these specialized models to create a group prediction of the SP. Taken together, these innovations yield an average AUC score across these four datasets of 0.808 compared to the previous best logistic regression approach score of 0.767, and also outperforming state-of-the-art deep neural net approaches. Importantly, we observe consistent improvements from each of our three methodological innovations, in each dataset, suggesting that our methods are of general utility and likely to produce improvements for other online tutoring systems as well.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑