arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.05596cs.HCcs.LG
收藏

利用智能手机数据自动评估学生表现

Automatically Assessing Students Performance with Smartphone Data

CISUC, University of Coimbra(科英布拉大学CISUC研究所);INESC, University of Coimbra(科英布拉大学INESC研究所);Escuela Politecnica Nacional(国家理工学院)

J. Fernandes, J. Sá Silva, A. Rodrigues, S. Sinche, F. Boavida

AI总结:

本文基于智能手机应用 ISABELA 采集的被动与问卷数据,使用多种机器学习模型评估学生表现,发现周时间窗口更优,并通过决策级中位数投票流水线将准确率提升至90%以上。

摘要:

随着我们周围智能设备数量的增加,创建具有社会感知能力的智能系统的机会也在增多。在此背景下,移动设备可用于收集学生数据,从而更好地理解他们的日常作息如何影响学业表现。此外,Covid-19疫情也给学生带来了新的挑战和困难,并对其生活方式产生了相当大的影响。本文提出了一个通过智能手机应用程序 ISABELA 收集的数据集,其中包含被动数据(例如活动和位置)以及来自问卷的自我报告数据。我们使用不同的机器学习模型进行了多项测试,以对学生表现进行分类。这些测试在不同时间窗口下开展,结果表明每周时间窗口比每月时间窗口能带来更好的预测和分类效果。此外,结果表明,即使使用在不同情境(即 Covid-19疫情之前和疫情期间)收集的数据,所建立的模型也能够预测学生表现。SVM、XGBoost 以及结合 Random Forest 的 AdaBoost-SAMME 被发现是最佳算法,准确率超过78%。另外,我们提出了一种使用决策级中位数投票算法的流水线,通过利用学生的历史数据进一步改进预测,从而提升模型性能。借助该流水线,可以进一步提高模型性能,其中部分模型取得了超过90%的准确率。

英文摘要:

As the number of smart devices that surround us increases, so do the opportunities to create smart socially-aware systems. In this context, mobile devices can be used to collect data about students and to better understand how their day-to-day routines can influence their academic performance. Moreover, the Covid-19 pandemic led to new challenges and difficulties, also for students, with considerable impact on their lifestyle. In this paper we present a dataset collected using a smartphone application (ISABELA), which include passive data (e.g., activity and location) as well as self-reported data from questionnaires. We present several tests with different machine learning models, in order to classify students' performance. These tests were carried out using different time windows, showing that weekly time windows lead to better prediction and classification results than monthly time windows. Furthermore, it is shown that the created models can predict student performance even with data collected from different contexts, namely before and during the Covid-19 pandemic. SVMs, XGBoost and AdaBoost-SAMME with Random Forest were found to be the best algorithms, showing an accuracy greater than 78%. Additionally, we propose a pipeline that uses a decision level median voting algorithm to further improve the models' performance, by using historic data from the students to further improve the prediction. Using this pipeline, it is possible to further increase the performance of the models, with some of them obtaining an accuracy greater than 90%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑