基于判别式预训练的学习成绩预测知识转移
Knowledge Transfer by Discriminative Pre-training for Academic Performance Prediction
摘要:
随着智能教学系统(ITS)的日益关注,对学生学习成绩的精确评估的需求越来越受到重视。然而,由于学习成绩的标签(如考试成绩)是从ITS外部收集的,因此获取标签的成本很高,导致标签稀缺问题,这给采用机器学习方法进行学习成绩预测带来了挑战。为此,受到自然语言处理社区中预训练方法的最新进展的启发,我们提出了DPA,一个带有区分性预训练任务的迁移学习框架,用于学习成绩预测。DPA预训练两个模型:生成器和鉴别器,并根据学习成绩预测对鉴别器进行微调。在DPA的预训练阶段,将一系列交互(其中一些标记被屏蔽)提供给生成器,生成器经过训练以重建原始序列。然后,预测器采用交互序列,其中被屏蔽的标记被生成器的输出替换,并被训练以预测序列中所有标记的原创性。与以前最先进的生成式预训练方法相比,DPA具有更高的样本效率,导致快速收敛,从而降低学习成绩预测误差。我们对从多平台ITS应用程序中获得的真实数据集进行了广泛的实验研究,结果表明DPA优于以前最先进的生成式预训练方法,平均绝对误差降低了4.05%,并且对标签稀缺性的增加更加鲁棒。
英文摘要:
The needs for precisely estimating a student's academic performance have been emphasized with an increasing amount of attention paid to Intelligent Tutoring System (ITS). However, since labels for academic performance, such as test scores, are collected from outside of ITS, obtaining the labels is costly, leading to label-scarcity problem which brings challenge in taking machine learning approaches for academic performance prediction. To this end, inspired by the recent advancement of pre-training method in natural language processing community, we propose DPA, a transfer learning framework with Discriminative Pre-training tasks for Academic performance prediction. DPA pre-trains two models, a generator and a discriminator, and fine-tunes the discriminator on academic performance prediction. In DPA's pre-training phase, a sequence of interactions where some tokens are masked is provided to the generator which is trained to reconstruct the original sequence. Then, the discriminator takes an interaction sequence where the masked tokens are replaced by the generator's outputs, and is trained to predict the originalities of all tokens in the sequence. Compared to the previous state-of-the-art generative pre-training method, DPA is more sample efficient, leading to fast convergence to lower academic performance prediction error. We conduct extensive experimental studies on a real-world dataset obtained from a multi-platform ITS application and show that DPA outperforms the previous state-of-the-art generative pre-training method with a reduction of 4.05% in mean absolute error and more robust to increased label-scarcity.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。