arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.13565cs.LGcs.AIstat.ML
收藏

在多个预测任务之间联合建模异构学生行为与交互

Jointly Modeling Heterogeneous Student Behaviors and Interactions Among Multiple Prediction Tasks

Shanghai Jiao Tong University(上海交通大学)

Haobing Liu, Yanmin Zhu, Tianzi Zang, Yanan Xu, Jiadi Yu, Feilong Tang

AI总结:

本文提出融合 LSTM 变体、软注意力与协同注意力堆叠单元的多任务框架,以建模异构学生行为并显式控制任务间知识迁移,真实数据集上的三项预测任务验证了其有效性。

摘要:

关于学生的预测任务对学生和大学都具有现实意义。对学生进行多项预测是智慧校园的重要组成部分。例如,预测学生是否会无法毕业,可以提醒学生事务办公室采取预测性措施,帮助该学生提升学业表现。随着高校信息技术的发展,我们能够持续收集编码了异构行为的数字足迹。本文中,我们关注对异构行为进行建模并联合完成多项预测,因为一些预测任务彼此相关,而针对特定任务单独学习模型可能面临数据稀疏问题。为此,我们提出了一种 LSTM 变体和一种软注意力机制。所提出的 LSTM 能够从异构行为序列中学习感知学生画像的表示。所提出的软注意力机制可以针对每名学生动态学习不同日期的不同重要程度。通过这种方式,异构行为可以得到良好建模。为了建模多个预测任务之间的交互,我们提出了一个基于协同注意力机制的单元。借助堆叠的单元,我们可以显式控制多个任务之间的知识迁移。我们基于从一所高校收集的真实数据集设计了三项具有启发性的行为预测任务。在这三项预测任务上的定性与定量实验证明了我们模型的有效性。

英文摘要:

Prediction tasks about students have practical significance for both student and college. Making multiple predictions about students is an important part of a smart campus. For instance, predicting whether a student will fail to graduate can alert the student affairs office to take predictive measures to help the student improve his/her academic performance. With the development of information technology in colleges, we can collect digital footprints which encode heterogeneous behaviors continuously. In this paper, we focus on modeling heterogeneous behaviors and making multiple predictions together, since some prediction tasks are related and learning the model for a specific task may have the data sparsity problem. To this end, we propose a variant of LSTM and a soft-attention mechanism. The proposed LSTM is able to learn the student profile-aware representation from heterogeneous behavior sequences. The proposed soft-attention mechanism can dynamically learn different importance degrees of different days for every student. In this way, heterogeneous behaviors can be well modeled. In order to model interactions among multiple prediction tasks, we propose a co-attention mechanism based unit. With the help of the stacked units, we can explicitly control the knowledge transfer among multiple tasks. We design three motivating behavior prediction tasks based on a real-world dataset collected from a college. Qualitative and quantitative experiments on the three prediction tasks have demonstrated the effectiveness of our model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑