利用情感迁移学习进行智能教学系统中的行为预测
Leveraging Affect Transfer Learning for Behavior Prediction in an Intelligent Tutoring System
摘要:
在这项工作中,我们提出了一个基于视频的迁移学习的方法来预测问题的学生与智能教学系统(ITS)的工作成果。通过分析一个学生的脸和手势,我们的方法预测的结果,一个学生回答一个问题,在ITS从视频饲料。我们的工作是出于这样的推理,即预测这种结果的能力使辅导系统能够调整干预措施,如提示和鼓励,并最终提高学生的学习。我们收集了一个大的学生互动的标记数据集与智能在线数学导师组成的68个会话,其中54个学生解决了2,749个问题。该数据集是公开的,可在https://www.cs.bu.edu/faculty/betke/research/learning/上获得。使用这个数据集,我们的迁移学习挑战是在“野外”获得的图片的源域中设计一个表示,用于面部表情分析任务,并将此学习的表示转移到教室环境中学生的网络摄像头视频域中的人类行为预测任务。我们开发了一种新的面部影响表示和用户个性化的培训计划,解锁这种表示的潜力。我们设计了一个递归神经网络的几个变体,该网络对学生解决数学问题的视频序列的时间结构进行建模。我们的最终模型名为ATL-BP for Affect迁移学习for Behavior Prediction,在这个新数据集上,平均F分数比最先进的方法相对增加了50%。
英文摘要:
In this work, we propose a video-based transfer learning approach for predicting problem outcomes of students working with an intelligent tutoring system (ITS). By analyzing a student's face and gestures, our method predicts the outcome of a student answering a problem in an ITS from a video feed. Our work is motivated by the reasoning that the ability to predict such outcomes enables tutoring systems to adjust interventions, such as hints and encouragement, and to ultimately yield improved student learning. We collected a large labeled dataset of student interactions with an intelligent online math tutor consisting of 68 sessions, where 54 individual students solved 2,749 problems. The dataset is public and available at https://www.cs.bu.edu/faculty/betke/research/learning/ . Working with this dataset, our transfer-learning challenge was to design a representation in the source domain of pictures obtained "in the wild" for the task of facial expression analysis, and transferring this learned representation to the task of human behavior prediction in the domain of webcam videos of students in a classroom environment. We developed a novel facial affect representation and a user-personalized training scheme that unlocks the potential of this representation. We designed several variants of a recurrent neural network that models the temporal structure of video sequences of students solving math problems. Our final model, named ATL-BP for Affect Transfer Learning for Behavior Prediction, achieves a relative increase in mean F-score of 50% over the state-of-the-art method on this new dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。