arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.04497cs.LGcs.CY
收藏

结合多模态融合和神经结构搜索的知识追踪方法

An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing

Zhejiang Gongshang University(浙江工商大学);Southern Methodist University(南方卫理公会大学)

Xinyi Ding, Tao Han, Yili Fang, Eric Larson

摘要:

知识追踪是追踪学生对特定学习领域的不同技能的掌握程度的过程。它是构建自适应学习系统的关键组成部分之一,已经研究了几十年。在深度神经网络在其他领域取得成功的同时,我们也看到研究人员在学习科学界采取了类似的方法。然而,大多数现有的基于深度学习的知识跟踪模型要么:(1)只使用正确/不正确的响应(忽略来自其他模态的有用信息),要么(2)通过试验和错误通过领域专业知识设计其网络架构。在本文中,我们提出了一个顺序模型为基础的优化方法,结合多模态融合和神经结构搜索在一个框架内。当只涉及一种模态时,常用的神经结构搜索技术可以被认为是我们所提出的方法的特殊情况。我们还建议使用一个新的度量标准,称为时间加权曲线下面积(加权AUC),以衡量序列模型如何随时间推移而表现。我们在两个公开的真实数据集上评估了我们的方法,显示所发现的模型能够实现卓越的性能。与大多数现有的作品,我们进行McNemar的测试模型的预测和结果是统计上显着的。

英文摘要:

Knowledge Tracing is the process of tracking mastery level of different skills of students for a given learning domain. It is one of the key components for building adaptive learning systems and has been investigated for decades. In parallel with the success of deep neural networks in other fields, we have seen researchers take similar approaches in the learning science community. However, most existing deep learning based knowledge tracing models either: (1) only use the correct/incorrect response (ignoring useful information from other modalities) or (2) design their network architectures through domain expertise via trial and error. In this paper, we propose a sequential model based optimization approach that combines multimodal fusion and neural architecture search within one framework. The commonly used neural architecture search technique could be considered as a special case of our proposed approach when there is only one modality involved. We further propose to use a new metric called time-weighted Area Under the Curve (weighted AUC) to measure how a sequence model performs with time. We evaluate our methods on two public real datasets showing the discovered model is able to achieve superior performance. Unlike most existing works, we conduct McNemar's test on the model predictions and the results are statistically significant.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑