arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.17427cs.CYcs.LG
收藏

基于状态空间模型且保留不确定性的深度知识追踪

Uncertainty-preserving deep knowledge tracing with state-space models

Carleton College(卡尔顿学院);NWEA/HMH(NWEA/HMH公司)

S. Thomas Christie, Carson Cook, Anna N. Rafferty

AI总结:

针对现有方法无法兼顾历史信息与认知不确定性的问题,提出Dynamic LENS建模范式,结合变分自编码器与贝叶斯状态空间模型,在保持预测性能的同时量化了学生的认知不确定性。

摘要:

知识追踪和传统评估的核心目标都是量化学生在特定时间点的知识和技能。深度知识追踪(DKT)灵活地考虑了学生的答题历史,但未量化认知不确定性;而IRT和CDM能计算测量误差,但仅孤立地考虑单次测试的作答,未结合学生过往的答题记录。Elo和BKT本可弥合这一鸿沟,但其底层模型的简单性限制了跨技能的信息共享,并施加了强归纳偏置。为克服这些局限,我们提出了Dynamic LENS,这是一种建模范式,结合了变分自编码器灵活保留不确定性的特性与贝叶斯状态空间模型严谨的信息整合能力。Dynamic LENS允许跨时间收集学生答题信息,同时将同一测试中的作答视为由共享潜在状态生成的可交换观测值。它将学生知识表示为高维空间中的高斯分布,并使用贝叶斯更新在测试内部和跨时间维度上结合各项估计。我们证明,Dynamic LENS具有与竞争模型相似的预测性能,同时保留了DKT模型所缺乏的认知不确定性(即深度学习中测量误差的类比)。该方法在为形成性练习设计的模型与总结性评估之间搭建了一座概念桥梁。

英文摘要:

A central goal of both knowledge tracing and traditional assessment is to quantify student knowledge and skills at a given point in time. Deep knowledge tracing flexibly considers a student's response history but does not quantify epistemic uncertainty, while IRT and CDM compute measurement error but only consider responses to individual tests in isolation from a student's past responses. Elo and BKT could bridge this divide, but the simplicity of the underlying models limits information sharing across skills and imposes strong inductive biases. To overcome these limitations, we introduce Dynamic LENS, a modeling paradigm that combines the flexible uncertainty-preserving properties of variational autoencoders with the principled information integration of Bayesian state-space models. Dynamic LENS allows information from student responses to be collected across time, while treating responses from the same test as exchangeable observations generated by a shared latent state. It represents student knowledge as Gaussian distributions in high-dimensional space and combines estimates both within tests and across time using Bayesian updating. We show that Dynamic LENS has similar predictive performance to competing models, while preserving the epistemic uncertainty - the deep learning analogue to measurement error - that DKT models lack. This approach provides a conceptual bridge across an important divide between models designed for formative practice and summative assessment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑