arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.04093cs.AI
收藏

利用大语言模型实现基于Web的智能教育系统中的噪声鲁棒认知诊断

Harnessing LLM for Noise-Robust Cognitive Diagnosis in Web-Based Intelligent Education Systems

School of Computer Science and Technology/School of Artificial Intelligence, China University of Mining and Technology(计算机科学与技术学院/人工智能学院,中国矿业大学);School of Computing Technologies, RMIT University(计算技术学院,拉筹伯大学);Department of Computer Science and Technology, University of Cambridge(计算机科学与技术系,剑桥大学);School of Computer Science and Technology, Hainan University(计算机科学与技术学院,海南大学)

Guixian Zhang, Guan Yuan, Ziqi Xu, Yanmei Zhang, Jing Ren, Zhenyun Deng, Debo Cheng

AI总结:

针对Web智能教育系统中认知诊断面临的数据噪声与不平衡问题,提出基于扩散模型的DLLM框架,通过两阶段去噪与语义结构对齐,在三个数据集上实现噪声鲁棒的最优预测。

摘要:

基于Web的智能教育系统(WIES)中的认知诊断旨在从异构、嘈杂的交互中评估学生对知识概念的掌握程度。近期工作尝试利用大语言模型(LLMs)进行认知诊断,然而LLMs难以处理结构化数据,且容易受到噪声引起的误判影响。特别是,WIES的开放环境持续吸引新学生并产生大量响应日志,加剧了传统教育系统中固有的数据不平衡和噪声问题。为应对这些挑战,我们提出了DLLM,一种基于扩散的LLM框架,用于噪声鲁棒的认知诊断。DLLM首先根据响应正确性构建独立子图,然后应用关系增强对齐模块以缓解数据不平衡。两个子图表示随后被融合,并与LLM派生的、语义增强的表示进行对齐。重要的是,在每次对齐步骤之前,DLLM采用两阶段去噪扩散模块来消除固有噪声,同时辅助结构表示对齐。具体而言,无条件去噪扩散首先移除错误信息,随后基于图引导的条件去噪扩散用于消除误导性信息。最后,整合了语义知识和结构信息的噪声鲁棒表示被输入到现有的认知诊断模型中进行预测。在三个公开可用的基于Web的教育平台数据集上的实验结果表明,我们的DLLM在不同噪声水平下均实现了最优的预测性能,这证明了DLLM在有效利用LLM语义知识的同时实现了噪声鲁棒性。

英文摘要:

Cognitive diagnostics in the Web-based Intelligent Education System (WIES) aims to assess students' mastery of knowledge concepts from heterogeneous, noisy interactions. Recent work has tried to utilize Large Language Models (LLMs) for cognitive diagnosis, yet LLMs struggle with structured data and are prone to noise-induced misjudgments. Specially, WIES's open environment continuously attracts new students and produces vast amounts of response logs, exacerbating the data imbalance and noise issues inherent in traditional educational systems. To address these challenges, we propose DLLM, a Diffusion-based LLM framework for noise-robust cognitive diagnosis. DLLM first constructs independent subgraphs based on response correctness, then applies relation augmentation alignment module to mitigate data imbalance. The two subgraph representations are then fused and aligned with LLM-derived, semantically augmented representations. Importantly, before each alignment step, DLLM employs a two-stage denoising diffusion module to eliminate intrinsic noise while assisting structural representation alignment. Specifically, unconditional denoising diffusion first removes erroneous information, followed by conditional denoising diffusion based on graph-guided to eliminate misleading information. Finally, the noise-robust representation that integrates semantic knowledge and structural information is fed into existing cognitive diagnosis models for prediction. Experimental results on three publicly available web-based educational platform datasets demonstrate that our DLLM achieves optimal predictive performance across varying noise levels, which demonstrates that DLLM achieves noise robustness while effectively leveraging semantic knowledge from LLM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑