知识追踪(Knowledge Tracing,KT)是旨在通过学习交互评估学生知识状态的研究领域,是智能教学系统(Intelligent Tutoring Systems,ITSs)的核心组成部分。尽管已取得显著进展,但目前尚无KT模型能同时在预测准确性和可解释性上均表现优异。与此同时,在海量自然语言数据集上预训练的大语言模型(Large Language Models,LLMs)已成为强大工具,在各类教育应用中具备巨大潜力。本系统综述探讨了教育场景下KT模型与LLMs结合的交叉点、机遇与挑战。综述首先调研了LLMs在教育中的应用,包括其对特定领域内容的适配能力,以及支持个性化学习的能力。随后梳理了KT模型从传统方法到前沿方法的发展与现状,旨在发掘LLMs可缓解的潜在挑战。综述核心聚焦LLMs与KT的融合,探讨了三大主要功能:解决KT领域的共性问题、克服特定KT模型的局限性、以及直接充当KT模型本身。研究发现,通过上下文学习、基于智能体的方法等定制化技术,可针对特定教育任务定制LLMs,有效处理复杂且不均衡的教育数据。这类模型能通过从题目数据中生成相关特征,提升现有KT模型的性能并解决冷启动问题。但当前两类模型都高度依赖结构化的有限数据集,未能利用多样化教育数据的价值,而这类数据本可提供对个体学习者的更深入洞察,支持各类教育场景。
英文摘要:
Knowledge Tracing (KT) is a research field that aims to estimate a student's knowledge state through learning interactions-a crucial component of Intelligent Tutoring Systems (ITSs). Despite significant advancements, no current KT models excel in both predictive accuracy and interpretability. Meanwhile, Large Language Models (LLMs), pre-trained on vast natural language datasets, have emerged as powerful tools with immense potential in various educational applications. This systematic review explores the intersections, opportunities, and challenges of combining KT models and LLMs in educational contexts. The review first investigates LLM applications in education, including their adaptability to domain-specific content and ability to support personalized learning. It then examines the development and current state of KT models, from traditional to advanced approaches, aiming to uncover potential challenges that LLMs could mitigate. The core of this review focuses on integrating LLMs with KT, exploring three primary functions: addressing general concerns in KT fields, overcoming specific KT model limitations, and performing as KT models themselves. Our findings reveal that LLMs can be customized for specific educational tasks through tailor-making techniques such as in-context learning and agent-based approaches, effectively managing complex and unbalanced educational data. These models can enhance existing KT models' performance and solve cold-start problems by generating relevant features from question data. However, both current models depend heavily on structured, limited datasets, missing opportunities to use diverse educational data that could offer deeper insights into individual learners and support various educational settings.
TLSQKT: A Question-Aware Dual-Channel Transformer for Literacy Tracing from Learning Sequences
Faculty of Artificial Intelligence in Education Central China Normal University Wuhan 430079, China;Faculty of Artificial Intelligence in Education Central China Normal University Wuhan, China;School of Electrical;Electronic Engineering Hubei University of Technology Wuhan 430068, China
Generative AI for Education (GAIED): Advances, Opportunities, and Challenges
University of Auckland(奥克兰大学);Microsoft(微软公司);Worcester Polytechnic Institute(伍斯特理工学院);EPFL(洛桑联邦理工学院);Carnegie Mellon University(卡内基梅隆大学);Carleton College(卡尔顿学院);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)
A Review of Generative AI in Computer Science Education: Challenges and Opportunities in Accuracy, Authenticity, and Assessment
School of Computer Science and Engineering, California State University, San Bernardino, USA(加州州立大学圣伯纳迪诺分校计算机科学与工程学院);School of Information Systems and Technology, San Jose State University, USA(旧金山州立大学信息系统与技术学院);University of California, San Diego, USA(加州大学圣地亚哥分校)
The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges
University of Alberta(阿尔伯塔大学);Federation of American Scientists(美国科学家联合会);Educational Testing Service(教育考试服务中心);University of Maryland(马里兰大学);University of Iowa(爱荷华大学);Cambium Assessment(坎比姆评估公司);Washington State University(华盛顿州立大学);Acuity Insights(敏锐洞察公司);PSI Services(PSI服务公司);University of Delaware(特拉华大学);Concordia University of Edmonton(埃德蒙顿康考迪亚大学)
AAKT: Enhancing Knowledge Tracing with Alternate Autoregressive Modeling
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Information Technology & Management, University of International Business and Economics(对外经济贸易大学信息技术与管理学院)
Exploring Teachers' Perception of Artificial Intelligence: The Socio-emotional Deficiency as Opportunities and Challenges in Human-AI Complementarity in K-12 Education
Michigan State University(密歇根州立大学);University of Pittsburgh(匹兹堡大学)
DASKT: A Dynamic Affect Simulation Method for Knowledge Tracing
University of Science and Technology of China(中国科学技术大学);School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);Liupanshui normal university(六盘水师范学院)