arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.00323cs.CLcs.SE
收藏

从预测到应用:基于语言模型的代码知识追踪,结合领域自适应预训练与基于教学提示的自动反馈系统,用于综合编程教育

From Prediction to Application: Language Model-based Code Knowledge Tracing with Domain Adaptive Pre-Training and Automatic Feedback System with Pedagogical Prompting for Comprehensive Programming Education

Enuma Inc(Enuma公司);University of Memphis(孟菲斯大学);Daegu National University of Education(大邱教育大学);Seoul National University(首尔大学);Seoul Metropolitan Office of Education(首尔市教育厅);Korea University(高丽大学)

Unggi Lee, Jiyeong Bae, Yeonji Jung, Minji Kang, Gyuri Byun, Yeonseo Lee, Dohee Kim, Sookbun Lee, Jaekwon Park, Taekyung Ahn, Gunho Lee, Hyeoncheol Kim

AI总结:

本文提出基于语言模型的代码知识追踪方法CodeLKT,结合领域与任务自适应预训练提升编程教育中的知识追踪性能,并集成大语言模型自动生成个性化反馈,推动编程教育从预测走向应用。

摘要:

知识追踪(KT)是在线学习中的关键组成部分,但传统方法在可解释性和跨领域适应性方面存在局限。本文介绍了基于语言模型的代码知识追踪(CodeLKT),这是基于语言模型的知识追踪(LKT)在编程教育中的创新应用。CodeLKT利用预训练语言模型处理学习数据,展现出优于现有KT和代码KT模型的性能。我们探索了领域自适应预训练(DAPT)和任务自适应预训练(TAPT),展示了在编码领域的性能提升,并研究了数学与编码之间的跨领域迁移。此外,我们提出了一个具有理论依据的集成系统,将CodeLKT与大型语言模型相结合,生成个性化、深入的反馈,以支持学生的编程学习。这项工作通过基于语言模型的方法扩展了知识库,并通过数据驱动的反馈为编程教育提供了实践启示,从而推动了代码知识追踪领域的发展。

英文摘要:

Knowledge Tracing (KT) is a critical component in online learning, but traditional approaches face limitations in interpretability and cross-domain adaptability. This paper introduces Language Model-based Code Knowledge Tracing (CodeLKT), an innovative application of Language model-based Knowledge Tracing (LKT) to programming education. CodeLKT leverages pre-trained language models to process learning data, demonstrating superior performance over existing KT and Code KT models. We explore Domain Adaptive Pre-Training (DAPT) and Task Adaptive Pre-Training (TAPT), showing enhanced performance in the coding domain and investigating cross-domain transfer between mathematics and coding. Additionally, we present an theoretically-informed integrated system combining CodeLKT with large language models to generate personalized, in-depth feedback to support students' programming learning. This work advances the field of Code Knowledge Tracing by expanding the knowledge base with language model-based approach and offering practical implications for programming education through data-informed feedback.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑