From Prediction to Application: Language Model-based Code Knowledge Tracing with Domain Adaptive Pre-Training and Automatic Feedback System with Pedagogical Prompting for Comprehensive Programming Education
Enuma Inc(Enuma公司);University of Memphis(孟菲斯大学);Daegu National University of Education(大邱教育大学);Seoul National University(首尔大学);Seoul Metropolitan Office of Education(首尔市教育厅);Korea University(高丽大学)
Unggi Lee, Jiyeong Bae, Yeonji Jung, Minji Kang, Gyuri Byun, Yeonseo Lee, Dohee Kim, Sookbun Lee, Jaekwon Park, Taekyung Ahn, Gunho Lee, Hyeoncheol Kim
Knowledge Tracing (KT) is a critical component in online learning, but traditional approaches face limitations in interpretability and cross-domain adaptability. This paper introduces Language Model-based Code Knowledge Tracing (CodeLKT), an innovative application of Language model-based Knowledge Tracing (LKT) to programming education. CodeLKT leverages pre-trained language models to process learning data, demonstrating superior performance over existing KT and Code KT models. We explore Domain Adaptive Pre-Training (DAPT) and Task Adaptive Pre-Training (TAPT), showing enhanced performance in the coding domain and investigating cross-domain transfer between mathematics and coding. Additionally, we present an theoretically-informed integrated system combining CodeLKT with large language models to generate personalized, in-depth feedback to support students' programming learning. This work advances the field of Code Knowledge Tracing by expanding the knowledge base with language model-based approach and offering practical implications for programming education through data-informed feedback.
Rewarding How Models Think Pedagogically: Integrating Pedagogical Reasoning and Thinking Rewards for LLMs in Education
Chosun University(昌原大学);Korea University(韩国大学);Seoul National University(首尔国立大学);Korea Institute for Curriculum and Evaluation(韩国课程与评价研究院);Upstage;Indiana University Bloomington(印第安纳大学布卢明顿分校);Nanyang Technological University(南洋理工大学)
Pedagogical Alignment for Vision-Language-Action Models: A Comprehensive Framework for Data, Architecture, and Evaluation in Education
Chosun University(全州大学);Seoul National University(首尔国立大学);Korea Institute for Curriculum and Evaluation(韩国课程评价院);Nanyang Technological University(南洋理工大学)
SHAPE: Unifying Safety, Helpfulness and Pedagogy for Educational LLMs
Center for Data Science, New York University Shanghai(纽约大学上海数据科学中心);Courant Institute of Mathematical Sciences, New York University(纽约大学Courant数学科学研究所);School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院)
LLMs Are Already Good Tutors: Training-Free Prompt Optimization for Pedagogical Math Tutoring
Korea University Sejong Campus(韩国大学世宗校区);Gyeonggi Institute of Education(京畿教育学院);Indiana University Bloomington(印第安纳大学布卢明顿分校);Opentutorials;Chosun University(全州大学);Korea University Korean Studies Center(韩国大学韩学研究中心)
LLMs can Find Mathematical Reasoning Mistakes by Pedagogical Chain-of-Thought
Shanghai Business School(上海商学院);Learnable.AI Inc.(Learnable.AI公司);Centre for Frontier AI Research, A*STAR(前沿人工智能研究中心,A*STAR);Institute of High-Performance Computing, A*STAR(高性能计算研究所,A*STAR);The Hong Kong Polytechnic University(香港理工大学);Microsoft Research Asia(微软亚洲研究院)
ELMES: An Automated Framework for Evaluating Large Language Models in Educational Scenarios
Shanghai Innavation Institute(上海创新研究院);Shanghai Institute of AI for Education(上海人工智能教育研究院);Department of Educational Information Technology(教育信息技术系);School of Computer Science and Technology(计算机科学与技术学院)
Are Video Models Zero-Shot Learners and Reasoners in Education? EduVideoBench, A Knowledge-Skills-Attitude Benchmark for Educational Video Generation
Korea University Sejong Campus(韩国大学世宗校区);Cardiff Metropolitan University(卡迪夫 Metropolitan 大学);Seoul National University(首尔国立大学);Bugil Academy(Bugil 学院);Gyeonggi Provincial Office of Education(京畿省教育厅);Loughborough University(洛桑大学);Korea National University of Education(韩国教育大学);Korea University(韩国大学);Korean Educational Development Institute(韩国教育发展院);Sungshin Women’s University(顺天堂女子大学);Seoul National University of Education(首尔国立教育大学);Korea Institute for Curriculum and Evaluation(韩国课程评价院);Indiana University Bloomington(印第安纳大学布卢明顿分校)