Knowledge Tracing (KT) aims to estimate a learner's evolving mastery based on interaction histories. Recent studies have explored Large Language Models (LLMs) for KT via autoregressive nature, but such approaches typically require fine-tuning and exhibit unstable or near-random performance. Moreover, prior KT systems primarily focus on prediction and rely on multi-stage pipelines for feedback and recommendation, resulting in increased system complexity and resources. To address this gap, we propose Thinking-KT, a training-free KT framework that incorporates Test-Time Scaling (TTS), enabling even small LLMs to achieve competitive KT performance. Moreover, in this framework, a small LLM can jointly perform KT prediction, personalized feedback generation, and learning recommendation in a unified output without degrading prediction accuracy. Beyond performance, we present the systematic analysis of reasoning traces in KT. Our results demonstrate that TTS is a critical yet underexplored factor in LLM-based KT, and that small LLMs can serve as unified ITS engines.
Where Did This Sentence Come From? Tracing Provenance in LLM Reasoning Distillation
College of Computer Science and Technology(计算机科学与技术学院);Alibaba Cloud Computing(阿里云计算);School of Artificial Intelligence(人工智能学院);Department of Mathematics(数学系)
Lingdan-V2: Large language models for clinically grounded reasoning in traditional Chinese medicine
School of Computer Science & Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Tianjin Tasly Digital Chinese Medicine Technology Co., Ltd.(天津天士力数字中医药科技有限公司);Tasly Biopharmaceuticals Co., Ltd.(天士力生物制药有限公司);Affiliated Hospital of Hubei University of Chinese Medicine(湖北中医药大学附属医院);Da’an Health Technology (Beijing) Co., Ltd.(大安健康科技(北京)有限公司);Institute of Chinese Medicine Epidemic Disease, Beijing University of Chinese Medicine(北京中医药大学中医疫病研究所);Guang’anmen Hospital, China Academy of Chinese Medical Sciences(中国中医科学院广安门医院);Xiyuan Hospital, China Academy of Chinese Medical Sciences(中国中医科学院西苑医院)
Tracing the ongoing emergence of human-like reasoning in Large Language Models
Departament de Filologia Catalana, Universitat Autònoma de Barcelona(加泰罗尼亚语言系系,巴塞罗那自治大学);Institut für Psychologie, Humboldt-Universitat zu Berlin(柏林洪堡大学心理学研究所);Institució Catalana de Recerca i Estudis Avançats (ICREA)(加泰罗尼亚高级研究与高级教育研究所)
Data Science Section, IT University of Copenhagen(丹麦哥本哈根技术大学数据科学部门);MaiNLP, Center for Information and Language Processing, LMU Munich(慕尼黑大学信息与语言处理中心MaiNLP);Department of Applied Mathematics and Computer Science, Technical University of Denmark(丹麦技术大学应用数学与计算机科学系);Pioneer Centre for Artificial Intelligence(先锋人工智能中心);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML))
MERIT: Memory-Enhanced Retrieval for Interpretable Knowledge Tracing
School of Computer Science and Technology, East China Normal University(东华师范大学计算机科学与技术学院);Shanghai Innovation Institute(上海创新研究院);WeChat AI, Tencent(微信AI,腾讯)
Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Hunan Normal University(湖南师范大学)
Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data
University of California, Santa Barbara(加利福尼亚大学圣巴巴拉分校);Allen Institute for AI(艾伦人工智能研究所);University of Washington(华盛顿大学);SynthLabs;Carnegie Mellon University(卡内基梅隆大学)
Tracing the Arrow of Time: Diagnosing Temporal Information Flow in Video-LLMs
The University of Osaka(大阪大学);Center for Information and Neural Networks(信息与神经网络中心);National Institute of Information and Communications Technology(信息与通信技术国家研究所);Kyoto University(京都大学);NII LLMC(日本信息处理学会LLMC)
MTCMB: A Multi-Task Benchmark Framework for Evaluating LLMs on Knowledge, Reasoning, and Safety in Traditional Chinese Medicine
School of Software Engineering, Sun Yat-sen University(中山大学软件学院);Institute of TCM Diagnostics, Hunan University of Chinese Medicine(湖南中医药大学中医诊断研究所);School of Artificial Intelligence, Guilin University of Electronic Technology(桂林电子科技大学人工智能学院);Department of Computer Science, Cornell University(康奈尔大学计算机科学系)
From Diagnosis to Redesign: Using Quantitative Ethnography to Improve Multi-Agent LLM Reasoning
University of California, Irvine(加利福尼亚大学欧文分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Monash University(莫纳什大学);Columbia University(哥伦比亚大学);University of Pennsylvania(宾夕法尼亚大学)
METER: Evaluating Multi-Level Contextual Causal Reasoning in Large Language Models
College of Computer Science, Sichuan University(四川大学计算机学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, China(中国教育部机器学习与产业智能工程研究中心)
SEMDR: A Semantic-Aware Dual Encoder Model for Legal Judgment Prediction with Legal Clue Tracing
College of Science, Northeastern University(东北大学理学院);School of Computer Science and Engineering, Southern University of Science and Technology(南方科技大学计算机科学与工程学院);Department of Computer Science, University of Reading(雷丁大学计算机科学系)
LLMs-based Few-Shot Disease Predictions using EHR: A Novel Approach Combining Predictive Agent Reasoning and Critical Agent Instruction
Emory University(埃默里大学);University of Washington(华盛顿大学);UCSD(加利福尼亚大学圣迭戈分校);Rollins School of Public Health, Emory University(埃默里大学罗林斯公共卫生学院);School of Medicine, Emory University(埃默里大学医学院)
A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodal
School of Computer, National University of Defense Technology(国防科技大学计算机学院);College of Intelligence Science and Technology, National University of Defense Technology(国防科技大学智能科学学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)