Large Language Models (LLMs) have recently showcased remarkable reasoning abilities. However, larger models often surpass their smaller counterparts in reasoning tasks, posing the challenge of effectively transferring these capabilities from larger models. Existing approaches heavily rely on extensive fine-tuning data or continuous interactions with a superior teacher LLM during inference. We introduce a principle-based teacher-student framework called ``Teaching via Principle Discovery'' (TPD) to address these limitations. Inspired by human learning mechanisms, TPD mimics the interaction between a teacher and a student using a principle-based approach. The teacher LLM generates problem-solving instructions and corrective principles based on the student LLM's errors. These principles guide the refinement of instructions and the selection of instructive examples from a validation set. This enables the student model to learn from both the teacher's guidance and its own mistakes. Once the student model begins making inferences, TPD requires no further intervention from the teacher LLM or humans. Through extensive experiments across eight reasoning tasks, we demonstrate the effectiveness of TPD. Compared to standard chain-of-thought prompting, TPD significantly improves the student model's performance, achieving $6.2\%$ improvement on average.
SocraticPO: Policy Optimization via Interactive Guidance
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China(认知智能国家重点实验室,中国科学技术大学);iFLYTEK AI Research (Central China), iFLYTEK Co., Ltd(iFLYTEK中央中国AI研究院,iFLYTEK公司)
Dense Is Not Enough: Hierarchical Supervision Allocation for Long-Horizon On-Policy Distillation
Ant Group(蚂蚁集团);Alibaba International Digital Commerce Group(阿里巴巴国际数字商业集团);University of Science and Technology of China(中国科学技术大学);Peking University(北京大学);University of Electronic Science and Technology of China(电子科技大学)
KT4EQG: Personalized Exercise Question Generation via Knowledge Tracing
University of California, Santa Barbara(加州大学圣巴巴拉分校);University of South Alabama(南方大学);University of Michigan(密歇根大学);MIT-IBM Watson AI Lab(麻省理工-IBM沃森人工智能实验室);Harvard University(哈佛大学)
A Comparative Study of Student Perspectives on Technical Writing Feedback Quality: Evaluating LLMs, SLMs, and Humans in Computer Science Topics
McMaster University(麦斯特大学);Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Research Institute for the Study of University Pedagogy, University of Toronto Mississauga(多伦多大学密西根分校大学教学研究学院);Department of Mathematical and Computational Sciences, University of Toronto Mississauga(多伦多大学密西根分校数学与计算科学系)
Look Ahead Before You Distill: Future Trajectory Validation of Teacher Guidance for Agentic On-Policy Distillation
Meituan LongCat Interaction(美团龙猫交互);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Peking University(北京大学);Nanjing University(南京大学);University of Chinese Academy of Sciences(中国科学院大学);Jilin University(吉林大学);University of Science and Technology of China(中国科学技术大学);The Hong Kong Polytechnic University(香港理工大学)
I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons
Allen Institute for Artificial Intelligence(艾伦人工智能研究所);University of Southern California(南加州大学);University of Washington(华盛顿大学);University of Pennsylvania(宾夕法尼亚大学);MIT(麻省理工学院)
Learning from Repaired Reasoning: Root-Cause-Guided On-Policy Distillation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);School of Information Technology and Management, University of International Business and Economics(对外经济贸易大学信息与技术管理学院)
In Good GRACEs: Principled Teacher Selection for Knowledge Distillation
Princeton Language and Intelligence(普林斯顿语言与智能研究所);Kempner Institute, Harvard(哈佛凯普纳研究所);Microsoft Research, New York(微软研究院(纽约));University of Pennsylvania(宾夕法尼亚大学)