We introduce LADDER (Learning through Autonomous Difficulty-Driven Example Recursion), a framework which enables Large Language Models to autonomously improve their problem-solving capabilities through self-guided learning by recursively generating and solving progressively simpler variants of complex problems. Unlike prior approaches that require curated datasets or human feedback, LADDER leverages a model's own capabilities to generate easier question variants. We demonstrate LADDER's effectiveness in the subject of mathematical integration, improving Llama 3.2 3B's accuracy from 1% to 82% on undergraduate-level problems and enabling Qwen2.5 7B Deepseek-R1 Distilled to achieve 73% on the MIT Integration Bee qualifying examination. We also introduce TTRL (Test-Time Reinforcement Learning), where we perform reinforcement learning on variants of test problems at inference time. TTRL enables Qwen2.5 7B Deepseek-R1 Distilled to achieve a state-of-the-art score of 90% on the MIT Integration Bee qualifying examination, surpassing OpenAI o1's performance. These results show how self-directed strategic learning can achieve significant capability improvements without relying on architectural scaling or human supervision.
Reasoning Up the Instruction Ladder for Controllable Language Models
Department of Computer Science and Engineering, The Ohio State University(俄亥俄州立大学计算机科学与工程系);Microsoft Research(微软研究院);Allen Institute for AI(艾伦人工智能研究所)
SRRM: Improving Recursive Transport Surrogates in the Small-Discrepancy Regime
School of Mathematical Sciences, Beijing University of Posts and Telecommunications(北京邮电大学数学科学学院);Key Laboratory of Mathematics and Information Networks (Beijing University of Posts and Telecommunications), Ministry of Education(数学信息网络重点实验室(北京邮电大学));Institute of Statistics and Big Data, Renmin University of China(中国人民大学统计与大数据研究院)
Improving accuracy in short mortality rate series: Exploring Multi-step Forecasting Approaches in Hybrid Systems
Departamento de Finanças e Contabilidade Universidade Federal da Paraíba(财务与会计系 伯南布哥联邦大学);Centro de Informática Universidade Federal de Pernambuco(计算机中心 皮奥伊联邦大学);Departamento de Estatística e Informática Universidade Federal do Cariri(统计与计算机系 卡里里联邦大学)