We study allowing large language models (LLMs) to process arbitrarily long prompts through the lens of inference-time scaling. We propose Recursive Language Models (RLMs), a general inference paradigm that treats long prompts as part of an external environment and allows the LLM to programmatically examine, decompose, and recursively call itself over snippets of the prompt. We find that RLMs can successfully process inputs up to two orders of magnitude beyond model context windows and, even for shorter prompts, dramatically outperform the quality of vanilla frontier LLMs and common long-context and coding scaffolds (e.g., on GPT-5 by a median across the evaluated benchmarks of $26\%$ against compaction, $130\%$ against CodeAct with sub-calls, and $13\%$ against Claude Code) across four diverse long-context tasks while having comparable cost. At a small scale, we post-train the first model around the RLM. Our model, RLM-Qwen3-8B, outperforms the underlying Qwen3-8B model by $28.3\%$ on average and even approaches the quality of vanilla GPT-5 on three long-context tasks. Code is available at https://github.com/alexzhang13/rlm.
The $\mathbf{Y}$-Combinator for LLMs: Solving Long-Context Rot with $λ$-Calculus
The School of Interdisciplinary Research(跨学科研究学院);Indian Institute of Technology (IIT) Delhi(印度理工学院德里分校);Robert Bosch GmbH, India(德国罗伯特·博世有限公司,印度);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Huawei Noah’s Ark UCL Centre for Artificial Intelligence(华为诺亚方舟大学伦敦人工智能中心)
Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes
Bosch Center for Artificial Intelligence(博世人工智能中心);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Hochschule der Medien(斯图加特媒体大学);Karlsruhe University of Applied Sciences(卡尔斯鲁厄应用技术大学)
100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Models
MiroMind(米罗Mind);Fudan University(复旦大学);National University of Singapore(新加坡国立大学);Singapore University of Technology and Design(新加坡科技设计大学);Nanyang Technological University(南洋理工大学)
Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM
University of Southern California(南加州大学);The University of Queensland(昆士兰大学);University of California, San Diego(加州大学圣地亚哥分校);University of California, Merced(加州大学默塞德分校)
Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Information, Renmin University of China(中国人民大学信息学院);Kuaishou Technology(快手科技)
Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models
the Department of Computer Science and Engineering, Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系);the institute of information engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);the College of Computer, National University of Defense Technology(国防科技大学计算机学院);the University of Sydney(悉尼大学)
PRefLexOR: Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning and Agentic Thinking
Center for Computational Science and Engineering(计算科学与工程中心);Schmarzman College of Computing(施马茨曼计算学院);Laboratory for Atomistic and Molecular Mechanics (LAMM)(原子与分子力学实验室);Massachusetts Institute of Technology(麻省理工学院)
Do Language Models Converge to Themselves? Recursive Self-Refinement as Textual Relaxation
Pfizer(辉瑞公司);University of California San Diego(加利福尼亚大学圣地亚哥分校);Institute for Medical Philosophy and Future Artificial Intelligence(医学哲学与未来人工智能研究所);Tongji University(同济大学);Shanghai Jiao Tong University(上海交通大学);Institute of Humanities and Social Science Data, Fudan University(复旦大学人文社会科学数据研究所)
Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition
Graduate School of Information Science(信息科学研究生学校);Technology, Hokkaido University, Sapporo 060-0814, Japan(技术,北海道大学,札幌060-0814,日本);Office of Institutional Research, Hokkaido University, Sapporo 060-0808, Japan(机构研究办公室,北海道大学,札幌060-0808,日本);Faculty of Information Science(信息科学学院)
HaReCAP: Habitual-action Grounding for Recursive Large Language Model Agents
North China Institute of Computer System Engineering(华北计算机系统工程研究所);University of Science and Technology of China(中国科学技术大学);China Information Security Research Institute Co., Ltd.(中国信息安全研究院有限公司)