As LLMs proliferate with diverse capabilities and costs, LLM routing has emerged by learning to predict each LLM's quality and cost for a given query, then selecting the one with high quality and low cost. However, existing routers implicitly assume a single fixed quality and cost per LLM for each query, ignoring that the same LLM's quality varies with its output length. This causes routers to exclude powerful LLMs when their estimated cost exceeds the budget, missing the opportunity that these LLMs could still deliver high quality at reduced cost with shorter outputs. To address this, we introduce R2-Router, which treats output length budget as a controllable variable and jointly selects the best LLM and length budget, enforcing the budget via length-constrained instructions. This enables R2-Router to discover that a powerful LLM with constrained output can outperform a weaker LLM at comparable cost-efficient configurations invisible to prior methods. Together with the router framework, we construct R2-Bench, the first routing dataset capturing LLM behavior across diverse output length budgets. Experiments show that R2-Router achieves state-of-the-art performance at 4-5\times lower cost compared with existing routers. This work opens a new direction: routing as reasoning, where routers evolve from reactive selectors to deliberate reasoners that explore which LLM to use and at what cost budget. The code is publicly available at https://github.com/UCF-ML-Research/R2-Router.
LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Maryland, College Park(马里兰大学帕克分校);Nanyang Technological University(南洋理工大学);Purdue University(普渡大学);University of Illinois Chicago(芝加哥伊利诺伊大学)
RouterDC: Query-Based Router by Dual Contrastive Learning for Assembling Large Language Models
Southern University of Science and Technology(南方科技大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)
Route to Rome Attack: Directing LLM Routers to Expensive Models via Adversarial Suffix Optimization
Key Laboratory of Symbolic Computation and Knowledge Engineering, MoE, Jilin University(符号计算与知识工程重点实验室,MoE,吉林大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机学院,北京大学);LLM-Core Xiaomi(小米LLM-Core)
Part-Of-Speech Sensitivity of Routers in Mixture of Experts Models
CNRS(法国国家科学研究中心);Aix-Marseille Université(艾克斯-马赛大学);International Laboratory on Learning Systems (ILLS - IRL CNRS)(国际学习系统实验室);Université de Montréal(蒙特利尔大学)
VL-RouterBench: A Benchmark for Vision-Language Model Routing
Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University(1 图像处理与模式识别研究所,上海交通大学);The Hong Kong University of Science and Technology (Guangzhou)(2 香港科学与技术大学(广州));The Hong Kong University of Science and Technology(3 香港科学与技术大学)
When Are Experts Misrouted? Counterfactual Routing Analysis in Mixture-of-Experts Language Models
Department of Computer Science and Engineering, POSTECH, South Korea(韩国POSTECH计算机科学与工程系);Graduate School of Artificial Intelligence, POSTECH, South Korea(韩国POSTECH人工智能研究生院);Microsoft Research Asia, Beijing, China(中国北京微软亚洲研究院)