Machine learning model performance improvements tend to arise from competition and application. For deployment, we consider prescriptive scaling laws: given a pre-training compute budget, what downstream accuracy is attainable with contemporary post-training practice, and how stable is that mapping as the field evolves? Using large-scale observational evaluations with 5k existing and 2k newly evaluated model checkpoints spanning 2022-2026 across six benchmarks, we estimate capability boundaries, high conditional quantiles of benchmark scores as a function of log pre-training FLOPs, via smoothed quantile regression with a monotone, saturating sigmoid parameterization. We validate temporal reliability by fitting on earlier model generations and evaluating on later releases: across four of six tasks, the out-of-distribution coverage error remains below 2%, while math reasoning exhibits a consistently advancing boundary over time. For instance, at a budget of 10^24 FLOPs, the estimated attainable accuracies are 0.83 on IFEval and 0.54 on MATH Lvl 5. We then extend our approach to analyze task-dependent saturation and to probe contamination-related shifts on math reasoning tasks. Finally, we introduce a balanced I-optimal sampling algorithm that recovers near-full-data frontiers using roughly 20% of the parameter-count-weighted evaluation budget, as low as 5% on some tasks, while maintaining comparable calibration. Together, our work releases Proteus-2k, the latest model performance evaluation dataset, and introduces a practical methodology for translating compute budgets into reliable performance expectations and for monitoring when capability boundaries shift across time.
Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉学科学院);The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所认知与决策智能复杂系统重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);College of Computer Science, Inner Mongolia University(内蒙古大学计算机学院)
Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
Microsoft Research(微软研究院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Language Technology Lab, University of Cambridge(剑桥大学语言技术实验室);Nanjing University(南京大学)
L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling
NSF AI Institute for Artificial Intelligence and Fundamental Interactions(NSF人工智能与基础相互作用研究院);Massachusetts Institute of Technology(麻省理工学院);Polytechnic University of Catalonia(加泰罗尼亚理工大学);Harvard University(哈佛大学);University of California, Los Angeles(加州大学洛杉矶分校)
Research School of Astronomy & Astrophysics, The Australian National University(澳大利亚国立大学天文与天体物理研究所);Astronomical Institute, University of Wrocław(沃克劳大学天文研究所);Department of Astronomy, The Ohio State University(俄亥俄州立大学天文学系);Center for Cosmology and AstroParticle Physics (CCAPP), The Ohio State University(宇宙与天体粒子物理中心(CCAPP),俄亥俄州立大学)
本文研究 Transformer 恒星光谱仿真器的神经缩放定律,结合 TransformerPayne 与 Maximum Update Parametrization 给出均衡扩展训练指南,为光谱基础模型奠定基础。
Test-Time Training Scaling Laws for Chemical Exploration in Drug Design
Computational Science Laboratory, Universitat Pompeu Fabra, Barcelona Biomedical Research Park (PRBB), C Dr. Aiguader 88, 08003 Barcelona, Spain(计算科学实验室,庞培法布拉大学,巴塞罗那生物医学研究公园(PRBB),C Dr. Aiguader 88,08003巴塞罗那,西班牙)