AI coding tools are widely adopted, but most teams plateau at prompt-and-review without a framework for systematic progression. This paper presents the AI Codebase Maturity Model (ACMM), a 6-level framework describing how codebases evolve from basic AI-assisted coding to fully autonomous systems. Inspired by CMMI, each level is defined by its feedback loop topology - the specific mechanisms that must exist before the next level becomes possible. I validate the model through a 100-day experience report maintaining KubeStellar Console, a CNCF Kubernetes dashboard built from scratch with Claude Code (Opus) and GitHub Copilot, and through the initial production deployment of Hive - an open-source multi-agent orchestration system that realizes Level 6: full autonomy. The system currently operates with 74 CI/CD workflows, 32 nightly test suites, 91% code coverage, and achieves bug-to-fix times under 30 minutes - 24 hours a day. The central finding: the intelligence of an AI-driven development system resides not in the AI model itself, but in the infrastructure of instructions, tests, metrics, and feedback loops that surround it. You cannot skip levels, and at each level, the thing that unlocks the next one is another feedback mechanism. Testing - the volume of test cases, the coverage thresholds, and the reliability of test execution - proved to be the single most important investment in the entire journey. v2 extends the model from 5 to 6 levels, adding Level 6 (Fully Autonomous) with Hive as reference implementation and Beads for cross-agent memory continuity, plus throughput acceleration data showing 5x PR throughput and 37x issue throughput from Level 2 to Level 6.
Specification-first convergence with an AI coding agent: a case study of dismantling a core architectural invariant across 189 files in a 717k-line codebase with no test oracle and no human code review
ChainSWE: Benchmarking Coding Agents on Multi-Bug Software Maintenance
NVIDIA(英伟达);University College London(伦敦大学学院);New York University(纽约大学);Georgia Institute of Technology(佐治亚理工学院);Cornell University(康奈尔大学);Stanford University(斯坦福大学);Northeastern University(东北大学)
Allen Institute for AI(艾伦人工智能研究所);University of Washington(华盛顿大学);Carnegie Mellon University(卡内基梅隆大学);Paul G. Allen School of Computer Science and Engineering(保罗·G·艾伦计算机科学与工程学院);Allen Institute of Artificial Intelligence(艾伦人工智能研究所);Machine Learning Department(机器学习系)
Prometheus: Towards Long-Horizon Codebase Navigation for Repository-Level Problem Solving
University College London(伦敦大学学院);Sana Labs(Sana实验室);Uppsala University(乌普萨拉大学);Nanjing University(南京大学);Carnegie Mellon University(卡内基梅隆大学);KTH Royal Institute of Technology(瑞典皇家理工学院)
SWE-Chain: Benchmarking Coding Agents on Chained Release-Level Package Upgrades
The Chinese University of Hong Kong(香港中文大学);Independent(独立);ELLIS;Technical University of Darmstadt(达姆施塔特技术大学);Johns Hopkins University(约翰霍普金斯大学);Monash University(墨尔本大学)
SWE-Bench Mobile: Can Large Language Model Agents Develop Industry-Level Mobile Applications?
University of Toronto(多伦多大学);Xiaohongshu Inc.(小红书);Coolwei AI Lab(酷维人工智能实验室);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Berkeley(加利福尼亚大学伯克利分校)
Shanghai Jiao Tong University(上海交通大学);Xi’an Jiaotong University(西安交通大学);Zhejiang University(浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术开发区(滨江)区块链与数据安全研究院)
A Large-Scale Comprehensive Measurement of AI-Generated Code in Real-World Repositories
Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington(印第安纳大学布卢明顿分校卢迪信息学、计算与工程学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算机与数据科学学院)