arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.09388cs.SEcs.AI
收藏

AI代码库成熟度模型:从辅助编码到完全自主系统

The AI Codebase Maturity Model: From Assisted Coding to Fully Autonomous Systems

IBM Research — Hybrid Cloud and AI Platform(IBM混合云和人工智能平台研究院)

Andy Anderson

AI总结:

本文提出AI代码库成熟度模型(ACMM),通过100天经验报告和Hive系统验证,展示代码库从基础AI辅助到完全自主的六级进化框架,强调测试覆盖率和反馈机制是关键因素。

摘要:

AI编码工具被广泛采用,但大多数团队在提示和审查阶段停滞不前,缺乏系统进步的框架。本文提出了AI代码库成熟度模型(ACMM),一个六级框架,描述代码库如何从基础AI辅助编码发展到完全自主系统。受CMMI启发,每个级别由反馈循环拓扑结构定义,即必须存在的机制。通过维护KubeStellar Console的100天经验报告和Hive系统的初始生产部署验证模型,Hive实现了第六级:完全自主。系统目前拥有74个CI/CD工作流、32个夜间测试套件、91%的代码覆盖率,且bug到修复时间在30分钟内。核心发现:AI驱动开发系统的智能不在于AI模型本身,而在于围绕它的指令、测试、指标和反馈循环基础设施。不能跳过级别,每个级别解锁下一个级别的关键是另一个反馈机制。测试-测试用例数量、覆盖率阈值和测试执行可靠性证明是整个旅程中最重要的投资。v2将模型扩展为六级,增加第六级(完全自主)并加入Beads用于跨代理内存连续性,以及从第二级到第六级的吞吐量加速数据。

英文摘要:

AI coding tools are widely adopted, but most teams plateau at prompt-and-review without a framework for systematic progression. This paper presents the AI Codebase Maturity Model (ACMM), a 6-level framework describing how codebases evolve from basic AI-assisted coding to fully autonomous systems. Inspired by CMMI, each level is defined by its feedback loop topology - the specific mechanisms that must exist before the next level becomes possible. I validate the model through a 100-day experience report maintaining KubeStellar Console, a CNCF Kubernetes dashboard built from scratch with Claude Code (Opus) and GitHub Copilot, and through the initial production deployment of Hive - an open-source multi-agent orchestration system that realizes Level 6: full autonomy. The system currently operates with 74 CI/CD workflows, 32 nightly test suites, 91% code coverage, and achieves bug-to-fix times under 30 minutes - 24 hours a day. The central finding: the intelligence of an AI-driven development system resides not in the AI model itself, but in the infrastructure of instructions, tests, metrics, and feedback loops that surround it. You cannot skip levels, and at each level, the thing that unlocks the next one is another feedback mechanism. Testing - the volume of test cases, the coverage thresholds, and the reliability of test execution - proved to be the single most important investment in the entire journey. v2 extends the model from 5 to 6 levels, adding Level 6 (Fully Autonomous) with Hive as reference implementation and Beads for cross-agent memory continuity, plus throughput acceleration data showing 5x PR throughput and 37x issue throughput from Level 2 to Level 6.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑