AI写作速度超过人类审阅:一项关于企业2x强制令的纵向研究
AI Writes Faster Than Humans Can Review: A Longitudinal Study of an Enterprise 2x Mandate
AI总结:
本研究通过802名开发者及196,212个拉取请求的纵向数据,量化评估了某中型AI公司自2025年中实施的“2x”强制令效果,发现人均吞吐量最终翻倍至2.09倍,且增益通过采纳与使用渠道实现,同时代码审查结构转向自动化。
摘要:
企业越来越多地强制使用AI编码工具并报告巨大的生产力提升,但关于这种强制令如何展开的纵向证据很少。在本文中,我们针对一家中型、AI前沿的公司,自2025年中以来致力于将每位工程师合并的拉取请求数量翻倍,对其有记录的“2x”强制令进行了定量案例研究。在802名开发者和196,212个拉取请求(2024年1月至2026年4月)的面板数据中,人均吞吐量最终翻倍,于2026年4月达到强制令前基线的2.09倍,据我们所知,这是现场部署AI编码工具所报告的最大增益之一。交错的双重差分设计将开发者内部的这一增益份额与AI采纳以及随累积使用而增长的进一步增益联系起来,强制令作为催化剂而非直接驱动因素。由于采纳和使用强度并非随机分配,我们将此证据解读为强烈暗示采纳和使用渠道,而非精确的因果归因。该增益在资历上广泛共享,但集中在较新的代码中,并且在不同模型代际间不可分离。采纳还围绕自动化重构了代码审查:每位审阅者的负载大约翻倍,自动化审查超过了人工审查,而合并和回滚率保持稳定。
英文摘要:
Enterprises increasingly mandate the use of AI coding tools and set ambitious productivity targets, yet there is little longitudinal evidence on whether such productivity targets have been reached, how, and at what cost. We present a quantitative case study of a documented enterprise "2x" mandate: in June 2025, the CTO of a mid-sized, AI-forward software company set the goal of doubling merged pull requests (PRs) per engineer with AI. Using a panel of 802 developers and 196,212 PRs (Jan 2024-Apr 2026), we estimate the effect of AI adoption by comparing each developer's PR throughput after they started using AI tools with their throughput before adoption. We find that the company eventually reached the target, but only in the tenth month and not in the way the mandate implied: PR throughput barely changed at the mandate date, increased by about 12% when each developer started using AI, and then kept increasing as developers accumulated use. The target was not met merely by working longer or splitting work: extra working days account for at most one-fifth of the throughput increase, and the added PRs became larger and skewed toward features and bug fixes rather than routine changes. The gain is similar across seniority levels and larger in repositories created since 2022. The cost of AI adoption fell on code review, where load per reviewer doubled and automated review exceeded human review in coverage within months of the mandate. We interpret these results as strong evidence that the adoption and sustained usage of AI raises PR throughput in an enterprise setting, with two caveats: throughput is only a proxy for productivity, and the exact size of the effect remains uncertain due to a lack of truly randomized assignment in our setting. Our results have implications for organizations under AI transformations and researchers studying the impact of AI on software development productivity.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。