AI自我改进的递归临界性
Recursive Criticality of AI Self-Improvement
浏览论文内容
中文总结 AI 辅助
本研究提出递归再生数$\boldsymbol{\textit{R}}_{\boldsymbol{\text{AI}}}$模型，分析AI研发反馈的自我放大条件，可区分递归放大与其他类型的快速进展。
中文摘要 AI 辅助
AI正越来越多地被用于研发未来AI系统的过程中，本研究探讨这种反馈会在何种条件下成为自我放大的机制。我们的模型描述了AI能力的增长速率如何取决于基线研究生产力、递归反馈以及研究进展日益增加的难度。我们推导了一个递归再生数$\boldsymbol{\textit{R}}_{\boldsymbol{\text{AI}}}$，该参数决定了改进在各个开发周期中是被放大还是被衰减。这个量将反馈强度与进一步进展变得更加困难的速率进行比较：当$\boldsymbol{\textit{R}}_{\boldsymbol{\text{AI}}}>1$时，改进的效果会在各个开发周期中复合，使系统处于自我放大状态；当$\boldsymbol{\textit{R}}_{\boldsymbol{\text{AI}}}<1$时，效果会在各个周期中减弱。这种转变取决于AI研发反馈回路的结构，且不一定发生在模型能力的某个特定水平上。因此，系统可能在加速变得可见之前就进入自我放大状态，而快速进展也可能在没有自我放大的情况下发生。更高的基线研究生产力可以加速进展，但不会改变系统是否处于自我放大状态，不过开发周期的持续时间会成为放大的限制时间尺度；增加研究难度则可以结束一段自我放大的时期。将模型扩展到多个研究主体后发现，即使单个主体没有自我放大，跨组织共享的改进也能使整个研究生态系统实现自我放大。该框架识别出AI研发系统的可测量属性，有助于区分递归放大与其他来源驱动的快速进展，这些属性包括递归反馈的强度、改进传递到后续系统的效率、周期持续时间以及进一步进展的难度增加程度。
英文摘要
AI is increasingly used in the R\&D process that produces future AI systems. We study the conditions under which this feedback becomes self-amplifying. Our model describes how the rate of AI capability growth depends on baseline research productivity, recursive feedback, and the increasing difficulty of research progress. We derive a recursive reproduction number, $\mathcal{R}_{\mathrm{AI}}$, that determines whether improvements are amplified or damped across development cycles. This quantity compares the strength of feedback with the rate at which further progress becomes more difficult. When $\mathcal{R}_{\mathrm{AI}}>1$, the effects of improvements compound across development cycles, placing the system in a self-amplifying regime. When $\mathcal{R}_{\mathrm{AI}}<1$, their effects weaken across cycles. The transition depends on the structure of the AI R\&D feedback loop and need not occur at any particular level of model capability. A system can therefore enter a self-amplifying regime before acceleration becomes visible, while rapid progress can also occur without self-amplification. Higher baseline research productivity can accelerate progress without changing whether the system is self-amplifying, but the duration of the development cycle becomes a limiting timescale for amplification. Increasing research difficulty can end a period of self-amplification. Extending the model to multiple research actors shows that improvements shared across organizations can make the overall research ecosystem self-amplifying even when no individual actor is. The framework identifies measurable properties of AI R\&D systems that can help distinguish recursive amplification from rapid progress driven by other sources, including the strength of recursive feedback, how effectively improvements propagate into successor systems, cycle duration, and the increasing difficulty of further progress.
发表机构
- London Institute for Mathematical Sciences（伦敦数学科学研究院）
机构由 AI 辅助整理，请以论文原文为准。
