arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.26294cs.LGcs.AIcs.MAcs.NE
收藏

红皇后哥德尔机:共同进化的智能体及其评估者

The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators

Alex Iacob, Andrej Jovanović, William F. Shen, Daniel Burkhardt, Meghdad Kurmanji, Nurbek Tastan, Lorenzo Sani, Niccolò Alberto Elia Venanzi, Jiayi Nie, Ambrois… 展开作者

Alex Iacob, Andrej Jovanović, William F. Shen, Daniel Burkhardt, Meghdad Kurmanji, Nurbek Tastan, Lorenzo Sani, Niccolò Alberto Elia Venanzi, Jiayi Nie, Ambroise Odonnat, Zeyu Cao, Bill Marino, Xinchi Qiu, Rika Antonova, Nicholas D. Lane

AI总结:

提出红皇后哥德尔机(RQGM),一种在非平稳效用下实现递归自我改进的进化框架,通过受控效用演化在编码、论文写作和证明任务上超越现有自我改进智能体。

摘要:

自我改进智能体在智能体编码基准上达到最先进水平,并最近扩展到通用领域。然而,它们的搜索方法通常假设一个固定的评估标准:一个固定的验证器、基准或标注数据集,在智能体改进过程中保持有效。这忽略了进化的一个核心特征:物种随着环境的变化而适应。我们旨在将同样的原则引入递归自我改进,使评估成为改进循环的一部分,并将搜索开放给进化的评估者、对抗性目标和可能超越静态基准的动态效用。我们引入了红皇后哥德尔机(RQGM),一个用于非平稳效用下递归自我改进的进化框架。RQGM通过受控效用演化实现了这一点:搜索被组织成具有固定时期内评估标准的时期,而效用可以在时期边界更新,因此随着目标在时期间的演化,每个时期内的自我改进保证成立。我们首先展示,即使在可验证的编码任务上,RQGM通过添加一个互补的智能体作为评判者的代码审查信号,将测试通过率提高到超过先前最先进水平。该信号更便宜,RQGM使用的令牌数减少1.35倍至1.72倍。然后我们转向科学论文写作和评审,以及奥林匹克级别的证明写作和评分,在这些任务上RQGM比先前的自我改进智能体表现更好:共同进化的写手在多样化的智能体作为评判者小组下达到1.78倍至1.86倍更高的接受率,而共同进化的评分者达到9%更高的真实准确率。在论文评审中,最强的基线评审者过度接受AI生成的论文,高达人类接受率的1.91倍。RQGM通过引入一个对抗性目标来纠正这一点,该目标发现对AI和人类工作同样严格的评审者。

英文摘要:

Self-improving agents are state-of-the-art on agentic coding benchmarks, yet their search methods assume a stationary evaluation criterion. This ignores a central feature of evolution: species adapt as their environments change with them. We introduce the Red Queen Gödel Machine (RQGM), an evolutionary framework for recursive self-improvement under non-stationary utilities. This allows learned evaluators to improve alongside the agents they guide. On DeepSWE, the RQGM improves over its fixed-evaluator baseline by adding a complementary agent-as-a-judge code-review signal: a co-evolved reviewer grades coder patches to guide search. At low reasoning effort, the RQGM coder passes 82.1% of held-out tasks against the baseline's 75.0%, and nearly matches the GPT-6 Astra model at high effort. In scientific paper writing and reviewing, and Olympiad-level proof writing and grading, co-evolved evaluators provide an evaluation criterion. Anchored to human IMO grades, a co-evolved grader writes its own milestone rubric and exceeds static baselines at a 3x lower search cost, driving the prover to the best mean score. Since the RQGM can modify the search objective across epochs, it can regularize the search. For example, the RQGM reduces self-preference bias via an additional adversarial objective to discover reviewers equally stringent on AI and human work. Guided by these calibrated reviewers, co-evolved writers reach 1.78x-1.86x higher acceptance rates than the baseline under an agent-as-a-judge panel. The RQGM enables self-improving systems where agents and evaluators recursively bootstrap each other beyond static evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑