arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.04444cs.AI
收藏

Gödel Agent:一种用于递归自我改进的自指代理框架

Gödel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement

Peking University(北京大学);University of California, Santa Barbara(加州大学圣巴巴拉分校);University of Arizona(亚利桑那大学)

Xunjian Yin, Xinyi Wang, Liangming Pan, Li Lin, Xiaojun Wan, William Yang Wang

AI总结:

针对现有代理系统受限于人为设计而无法探索全局最优设计空间的问题,本文提出Gödel Agent框架,利用LLMs通过高层目标提示动态修改自身逻辑与行为,实现无需预定义例程的递归自我改进,并在性能、效率和泛化能力上超越人工设计的代理。

摘要:

大型语言模型(LLMs)的快速发展显著提升了AI驱动的代理在各类任务中的能力。然而,现有的代理系统,无论是基于固定流水线算法还是预定义的元学习框架,由于人为设计组件的限制,都无法搜索整个代理设计空间,因此可能会错过全局最优的代理设计。在本文中,我们提出了Gödel Agent,这是一个受Gödel machine启发的自演化框架,使代理能够递归地自我改进,而无需依赖预定义的例程或固定的优化算法。Gödel Agent利用LLMs动态修改自身的逻辑和行为,仅通过提示由高层目标引导。在数学推理和复杂代理任务上的实验结果表明,Gödel Agent的实现能够实现持续的自我改进,在性能、效率和泛化能力上超越人工设计的代理。

英文摘要:

The rapid advancement of large language models (LLMs) has significantly enhanced the capabilities of AI-driven agents across various tasks. However, existing agentic systems, whether based on fixed pipeline algorithms or pre-defined meta-learning frameworks, cannot search the whole agent design space due to the restriction of human-designed components, and thus might miss the globally optimal agent design. In this paper, we introduce Gödel Agent, a self-evolving framework inspired by the Gödel machine, enabling agents to recursively improve themselves without relying on predefined routines or fixed optimization algorithms. Gödel Agent leverages LLMs to dynamically modify its own logic and behavior, guided solely by high-level objectives through prompting. Experimental results on mathematical reasoning and complex agent tasks demonstrate that implementation of Gödel Agent can achieve continuous self-improvement, surpassing manually crafted agents in performance, efficiency, and generalizability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑