arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.02810cs.AIcs.CLcs.LG
收藏

StateAct:通过自我提示与状态跟踪增强大语言模型基础智能体

StateAct: Enhancing LLM Base Agents via Self-prompting and State-tracking

Imperial College London(伦敦帝国学院)

Nikolai Rozanov, Marek Rei

AI总结:

StateAct 提出通过自我提示和状态链跟踪来增强大语言模型基础智能体的长程推理与目标遵循能力,在多个基准上显著超越 ReAct,并可作为即插即用组件进一步提升先进智能体方法的性能。

摘要:

大语言模型(LLMs)正越来越多地被用作自主智能体,处理从机器人技术到网页导航等各类任务。它们的性能取决于底层的基础智能体。然而,现有方法在长上下文推理和目标遵循方面存在困难。我们提出了 StateAct,这是一种新颖且高效的基础智能体,通过以下两种机制增强决策能力:(1)自我提示(self-prompting),在每一步强化任务目标;(2)状态链(chain-of-states),这是思维链(chain-of-thought)的扩展,用于随时间跟踪状态信息。在多个前沿大语言模型上,StateAct 在 Alfworld 上比此前最佳的基础智能体 ReAct 性能高出 10% 以上,在 Textcraft 上高出 30%,在 Webshop 上高出 7%。我们还证明,StateAct 可以作为 ReAct 的直接替代品,与测试时扩展(test-time scaling)等先进的大语言模型智能体方法配合使用,在 Textcraft 上额外获得 12% 的提升。通过在不增加额外训练或检索的情况下提高效率和长程推理能力,StateAct 为大语言模型智能体提供了一个可扩展的基础。我们已在 https://github.com/ai-nikolai/stateact 开源代码以支持进一步研究。

英文摘要:

Large language models (LLMs) are increasingly used as autonomous agents, tackling tasks from robotics to web navigation. Their performance depends on the underlying base agent. Existing methods, however, struggle with long-context reasoning and goal adherence. We introduce StateAct, a novel and efficient base agent that enhances decision-making through (1) self-prompting, which reinforces task goals at every step, and (2) chain-of-states, an extension of chain-of-thought that tracks state information over time. StateAct outperforms ReAct, the previous best base agent, by over 10% on Alfworld, 30% on Textcraft, and 7% on Webshop across multiple frontier LLMs. We also demonstrate that StateAct can be used as a drop-in replacement for ReAct with advanced LLM agent methods such as test-time scaling, yielding an additional 12% gain on Textcraft. By improving efficiency and long-range reasoning without requiring additional training or retrieval, StateAct provides a scalable foundation for LLM agents. We open source our code to support further research at https://github.com/ai-nikolai/stateact .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑