arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09138cs.AIcs.CL
收藏

PABU:面向高效LLM代理的进度感知信念更新

PABU: Progress-Aware Belief Update for Efficient LLM Agents

North Carolina State University, Raleigh, NC, USA(北卡罗来纳州立大学);University of California, Irvine, CA, USA(加州大学伊市分校);Amazon, Seattle, WA, USA(亚马逊公司)

Haitao Jiang, Lin Ge, Hengrui Cai, Rui Song

AI总结:

PABU通过显式建模任务进度和选择性保留历史信息,提升了LLM代理的任务完成效率和性能。

摘要:

大型语言模型(LLM)代理通常根据完整的动作-观察历史来决定动作,这会引入与任务无关的信息,容易导致冗余动作和更高的推理成本。我们提出了进度感知信念更新(PABU),一种信念状态框架,通过显式建模任务进度并选择性保留过去动作和观察来紧凑地表示代理的状态。在每一步,代理预测自上一轮以来的相对进度,并决定是否存储新遇到的交互,仅根据保留的子集来决定未来行动。在AgentGym基准的八个环境中,使用相同的训练轨迹,PABU实现了81.0%的任务完成率,比使用完整历史信念的先前最佳模型(SoTA)高出23.9%。此外,PABU的基于进度的动作选择提高了效率,将平均交互步骤数减少到9.5,对应26.9%的减少。消融研究显示,显式的进度预测和选择性保留对于稳健的信念学习和性能提升都是必要的。

英文摘要:

Large Language Model (LLM) agents commonly condition actions on full action-observation histories, which introduce task-irrelevant information that easily leads to redundant actions and higher inference cost. We propose Progress-Aware Belief Update (PABU), a belief-state framework that compactly represents an agent's state by explicitly modeling task progress and selectively retaining past actions and observations. At each step, the agent predicts its relative progress since the previous round and decides whether the newly encountered interaction should be stored, conditioning future decisions only on the retained subset. Across eight environments in the AgentGym benchmark, and using identical training trajectories, PABU achieves an 81.0% task completion rate, outperforming previous State of the art (SoTA) models with full-history belief by 23.9%. Additionally, PABU's progress-oriented action selection improves efficiency, reducing the average number of interaction steps to 9.5, corresponding to a 26.9% reduction. Ablation studies show that both explicit progress prediction and selective retention are necessary for robust belief learning and performance gains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑