arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.07091cs.AIcs.CL
收藏

认知带宽瓶颈:将长时程智能体从基于动作的规划转向基于模式的规划

The Cognitive Bandwidth Bottleneck: Shifting Long-Horizon Agent from Planning with Actions to Planning with Schemas

The Hong Kong University of Science and Technology(香港科学与技术大学)

Baixuan Xu, Tianshi Zheng, Zhaowei Wang, Hong Ting Tsang, Weiqi Wang, Tianqing Fang, Yangqiu Song

AI总结:

本文提出认知带宽视角,比较基于动作与基于模式的规划,发现表示选择拐点,并给出构建更强PwS智能体的指南。

摘要:

使大型语言模型能够有效执行需要长期规划和多次交互的长时程任务,对于开放世界自主性至关重要。传统方法采用基于动作的规划(planning with actions, PwA),即提供可执行的动作列表作为参考。然而,当环境动作空间组合爆炸(例如,开放式的现实世界)时,这种动作表示选择将变得不切实际。这自然引出一个问题:随着环境动作空间的扩展,长时程智能体的最优动作表示是什么?在本文中,我们系统地研究了两种不同动作表示的有效性。第一种是传统的基于动作的规划(PwA),因其在现有基准上的有效性而被广泛采用。另一种是基于模式的规划(planning with schemas, PwS),它将动作模式实例化为动作列表(例如,"移动[物体]到[物体]" -> "移动苹果到桌子"),以确保动作空间简洁且可可靠扩展。这种替代方案的动机在于其与人类认知的一致性及其对环境施加的动作格式限制的遵从。我们提出认知带宽视角作为概念框架,以定性理解这两种动作表示之间的差异,并经验性地观察到ALFWorld(约35个动作)和SciWorld(约500个动作)之间的表示选择拐点,这为可扩展表示的需求提供了证据。我们进一步进行受控实验,研究该拐点位置如何与不同模型能力相互作用:更强的规划能力使拐点右移,而更好的模式实例化使其左移。最后,鉴于PwS智能体的次优性能,我们为构建更强大的PwS智能体以更好地实现可扩展自主性提供了可操作的指南。

英文摘要:

Enabling LLMs to effectively operate long-horizon task which requires long-term planning and multiple interactions is essential for open-world autonomy. Conventional methods adopt planning with actions where a executable action list would be provided as reference. However, this action representation choice would be impractical when the environment action space is combinatorial exploded (e.g., open-ended real world). This naturally leads to a question: As environmental action space scales, what is the optimal action representation for long-horizon agents? In this paper, we systematically study the effectiveness of two different action representations. The first one is conventional planning with actions (PwA) which is predominantly adopted for its effectiveness on existing benchmarks. The other one is planning with schemas (PwS) which instantiate an action schema into action lists (e.g., "move [OBJ] to [OBJ]" -> "move apple to desk") to ensure concise action space and reliable scalability. This alternative is motivated by its alignment with human cognition and its compliance with environment-imposed action format restriction. We propose cognitive bandwidth perspective as a conceptual framework to qualitatively understand the differences between these two action representations and empirically observe a representation-choice inflection point between ALFWorld (~35 actions) and SciWorld (~500 actions), which serve as evidence of the need for scalable representations. We further conduct controlled experiments to study how the location of this inflection point interacts with different model capacities: stronger planning proficiency shifts the inflection rightward, whereas better schema instantiation shifts it leftward. Finally, noting the suboptimal performance of PwS agents, we provide an actionable guide for building more capable PwS agents for better scalable autonomy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑