arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2601.03509cs.AIcs.NE

演化式程序化技能网络

Evolving Programmatic Skill Networks

DIRO & Institut Courtois, Université de Montréal(DIRO与Courtois研究所,蒙特利尔大学);Mila – Québec AI Institute(魁北克人工智能研究所);Microsoft Research(微软研究院);Canada CIFAR AI Chair(加拿大CIFAR人工智能主席)

Haochen Shi, Xingdi Yuan, Bang Liu

AI总结:

提出程序化技能网络(PSN),通过大语言模型驱动的故障定位、渐进优化和结构重构,实现开放环境中技能库的持续构建与复用。

摘要:

我们研究在开放具身环境中持续技能获取的问题,其中智能体必须构建、精炼并重用不断扩展的可执行技能库。我们引入程序化技能网络(PSN),该框架中技能是可执行的符号程序,形成通过经验演化的组合网络。PSN 定义了通过大语言模型实例化的三个核心机制:(1) 结构化故障定位,用于技能组合上的故障定位;(2) 渐进优化,具有成熟度感知的更新门控,稳定可靠技能的同时保持对不确定技能的可塑性;(3) 规范结构重构,在回滚验证下保持网络紧凑性。我们进一步表明,PSN 的学习动态在结构上与神经网络训练具有相似性。在 MineDojo 和 Crafter 上的实验证明了在开放任务分布中鲁棒的技能重用、快速适应和强泛化能力。

英文摘要:

We study continual skill acquisition in open-ended embodied environments where an agent must construct, refine, and reuse an expanding library of executable skills. We introduce the Programmatic Skill Network (PSN), a framework in which skills are executable symbolic programs forming a compositional network that evolves through experience. PSN defines three core mechanisms instantiated via large language models: (1)~\opreflect for structured fault localization over skill compositions, (2)~progressive optimization with maturity-aware update gating that stabilizes reliable skills while maintaining plasticity for uncertain ones, and (3)~canonical structural refactoring under rollback validation that maintains network compactness. We further show that PSN's learning dynamics exhibit structural parallels to neural network training. Experiments on MineDojo and Crafter demonstrate robust skill reuse, rapid adaptation, and strong generalization across open-ended task distributions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑