arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.12366cs.RO
收藏

APT: 动作专家预训练提升视觉-语言-动作策略的指令泛化能力

APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies

Zhejiang University(浙江大学);Zhejiang Humanoid Robot Innovation Center(浙江人形机器人创新中心)

Kechun Xu, Zhenjie Zhu, Anzhe Chen, Rong Xiong, Yue Wang

AI总结:

针对连续动作专家模型对分布外语言指令泛化差的问题,提出APT两阶段训练方法,先预训练动作专家作为视觉-动作先验,再通过门控融合注入语言,显著提升泛化性能。

摘要:

视觉-语言-动作(VLA)模型将预训练的视觉-语言模型(VLM)与连续动作专家结合,在操作任务上取得了强劲性能,但对分布外(OOD)语言指令的泛化能力仍然较差。一个已知挑战是VLA数据中的结构不平衡,其中语言的多样性远低于视觉和动作内容,使得策略容易依赖视觉捷径。虽然离散动作方法通过视觉-语言联合训练缓解了这一问题,但连续动作专家缺乏此类保护:它们从随机初始化开始,完全从不平衡数据中学习,产生噪声梯度,破坏VLM并无法利用其语言能力。我们从贝叶斯角度出发,将策略分解为与语言无关的视觉-动作(VA)先验和语言条件化的VLA似然,并提出APT,一种强调动作专家预训练的两阶段训练方法。在第一阶段,动作专家作为VA先验,在冻结的VLM提供的视觉-动作对上进行预训练,绕过了语言不平衡问题。在第二阶段,通过门控融合机制注入语言标记,该机制整合VLM特征的同时保留已学习的视觉运动先验。APT适用于主流VLA架构,包括π和GR00T风格架构。综合实验验证了APT在未见指令和组合任务上取得了一致的性能提升。项目页面:此 https URL

英文摘要:

Vision-Language-Action (VLA) models that couple pretrained Vision-Language Models (VLMs) with continuous action experts have achieved strong manipulation performance, yet generalization to out-of-distribution (OOD) language instructions remains poor. A known challenge is the structural imbalance in VLA data, where language is far less diverse than visual and action content, making policies prone to visual shortcuts. While discrete-action methods mitigate this through vision-language co-training, continuous action experts lack such protection: they start from random initialization and learn entirely from imbalanced data, producing noisy gradients that corrupt the VLM and fail to exploit its language capability. We address this from a Bayesian perspective, factorizing the policy into a language-agnostic Vision-Action (VA) prior and a language-conditioned VLA likelihood, and propose APT, a two-stage training method emphasizing Action expert PreTraining. In Stage 1, the action expert is pretrained as a VA prior on vision-action pairs from a frozen VLM, bypassing the language imbalance. In Stage 2, language tokens are injected through a gated fusion mechanism that integrates VLM features while preserving the learned visuomotor prior. APT applies to mainstream VLA architectures, including the $π$ and GR00T-style architectures. Comprehensive experiments validate that APT achieves consistent gains on unseen instructions and compositional tasks. Project Page: https://xukechun.github.io/papers/APT/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑