arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.21684cs.ROcs.LG
收藏

动作生成中的主-细分离

Primary-Fine Decoupling for Action Generation in Robotic Imitation

MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发智能感知与认知国家重点实验室,中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(人工智能研究院,合肥综合性国家科学中心)

Xiaohan Lei, Min Wang, Wengang Zhou, Xingyu Lu, Houqiang Li

AI总结:

PF-DAG通过两阶段框架实现动作生成中的主-细分离,提升机器人模仿学习的多模态建模与闭环控制性能。

摘要:

机器人操作动作序列中的多模态分布对模仿学习提出了关键挑战。为此,现有方法通常将动作空间建模为离散的标记集或连续的潜在变量分布。然而,这两种方法都存在权衡:一些方法将动作离散化为标记,因此会丢失细粒度的动作变化,而另一些方法在单阶段生成连续动作时容易产生不稳定的模式转换。为了解决这些限制,我们提出了动作生成中的主-细分离(PF-DAG),一种两阶段框架,将粗动作一致性与细粒度变化分离。首先,我们将动作块压缩成一小组离散模式,使轻量级策略能够选择一致的粗模式并避免模式跳动。其次,学习了一个基于模式的MeanFlow策略来生成高保真的连续动作。理论上,我们证明PF-DAG的两阶段设计实现了比单阶段生成策略严格更低的MSE界限。实验上,PF-DAG在Adroit、DexArt和MetaWorld基准的56个任务中均优于最先进的基线方法。它进一步推广到现实世界触觉灵巧操作任务。我们的工作表明,显式模式级分离能够实现稳健的多模态建模和反应闭环控制。

英文摘要:

Multi-modal distribution in robotic manipulation action sequences poses critical challenges for imitation learning. To this end, existing approaches often model the action space as either a discrete set of tokens or a continuous, latent-variable distribution. However, both approaches present trade-offs: some methods discretize actions into tokens and therefore lose fine-grained action variations, while others generate continuous actions in a single stage tend to produce unstable mode transitions. To address these limitations, we propose Primary-Fine Decoupling for Action Generation (PF-DAG), a two-stage framework that decouples coarse action consistency from fine-grained variations. First, we compress action chunks into a small set of discrete modes, enabling a lightweight policy to select consistent coarse modes and avoid mode bouncing. Second, a mode conditioned MeanFlow policy is learned to generate high-fidelity continuous actions. Theoretically, we prove PF-DAG's two-stage design achieves a strictly lower MSE bound than single-stage generative policies. Empirically, PF-DAG outperforms state-of-the-art baselines across 56 tasks from Adroit, DexArt, and MetaWorld benchmarks. It further generalizes to real-world tactile dexterous manipulation tasks. Our work demonstrates that explicit mode-level decoupling enables both robust multi-modal modeling and reactive closed-loop control for robotic manipulation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑