arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.12480cs.ROcs.AI
收藏

一步流策略:用于快速视觉-运动策略的自蒸馏

One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policies

Shaolong Li, Lichao Sun, Yongchao Chen

AI总结:

本文提出一步流策略,通过自蒸馏实现高保真单步动作生成,无需预训练教师模型,有效提升动作生成速度和控制精度。

摘要:

生成流和扩散模型提供了连续的多模态动作分布,适用于高精度机器人策略。然而,其依赖于迭代采样导致严重的推理延迟,影响控制频率和时间敏感操作的性能。为此,我们提出了一步流策略(OFP),一种从头开始的自蒸馏框架,用于高保真单步动作生成,无需预训练教师。OFP统一了自一致性损失以强制时间间隔内的相干传输,并采用自引导正则化以使预测更精确地指向高密度专家模式。此外,一个预热机制利用时间动作相关性以最小化生成传输距离。在56种不同的模拟操作任务上的评估表明,一步OFP实现了最先进的结果,优于100步扩散和流策略,同时将动作生成速度提高了超过100倍。我们进一步将OFP集成到RoboTwin 2.0上的π_{0.5}模型中,其中一步OFP超过了原始10步策略。这些结果确立了OFP作为高精度和低延迟机器人控制的实用、可扩展的解决方案。

英文摘要:

Generative flow and diffusion models provide the continuous, multimodal action distributions needed for high-precision robotic policies. However, their reliance on iterative sampling introduces severe inference latency, degrading control frequency and harming performance in time-sensitive manipulation. To address this problem, we propose the One-Step Flow Policy (OFP), a from-scratch self-distillation framework for high-fidelity, single-step action generation without a pre-trained teacher. OFP unifies a self-consistency loss to enforce coherent transport across time intervals, and a self-guided regularization to sharpen predictions toward high-density expert modes. In addition, a warm-start mechanism leverages temporal action correlations to minimize the generative transport distance. Evaluations across 56 diverse simulated manipulation tasks demonstrate that a one-step OFP achieves state-of-the-art results, outperforming 100-step diffusion and flow policies while accelerating action generation by over $100\times$. We further integrate OFP into the $π_{0.5}$ model on RoboTwin 2.0, where one-step OFP surpasses the original 10-step policy. These results establish OFP as a practical, scalable solution for highly accurate and low-latency robot control.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑