arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.26320cs.ROcs.CV
收藏

DFM-VLA:通过离散流匹配实现机器人操作的迭代动作细化

DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching

The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Harbin Institute of Technology(哈尔滨工业大学);ShanghaiTech University(上海科技大学);Shanghai Institute of Technical Physics, CAS(中国科学院上海技术物理研究所)
Jiayi Chen, Wenxuan Song, Jiaxin Fang, Ruiqing Yin, Jingbo Wang, Shuai Chen, Jieyuan Pei, Yikai Qin, Feifan Chen, Haodong Yan, Zhide Zhong, Wen Chen, Yan Wang, … 展开作者

Jiayi Chen, Wenxuan Song, Jiaxin Fang, Ruiqing Yin, Jingbo Wang, Shuai Chen, Jieyuan Pei, Yikai Qin, Feifan Chen, Haodong Yan, Zhide Zhong, Wen Chen, Yan Wang, Yuxiang Gao, Haoang Li

AI总结:

DFM-VLA通过离散流匹配实现机器人操作中动作token的迭代细化,采用动态概率速度场和双阶段解码策略,提升了动作生成的准确性和效率。

摘要:

视觉-语言-动作(VLA)模型通过离散令牌化方案编码动作已被广泛应用于机器人操作,但现有解码范式仍存在根本性限制。无论动作是通过自回归VLA顺序解码还是通过离散扩散VLA并行解码,一旦生成一个token,通常固定不变,无法在后续迭代中进行修正,导致早期token错误无法有效纠正。我们提出DFM-VLA,一种离散流匹配VLA,用于动作token的迭代细化。DFM-VLA建模了一个token级的概率速度场,该速度场在细化迭代中动态更新完整动作序列。我们研究了两种构建速度场的方法:辅助速度头公式和动作嵌入引导公式。我们的框架进一步采用双阶段解码策略,先进行迭代细化,再进行确定性验证以实现稳定收敛。在CALVIN、LIBERO和现实世界操作任务上的大量实验表明,DFM-VLA在操作性能上一致优于强大的自回归、离散扩散和连续扩散基线,同时保持高推理效率。特别是,DFM-VLA在CALVIN上实现了平均成功长度4.44,在LIBERO上实现了平均成功率95.7%,突显了通过离散流匹配实现动作细化在机器人操作中的价值。我们的项目可在https://chris1220313648.github.io/DFM-VLA/上获取。

英文摘要:

Vision-Language-Action (VLA) models that encode actions using a discrete tokenization scheme have been widely adopted for robotic manipulation, but existing decoding paradigms remain fundamentally limited. Whether actions are decoded sequentially by autoregressive VLAs or in parallel by discrete diffusion VLAs, once a token is generated, it is typically fixed and cannot be revised in subsequent iterations. Consequently, early token errors cannot be effectively corrected later. We propose DFM-VLA, a discrete flow matching VLA that iteratively refines action tokens. DFM-VLA models a token-level probability velocity field that dynamically updates the full action sequence across refinement iterations. We investigate two approaches to constructing the velocity field: an auxiliary velocity-head formulation and an embedding-guided formulation. To further improve prediction accuracy, we introduce a metric-aligned action tokenizer (MAAT) tailored to the coarse-to-fine nature of DFM, together with a two-stage decoding strategy. Extensive experiments on CALVIN, LIBERO, LIBERO-Plus, and real-world manipulation tasks demonstrate the effectiveness of our approach. Our project is available at https://chris1220313648.github.io/DFM-VLA/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑