arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2611.08577cs.ROcs.CV
收藏

Meituan-Robotics-0:面向桌面操作的视觉-语言-动作基础模型

Meituan-Robotics-0: A Vision-Language-Action Foundation Model for Desktop Manipulation

Meituan Robotics Team(美团机器人团队)
Meituan Robotics Team, Caicheng Wang, Chen Zhao, Chengpeng Jin, Duo Xu, Fengjiao Chen, Guanglu Wan, Heqing Yang, Jia Wang, Jiacong Zhou, Jie Hu, Jiyuan Ru, Ling… 展开作者

Meituan Robotics Team, Caicheng Wang, Chen Zhao, Chengpeng Jin, Duo Xu, Fengjiao Chen, Guanglu Wan, Heqing Yang, Jia Wang, Jiacong Zhou, Jie Hu, Jiyuan Ru, Lingfeng Zhang, Linjiang Huang, Manyuan Zhang, Ningchu Liu, Shijie Zhou, Si Liu, Shuo Li, Tianyi Zhang, Xi Zhang, Xin Chen, Xuezhi Cao, Xunliang Cai, Yanbin Zeng, Yang Yang, Yang Yi, Yanli Tan, Yifu Xu, Yimeng Jia, Yuchen Tang, Yuchen Xie, Yuxiang Zheng, Zerwei Chng, Zilong Huang, Zipeng Ye, Ziyuan Qin, Ziqin Wang

AI总结:

该研究提出MR0视觉-语言-动作基础模型,通过三阶段训练、Rollback方法等技术,在RoboTwin 2.0等基准及真实机器人任务中取得优异性能,支持跨任务操作与恢复。

摘要:

我们提出Meituan-Robotics-0(MR0),这是一款用于固定基座桌面操作的视觉-语言-动作基础模型及具身智能体系统。MR0结合了1.47亿个视觉-语言样本与涵盖12种 embodiment( embodiment 指机器人形态)的15060小时精选机器人轨迹。三阶段训练流程通过离散动作token预训练将多模态表征与机器人行为对齐,通过流匹配中间训练将这些先验迁移至连续跨形态控制,通过真实世界后训练适配策略。我们引入Rollback方法,将替换的策略片段与人类修正配对,为CFG-DAgger提供正负监督,无需价值学习或优势标注。统一的末端执行器接口支持异构形态,而异步动作块合并在可变推理延迟下维持平稳执行。事件驱动智能体维护持久任务事件,并在进展或可行性变化时重新评估计划,支持跨任务检索与条件任务恢复。MR0在RoboTwin 2.0上达到93.6%的成功率,在RoboDojo VLA赛道排名第五。在匹配HG-DAgger后训练下,MR0在三项真实机器人任务中比π₀.₅取得更高的平均成功率与进展分数。在以太网插入任务中,用Rollback数据训练的CFG-DAgger达到70%的成功率与0.90的进展分数。定性智能体部署展示了跨任务事件检索及从暂时不满足的任务条件中恢复的能力。

英文摘要:

We present Meituan-Robotics-0 (MR0), a vision-language-action foundation model and embodied-agent system for stationary-base desktop manipulation. MR0 combines 147 million vision-language samples with 15,060 hours of curated robot trajectories spanning 12 embodiments. A three-stage training recipe aligns multimodal representations with robot behavior through discrete action-token pre-training, transfers these priors to continuous cross-embodiment control through flow-matching mid-training, and adapts the policy through real-world post-training. We introduce Rollback, which pairs replaced policy segments with human corrections to provide positive and negative supervision for CFG-DAgger without value learning or advantage labeling. A unified end-effector interface supports heterogeneous embodiments, while asynchronous action-chunk merging maintains smooth execution under variable inference latency. An event-driven agent maintains persistent task events and reassesses plans when progress or feasibility changes, enabling cross-task retrieval and conditional task resumption. MR0 achieves 93.6% success on RoboTwin 2.0 and ranks fifth in the RoboDojo VLA track. Under matched HG-DAgger post-training, MR0 achieves higher average success rate and progress score than $π_{0.5}$ across three real-robot tasks. On Ethernet insertion, CFG-DAgger trained with Rollback data reaches 70% success and a progress score of 0.90. Qualitative agent deployments demonstrate cross-task event retrieval and recovery from temporarily unsatisfied task conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

相关深度报道

↑