arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2508.13998cs.ROcs.AIcs.LG

Embodied-R1:强化的具身推理用于通用机器人操作

Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation

College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)

Yifu Yuan, Haiqin Cui, Yaoting Huang, Yibin Chen, Fei Ni, Zibin Dong, Pengyi Li, Yan Zheng, Hongyao Tang, Jianye Hao

AI总结:

本文提出Embodied-R1,通过引入指向作为统一的中间表示,结合强化微调方法,实现通用机器人操作中的具身推理,展示了在多个基准测试中的卓越性能和零样本泛化能力。

摘要:

在具身AI中,泛化能力受制于“感知-行动鸿沟”,这源于数据稀缺和具身异质性。为了解决这一问题,我们开创性地引入“指向”作为统一的、与具身无关的中间表示,定义了四种核心具身指向能力,连接高级视觉语言理解与低级动作原语。我们引入了专门设计用于具身推理和指向的3B视觉语言模型(VLM)Embodied-R1。我们使用各种具身和通用视觉推理数据集构建大规模数据集Embodied-Points-200K,以支持关键的具身指向能力。然后,我们使用双阶段强化微调(RFT)课程训练方法,结合专门的多任务奖励设计来训练Embodied-R1。Embodied-R1在11个具身空间和指向基准测试中实现了最先进的性能。关键的是,它通过在SIMPLEREnv中达到56.2%的成功率,在8个现实世界XArm任务中达到87.5%的成功率,无需任何任务特定的微调,比强基线提高了62%。此外,该模型在多样化的视觉干扰下表现出高度的鲁棒性。我们的工作表明,以指向为中心的表示结合RFT训练范式,为闭合机器人中的感知-行动鸿沟提供了一条有效且可泛化的路径。

英文摘要:

Generalization in embodied AI is hindered by the "seeing-to-doing gap," which stems from data scarcity and embodiment heterogeneity. To address this, we pioneer "pointing" as a unified, embodiment-agnostic intermediate representation, defining four core embodied pointing abilities that bridge high-level vision-language comprehension with low-level action primitives. We introduce Embodied-R1, a 3B Vision-Language Model (VLM) specifically designed for embodied reasoning and pointing. We use a wide range of embodied and general visual reasoning datasets as sources to construct a large-scale dataset, Embodied-Points-200K, which supports key embodied pointing capabilities. We then train Embodied-R1 using a two-stage Reinforced Fine-tuning (RFT) curriculum with a specialized multi-task reward design. Embodied-R1 achieves state-of-the-art performance on 11 embodied spatial and pointing benchmarks. Critically, it demonstrates robust zero-shot generalization by achieving a 56.2% success rate in the SIMPLEREnv and 87.5% across 8 real-world XArm tasks without any task-specific fine-tuning, representing a 62% improvement over strong baselines. Furthermore, the model exhibits high robustness against diverse visual disturbances. Our work shows that a pointing-centric representation, combined with an RFT training paradigm, offers an effective and generalizable pathway to closing the perception-action gap in robotics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑