arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2511.09141cs.RO

RGMP: 基于几何先验的多模态策略用于通用人形机器人操作

RGMP: Recurrent Geometric-prior Multimodal Policy for Generalizable Humanoid Robot Manipulation

Xuetao Li, Wenke Huang, Nengyuan Pan, Kaiyan Zhao, Songhua Yang, Yiming Wang, Mengde Li, Mang Ye, Jifeng Xuan, Miao Li

AI总结:

RGMP通过结合几何-语义推理与递归高斯适应,实现了高效的人形机器人多模态操作控制。

摘要:

人形机器人在执行多样化的类人技能方面具有显著潜力。然而,当前研究大多依赖于数据驱动的方法,这些方法需要大量的训练数据集才能实现稳健的多模态决策能力和可推广的视觉-运动控制能力。这些方法由于在未见场景中忽视了几何推理,以及在训练数据中对机器人-目标关系的建模效率低下,导致训练资源浪费严重。为了解决这些限制,我们提出了Recurrent Geometric-prior Multimodal Policy(RGMP),一个端到端的框架,将几何-语义技能推理与数据高效的视觉-运动控制统一起来。在感知能力方面,我们提出了Geometric-prior Skill Selector,该方法将几何归纳偏置注入到视觉语言模型中,生成适应于未见场景的技能序列,仅需最小的空间常识调整。为了实现数据高效的机器人运动合成,我们引入了Adaptive Recursive Gaussian Network,该方法将机器人-物体交互参数化为紧凑的高斯过程层次结构,递归编码多尺度空间关系,即使从稀疏演示中也能生成灵活、数据高效的运动合成。在我们的人形机器人和桌面双臂机器人上进行评估,RGMP框架在泛化测试中实现了87%的任务成功率,并表现出比现有最佳模型高5倍的数据效率。这一性能凸显了其通过几何-语义推理和递归-高斯适应实现的优越跨域泛化能力。

英文摘要:

Humanoid robots exhibit significant potential in executing diverse human-level skills. However, current research predominantly relies on data-driven approaches that necessitate extensive training datasets to achieve robust multimodal decision-making capabilities and generalizable visuomotor control. These methods raise concerns due to the neglect of geometric reasoning in unseen scenarios and the inefficient modeling of robot-target relationships within the training data, resulting in significant waste of training resources. To address these limitations, we present the Recurrent Geometric-prior Multimodal Policy (RGMP), an end-to-end framework that unifies geometric-semantic skill reasoning with data-efficient visuomotor control. For perception capabilities, we propose the Geometric-prior Skill Selector, which infuses geometric inductive biases into a vision language model, producing adaptive skill sequences for unseen scenes with minimal spatial common sense tuning. To achieve data-efficient robotic motion synthesis, we introduce the Adaptive Recursive Gaussian Network, which parameterizes robot-object interactions as a compact hierarchy of Gaussian processes that recursively encode multi-scale spatial relationships, yielding dexterous, data-efficient motion synthesis even from sparse demonstrations. Evaluated on both our humanoid robot and desktop dual-arm robot, the RGMP framework achieves 87% task success in generalization tests and exhibits 5x greater data efficiency than the state-of-the-art model. This performance underscores its superior cross-domain generalization, enabled by geometric-semantic reasoning and recursive-Gaussion adaptation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑