arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.18950cs.ROcs.CV

λ₀:为类人机器人的移动操作扩展开放世界自我中心人类数据

$λ_0$: Scaling Open-World Egocentric Human Data for Humanoid Loco-Manipulation

Alibaba Group(阿里巴巴集团);Alibaba Token Hub(阿里巴巴令牌中心);Amap(高德地图)

Lambda-humanoid Team

AI总结:

本研究推出HumanVerse数据集,开发λ₀类人机器人基础模型,通过人-类人机器人流水线实现零样本迁移,在SIMPLE任务获90.0%成功率,现实任务达62.5%,为类人机器人移动操作提供可扩展数据方案。

摘要:

类人机器人的移动操作需要与物理世界进行协调的全身交互,但大规模收集机器人演示的成本仍然很高。人类演示提供了一种可扩展的替代方案,但现有的自我中心人类监督通常会忽略运动和姿态,而实体差异和控制器动态会阻碍末端执行器的准确执行。我们推出HumanVerse,这是一个时长500小时的开放世界人类移动操作数据集,将自我中心视频与同步的身体和手部运动配对。我们的人-类人机器人流水线对齐了相机视角和手臂外观,并离线优化了运动参考和控制器输入,以减少末端执行器误差,同时保留全身协调性。我们通过零样本迁移到Unitree G1上的代表性全身操作和远程移动操作任务来验证该流水线,无需目标任务的机器人演示。基于此流水线,我们开发了λ₀,这是一个用于全身移动操作的类人机器人基础模型,其中与机器人对齐的人类演示为训练过程提供监督。增加全身人类数据会持续提升下游任务的进展。λ₀在SIMPLE任务上达到90.0%的成功率,在现实世界移动操作任务上达到62.5%的成功率。我们期望这项研究能指导可扩展的全身人类数据收集,以开发用于与物理世界进行更丰富交互的类人机器人基础模型。

英文摘要:

Humanoid loco-manipulation requires coordinated whole-body interaction with the physical world, yet collecting robot demonstrations at scale remains costly. Human demonstrations offer a scalable alternative, but existing egocentric human supervision often omits locomotion and posture, while embodiment differences and controller dynamics hinder accurate end-effector execution. We introduce HumanVerse, a 500-hour dataset of open-world human loco-manipulation pairing egocentric video with synchronized body and hand motion. Our human-to-humanoid pipeline aligns camera viewpoints and arm appearance, and refines motion references and controller inputs offline to reduce end-effector errors while preserving whole-body coordination. We validate the pipeline through zero-shot transfer to Unitree G1 on representative whole-body manipulation and long-range loco-manipulation tasks, without target-task robot demonstrations. Building on this pipeline, we develop $\lambda_0$, a humanoid foundation model for whole-body loco-manipulation, with robot-aligned human demonstrations providing supervision for mid-training. Increasing whole-body human data consistently improves downstream task progress. $\lambda_0$ achieves 90.0% success on SIMPLE and 62.5% across real-world loco-manipulation tasks. We expect this study to guide scalable whole-body human data collection toward humanoid foundation models for richer interaction with the physical world. Homepage: this https URL

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

相关深度报道

↑