arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.08548cs.RO
收藏

OASIS:从仿真数据收集到真实世界人形机器人移动操作

OASIS: From Simulation Data Collection to Real-World Humanoid Loco-Manipulation

Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));Fudan University(复旦大学);East China University of Science and Technology(华东理工大学);Shanghai Jiao Tong University(上海交通大学)

Zehao Yu, Jiakun Zheng, Weiji Xie, Jiyuan Shi, Chenyun Zhang, Chenjia Bai, Xuelong Li

AI总结:

提出OASIS框架,利用3D生成模型从真实图像重建物体资产,在仿真中收集并增强轨迹数据,训练层次化视觉运动策略,实现零样本部署下人形机器人移动操作,成功率优于真实遥操作数据。

摘要:

近年来,机器人操作领域的进展主要得益于大规模演示学习。然而,对于人形机器人移动操作任务,现有数据源在轨迹质量和可扩展性之间做出了令人不满意的权衡。真实世界遥操作能提供最高质量的轨迹,但需要专用的物理空间和耗时的场景重置。仿真提供了摆脱这一困境的替代方案:无需任何物理硬件即可大规模生成干净、符合本体形态的数据。在本文中,我们提出了OASIS,一个基于仿真数据的人形机器人移动操作框架。OASIS利用3D生成模型从真实世界图像自动重建逼真的物体资产。基于这些资产,首先在仿真中通过遥操作收集轨迹,然后在后处理阶段在多样化的领域随机化下进行增强。利用得到的仿真数据,我们进一步设计了一种用于人形机器人移动操作的层次化视觉运动策略。在真实人形机器人上的大量实验表明,在零样本部署下,基于我们的仿真数据训练的策略在大多数任务上实现了比基于真实机器人遥操作数据训练的策略更高的成功率,这主要归功于我们的仿真渲染覆盖了广泛的照明和环境变化,而真实机器人数据无法捕捉这些变化。项目页面见https://oasis-humanoid.github.io/。

英文摘要:

Recent progress in robot manipulation has been largely driven by learning from large-scale demonstrations. For humanoid robot loco-manipulation tasks, however, existing data sources force an unsatisfying tradeoff between trajectory quality and scalability. Real-world teleoperation provides the highest-quality trajectories but requires dedicated physical space and time-consuming scene resets. Simulation offers an alternative way out of this dilemma: it can produce clean, embodiment-aligned data at scale without any physical hardware. In this paper, we propose OASIS, a simulation-data-driven framework for humanoid loco-manipulation. OASIS automatically reconstructs realistic object assets from real-world images using a 3D generative model. Based on these assets, trajectories are first collected through teleoperation in simulation, and then augmented under diverse domain randomizations in a post-processing stage. With the resulting simulation data, we further design a hierarchical visuomotor policy for humanoid loco-manipulation. Extensive experiments on the real humanoid robot show that, under zero-shot deployment, the policy trained on our simulation data achieves higher success rates on most tasks than that trained on real-robot teleoperation data, owing largely to the broad lighting and environmental variations covered by our simulation rendering, which real-robot data fails to capture. The project page is available at https://oasis-humanoid.github.io/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑