arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2502.20382cs.ROcs.AIcs.LGcs.SYeess.SY

通过轨迹优化实现接触密集操作的物理驱动数据生成

Physics-Driven Data Generation for Contact-Rich Manipulation via Trajectory Optimization

Computer Science and Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology(计算机科学与人工智能实验室(CSAIL),麻省理工学院);Robotics and AI Institute(机器人与人工智能研究院)

Lujie Yang, H. J. Terry Suh, Tong Zhao, Bernhard Paus Graesdal, Tarik Kelestemur, Jiuguang Wang, Tao Pang, Russ Tedrake

AI总结:

本研究提出了一种结合物理仿真和轨迹优化的方法,通过生成多样化高质量数据集,提升接触密集操作任务的机器人性能。

摘要:

我们提出了一种低成本的数据生成管道,该管道集成了基于物理的仿真、人类示范和基于模型的规划,以高效地生成大规模、高质量的数据集,用于接触密集的机器人操作任务。从虚拟现实仿真环境中收集的少量具有灵活性的肢体示范开始,该管道通过基于优化的运动学重定向和轨迹优化来细化这些示范,以适应各种机器人肢体和物理参数。这一过程产生了一个多样且物理上一致的数据集,能够实现跨肢体数据转移,并有可能重用在不同硬件配置或物理参数下收集的遗留数据集。我们通过训练扩散策略来验证该管道的有效性,这些策略从生成的数据集中训练,用于挑战性的接触密集操作任务,涉及多种机器人肢体,包括漂浮的Allegro手和双臂机器人臂。训练好的策略在硬件上零样本部署于双臂iiwa臂上,实现了高成功率,且需要极少的人工干预。项目网站:https://lujieyang.github.io/physicsgen/。

英文摘要:

We present a low-cost data generation pipeline that integrates physics-based simulation, human demonstrations, and model-based planning to efficiently generate large-scale, high-quality datasets for contact-rich robotic manipulation tasks. Starting with a small number of embodiment-flexible human demonstrations collected in a virtual reality simulation environment, the pipeline refines these demonstrations using optimization-based kinematic retargeting and trajectory optimization to adapt them across various robot embodiments and physical parameters. This process yields a diverse, physically consistent dataset that enables cross-embodiment data transfer, and offers the potential to reuse legacy datasets collected under different hardware configurations or physical parameters. We validate the pipeline's effectiveness by training diffusion policies from the generated datasets for challenging contact-rich manipulation tasks across multiple robot embodiments, including a floating Allegro hand and bimanual robot arms. The trained policies are deployed zero-shot on hardware for bimanual iiwa arms, achieving high success rates with minimal human input. Project website: https://lujieyang.github.io/physicsgen/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑