方向至关重要:学习力的方向使模拟到现实的接触丰富操作成为可能
TDC: Sim-to-Real Transferable Directional Compliance for Contact-Rich Manipulation
AI总结:
本文提出了一种通过学习力方向来提升模拟到现实接触丰富操作性能的方法,利用专家设计的控制器逻辑和有限状态机,在四个真实任务中实现了更高的成功率和鲁棒性。
摘要:
在接触丰富的操作中,模拟到现实的迁移仍然具有挑战性,因为接触动力学存在固有的差异。尽管现有方法通常依赖于昂贵的真实世界数据或利用盲目的顺应性通过固定控制器,我们提出了一种框架,该框架利用专家设计的控制器逻辑进行迁移。受运动学任务中特权监督成功的影响,我们采用基于位置/力控制器的人工设计有限状态机在模拟中提供特权指导。所得到的策略被训练以预测末端执行器位置、接触状态以及关键的所需接触力方向。与力的大小相比,力的方向编码高层次的任务几何,并在模拟到现实的差距中保持稳健。在部署时,这些预测配置了一个力感知的顺应控制器。通过将策略的方向意图与一个常数、低成本的人工调节力大小相结合,系统生成了适应性强、任务一致的顺应性。这种调节是轻量级的,通常只需每个接触状态一个标量。我们为稳定性和对干扰的鲁棒性提供了理论分析。在四个真实世界任务,即微波炉打开、圆柱体插入、白板擦拭和门打开上进行的实验表明,我们的方法在成功率和鲁棒性方面显著优于强大的基线。视频可在:https://yifei-y.github.io/project-pages/DirectionMatters/上找到。
英文摘要:
Contact-rich manipulation requires robots to regulate both motion and interaction forces, yet achieving adaptive compliance remains a fundamental challenge. Learning from real-world data is costly and risky, while simulation-based approaches struggle with the sim-to-real gap in contact dynamics; existing sim-to-real methods either require real-world adaptation or sacrifice adaptive compliance by relying on isotropic compliant controllers. Our key insight is that force regulation decomposes into a time-varying but simulation-transferable directional component and a dynamics-sensitive but manually tunable magnitude component. We instantiate this directional component as two policy outputs, a task frame and a control mode vector, predicted by a visuomotor policy adapted from a pre-trained VLA model and trained via imitation learning on automatically generated simulation demonstrations. At deployment, an admittance controller integrates these predictions with human-specified stiffness and target wrench values to realize adaptive compliance. Our approach achieves adaptive compliance using only simulation data and can benefit from large-scale VLA pre-training. Extensive real-world experiments on four contact-rich tasks, microwave opening, peg-in-hole insertion, whiteboard wiping, and door opening, demonstrate strong task success rates and robustness to external disturbances. Project page: https://yifei-y.github.io/project-pages/TDC/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。