机器人炒菜:半流体物体的双手非接触操作
Robot Cooking with Stir-fry: Bimanual Non-prehensile Manipulation of Semi-fluid Objects
摘要:
本文介绍了一种在双手机器人系统上实现中国著名烹饪艺术炒菜的方法。炒菜需要一系列高度动态的协调动作,厨师通常很难学会,更不用说转移到机器人身上了。在这封信中,我们定义了一个典型的炒运动,然后提出了一个解耦的框架,从人类示范学习这种可变形的对象操作。首先将机器人双臂解耦为不同的角色(领导者和跟随者),分别用经典方法和基于神经网络的方法学习,然后将双手任务转化为协调问题。为了获得一般的双手协调,我们其次提出了一个基于图和Transformer的模型--结构化-Transformer,以捕捉双臂运动之间的时空关系。最后,通过添加内容变形的视觉反馈,我们的框架可以自动调整动作,以达到预期的炒效果。我们验证了一个模拟器的框架,并部署在一个真正的双手熊猫机器人系统。实验结果验证了该框架能够实现双手机器人的炒菜运动,并具有推广到其他双手协调的可变形物体的潜力。
英文摘要:
This letter describes an approach to achieve well-known Chinese cooking art stir-fry on a bimanual robot system. Stir-fry requires a sequence of highly dynamic coordinated movements, which is usually difficult to learn for a chef, let alone transfer to robots. In this letter, we define a canonical stir-fry movement, and then propose a decoupled framework for learning this deformable object manipulation from human demonstration. First, the dual arms of the robot are decoupled into different roles (a leader and follower) and learned with classical and neural network-based methods separately, then the bimanual task is transformed into a coordination problem. To obtain general bimanual coordination, we secondly propose a Graph and Transformer based model -- Structured-Transformer, to capture the spatio-temporal relationship between dual-arm movements. Finally, by adding visual feedback of content deformation, our framework can adjust the movements automatically to achieve the desired stir-fry effect. We verify the framework by a simulator and deploy it on a real bimanual Panda robot system. The experimental results validate our framework can realize the bimanual robot stir-fry motion and have the potential to extend to other deformable objects with bimanual coordination.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。