基于足部IMU的齿轮驱动人形机器人双足运动学习
Learning Bipedal Locomotion on Gear-Driven Humanoid Robot Using Foot-Mounted IMUs
AI总结:
本文提出一种基于足部IMU的强化学习框架,结合对称数据增强和随机网络蒸馏,在无扭矩传感器的高减速比人形机器人上实现了复杂地形下的快速稳定双足运动,并通过EVAL-03硬件实验验证了其在非刚性表面和突发环境变化下的有效性。
摘要:
针对高减速比执行器的人形机器人,由于执行器动力学复杂且缺乏扭矩传感器,从仿真到现实的强化学习(RL)仍具挑战性。为此,我们提出一种利用足部惯性测量单元(IMU)的新型RL框架。我们不追求详细的执行器建模和系统辨识,而是利用足部IMU测量来增强在复杂地形上的快速稳定能力。此外,我们提出了针对所设计观测空间的对称数据增强方法,以及随机网络蒸馏方法,以增强在崎岖地形上的双足运动学习。我们通过微型人形机器人EVAL-03在多种环境中的硬件实验验证了该方法。实验结果表明,我们的方法提高了在非刚性表面和突发环境变化下的快速稳定能力。
英文摘要:
Sim-to-real reinforcement learning (RL) for humanoid robots with high-gear ratio actuators remains challenging due to complex actuator dynamics and the absence of torque sensors. To address this, we propose a novel RL framework leveraging foot-mounted inertial measurement units (IMUs). Instead of pursuing detailed actuator modeling and system identification, we utilize foot-mounted IMU measurements to enhance rapid stabilization capabilities over challenging terrains. Additionally, we propose symmetric data augmentation dedicated to the proposed observation space and random network distillation to enhance bipedal locomotion learning over rough terrain. We validate our approach through hardware experiments on a miniature-sized humanoid EVAL-03 over a variety of environments. The experimental results demonstrate that our method improves rapid stabilization capabilities over non-rigid surfaces and sudden environmental transitions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。