EFGCL:通过受启发于体操的外部力引导课程学习学习动态运动
EFGCL: Learning Dynamic Motion through Spotting-Inspired External Force Guided Curriculum Learning
AI总结:
本文提出EFGCL,一种基于物理指导原理的强化学习方法,通过引入外部辅助力加速四足机器人学习跳跃等动态全身运动,克服传统RL方法的不足。
摘要:
通过强化学习(RL)学习四足机器人动态全身运动仍具挑战性,因高风险导致探索效率低且学习不稳定。本文提出外部力引导课程学习(EFGCL),一种基于物理指导原理的RL方法,在训练中引入外部辅助力。受艺术体操启发,EFGCL使智能体无需依赖任务特定奖励塑造或参考轨迹即可经历成功运动执行。在四足机器人完成跳跃、后翻和侧翻任务的实验中,EFGCL将跳跃任务学习速度提高约两倍,并使传统RL方法无法学习的复杂全身运动得以获取。进一步显示,所学策略可部署于真实机器人,再现与仿真中一致的运动。这些结果表明,物理引导探索,允许智能体在训练早期体验成功,是提高动态全身运动任务学习效率的有效通用策略。
英文摘要:
Learning dynamic whole-body motions for legged robots through reinforcement learning (RL) remains challenging due to the high risk of failure, which makes efficient exploration difficult and often leads to unstable learning. In this paper, we propose External Force Guided Curriculum Learning (EFGCL), a guided RL approach based on the principle of physical guidance, in which external assistive forces are introduced during training. Inspired by spotting in artistic gymnastics, EFGCL enables agents to physically experience successful motion executions without relying on task-specific reward shaping or reference trajectories. Experiments on a quadrupedal robot performing Jump, Backflip, and Lateral-Flip tasks demonstrate that EFGCL accelerates learning of the Jump task by approximately a factor of two and enables the acquisition of complex whole body motions that conventional RL methods fail to learn. We further show that the learned policies can be deployed on real robot, reproducing motions consistent with those observed in simulation. These results indicate that physically guided exploration, which allows agents to experience success early in training, is an effective and general strategy for improving learning efficiency in dynamic whole-body motion tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。