arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.07089cs.ROcs.LGcs.SYeess.SY
收藏

基于深度强化学习的鲁棒四足跳跃

Robust Quadruped Jumping via Deep Reinforcement Learning

Ecole Polytechnique Federale de Lausanne(洛桑联邦理工学院);University of Southern California(南加州大学)

Guillaume Bellegarda, Chuong Nguyen, Quan Nguyen

AI总结:

本文提出一种结合非线性轨迹优化与深度强化学习的四足跳跃框架,通过引入电机转矩-速度关系和功率约束实现仿真到实物零调参部署,在不平坦地形和动力学参数变化下实现距离达2倍体长、抗足端扰动达6 cm的鲁棒跳跃。

摘要:

在本文中,我们考虑四足机器人在噪声环境中(例如在不平坦地形上起跳以及机器人动力学参数变化的情况下)跳跃不同距离和高度的通用任务。为了在此类条件下实现精确跳跃,我们提出了一种使用深度强化学习的框架,该框架利用并增强了四足跳跃非线性轨迹优化的复杂解。虽然单独的优化方法将跳跃限制在平坦地面上起跳,并且需要对机器人动力学做出精确假设,但我们提出的方法提高了鲁棒性,使得机器人能够在显著不平坦的地形上、在机器人动力学参数和环境条件变化的情况下完成跳跃。与行走和跑步相比,在硬件上实现高动态跳跃需要考虑电机的转矩-速度关系以及机器人的总功率限制。通过将这些约束纳入我们的学习框架,我们成功地将策略从仿真部署到实物,无需进一步调参,充分利用了机载电源和电机的可用性能。我们展示了在足端扰动高度达 6 cm(即机器人标称站立高度的 33%)的环境噪声下,跳跃距离达到 2 倍体长的鲁棒性。

英文摘要:

In this paper, we consider a general task of jumping varying distances and heights for a quadrupedal robot in noisy environments, such as off of uneven terrain and with variable robot dynamics parameters. To accurately jump in such conditions, we propose a framework using deep reinforcement learning that leverages and augments the complex solution of nonlinear trajectory optimization for quadrupedal jumping. While the standalone optimization limits jumping to take-off from flat ground and requires accurate assumptions of robot dynamics, our proposed approach improves the robustness to allow jumping off of significantly uneven terrain with variable robot dynamical parameters and environmental conditions. Compared with walking and running, the realization of aggressive jumping on hardware necessitates accounting for the motors' torque-speed relationship as well as the robot's total power limits. By incorporating these constraints into our learning framework, we successfully deploy our policy sim-to-real without further tuning, fully exploiting the available onboard power supply and motors. We demonstrate robustness to environment noise of foot disturbances of up to 6 cm in height, or 33% of the robot's nominal standing height, while jumping 2x the body length in distance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑