arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.16337cs.RO
收藏

用于四足跳跃的基于课程的强化学习:一种无参考设计

Curriculum-Based Reinforcement Learning for Quadrupedal Jumping: A Reference-free Design

Delft University of Technology(代尔夫特理工大学);Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(德国航空航天中心机器人与机电一体化研究所)

Vassil Atanassov, Jiatao Ding, Jens Kober, Ioannis Havoutis, Cosimo Della Santina

AI总结:

提出一种无参考轨迹的课程式DRL框架,使四足机器人由原地跳逐步学习全向跳和越障,真实实验实现90厘米前跳并能在未训练的软草地连续跳跃。

摘要:

深度强化学习(DRL)已成为掌握爆发性且多样化四足跳跃技能的一种有前景的解决方案。然而,当前基于DRL的框架通常依赖于通过捕捉动物运动或从现有控制器迁移经验而获得的预先存在的参考轨迹。本工作旨在证明,通过利用课程设计,在不依赖模仿参考轨迹的情况下学习动态跳跃是可能的。从垂直原地跳开始,我们将学到的策略泛化到向前跳和斜向跳,最后学习跨越障碍物。在以期望着陆位置、朝向和障碍物尺寸为条件的情况下,所提出的方法在真实世界实验中产生了广泛的全向跳跃运动。特别是,我们实现了90厘米的向前跳跃,超过了现有文献中报告的类似机器人的所有先前纪录。此外,机器人能够在柔软的草地上可靠地执行连续跳跃,这一点尤其引人注目,因为此类条件并未包含在训练阶段中。补充视频可在https://www.youtube.com/watch?v=nRaMCrwU5X8找到。与本工作相关的代码可在https://github.com/Vassil17/Curriculum-Quadruped-Jumping-DRL找到。

英文摘要:

Deep reinforcement learning (DRL) has emerged as a promising solution to mastering explosive and versatile quadrupedal jumping skills. However, current DRL-based frameworks usually rely on pre-existing reference trajectories obtained by capturing animal motions or transferring experience from existing controllers. This work aims to prove that learning dynamic jumping is possible without relying on imitating a reference trajectory by leveraging a curriculum design. Starting from a vertical in-place jump, we generalize the learned policy to forward and diagonal jumps and, finally, we learn to jump across obstacles. Conditioned on the desired landing location, orientation, and obstacle dimensions, the proposed approach yields a wide range of omnidirectional jumping motions in real-world experiments. Particularly we achieve a 90cm forward jump, exceeding all previous records for similar robots reported in the existing literature. Additionally, the robot can reliably execute continuous jumping on soft grassy grounds, which is especially remarkable as such conditions were not included in the training stage. A supplementary video can be found on: https://www.youtube.com/watch?v=nRaMCrwU5X8. The code associated with this work can be found on: https://github.com/Vassil17/Curriculum-Quadruped-Jumping-DRL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑