arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.04819cs.NEcs.AIcs.LGcs.RO
收藏

通过发现多样化的环境轨迹生成器先验高效学习运动技能

Efficient Learning of Locomotion Skills through the Discovery of Diverse Environmental Trajectory Generator Priors

Imperial College London(伦敦帝国理工学院)

Shikha Surana, Bryan Lim, Antoine Cully

AI总结:

本文提出EETG方法,利用质量-多样性算法学习多样化运动先验,在PMTG架构中保持单一策略,使四足机器人高效穿越多种地形,比单一先验效率提升5倍。

摘要:

基于数据驱动的学习方法近来在针对各种非结构化地形的鲁棒运动控制器学习中尤为成功。先前的工作表明,以轨迹生成器(TGs)形式融入良好的运动先验对于高效学习复杂运动技能是有效的。然而,随着任务/环境变得越来越复杂,定义一个良好的单一TG仍然是一个具有挑战性的问题,因为它需要大量的调参,并可能降低先验的有效性。在本文中,我们提出了进化环境轨迹生成器(EETG),一种使用质量-多样性算法学习一组多样化的专门运动先验的方法,同时保持Policies Modulating TG(PMTG)架构中的单一策略。结果表明,EETG使四足机器人能够成功穿越各种环境,如斜坡、楼梯、崎岖地形和平衡木。我们的实验表明,在处理广泛的环境时,学习一组多样化的专门TG先验比使用单一固定先验显著更高效(5倍)。

英文摘要:

Data-driven learning based methods have recently been particularly successful at learning robust locomotion controllers for a variety of unstructured terrains. Prior work has shown that incorporating good locomotion priors in the form of trajectory generators (TGs) is effective at efficiently learning complex locomotion skills. However, defining a good, single TG as tasks/environments become increasingly more complex remains a challenging problem as it requires extensive tuning and risks reducing the effectiveness of the prior. In this paper, we present Evolved Environmental Trajectory Generators (EETG), a method that learns a diverse set of specialised locomotion priors using Quality-Diversity algorithms while maintaining a single policy within the Policies Modulating TG (PMTG) architecture. The results demonstrate that EETG enables a quadruped robot to successfully traverse a wide range of environments, such as slopes, stairs, rough terrain, and balance beams. Our experiments show that learning a diverse set of specialized TG priors is significantly (5 times) more efficient than using a single, fixed prior when dealing with a wide range of environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑