arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.14534cs.ROcs.LGstat.ML
收藏

从人形机器人的推回学习看全身策略的产生

On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learning

Istituto Italiano di Tecnologia(意大利理工学院);University of Manchester(曼彻斯特大学);Massachusetts Institute of Technology(麻省理工学院);Sapienza Università di Roma(罗马第一大学);Università degli Studi di Genova(热那亚大学)

Diego Ferigo, Raffaello Camoriano, Paolo Maria Viceconte, Daniele Calandriello, Silvio Traversaro, Lorenzo Rosasco, Daniele Pucci

摘要:

平衡和推动恢复是使人形机器人能够解决复杂运动任务的基本能力。在这种情况下,经典的控制系统往往是基于简化的物理模型和硬编码的策略。虽然在特定情况下是成功的,但这种方法需要在专门设计的控制器之间对参数和切换逻辑进行苛刻的调整,以处理更一般的扰动。我们应用无模型深度强化学习在模拟环境中训练一个通用和强大的人形推恢复策略。我们的方法针对高维全身人形控制,并验证了iCub人形。奖励组件结合专家知识的人形控制,使快速学习几个强大的行为相同的政策,跨越整个身体。我们验证了我们的方法与广泛的定量分析模拟,包括样本外的任务,表现出政策的鲁棒性和泛化,对现实世界的机器人部署的关键要求。

英文摘要:

Balancing and push-recovery are essential capabilities enabling humanoid robots to solve complex locomotion tasks. In this context, classical control systems tend to be based on simplified physical models and hard-coded strategies. Although successful in specific scenarios, this approach requires demanding tuning of parameters and switching logic between specifically-designed controllers for handling more general perturbations. We apply model-free Deep Reinforcement Learning for training a general and robust humanoid push-recovery policy in a simulation environment. Our method targets high-dimensional whole-body humanoid control and is validated on the iCub humanoid. Reward components incorporating expert knowledge on humanoid control enable fast learning of several robust behaviors by the same policy, spanning the entire body. We validate our method with extensive quantitative analyses in simulation, including out-of-sample tasks which demonstrate policy robustness and generalization, both key requirements towards real-world robot deployment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑