arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.16611cs.RO
收藏

利用深度强化学习实现人形机器人稳定的高速运动

Achieving Stable High-Speed Locomotion for Humanoid Robots with Deep Reinforcement Learning

School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);Ningbo Institute of Digital Twin, Eastern Institute of Technology(浙大宁波理工学院宁波数字孪生研究院)

Xinming Zhang, Xianghui Wang, Lerong Zhang, Guodong Guo, Xiaoyu Shen, Wei Zhang

AI总结:

本文提出结合深度强化学习与运动动力学先验的 KSLC 方法,通过协调手臂运动提升人形机器人高速运动稳定性,在仿真中实现 3.5 m/s 速度跟踪并验证了泛化能力。

摘要:

人形机器人在执行各种任务时具有显著的通用性,但其基本的行走和奔跑能力,尤其是在高速运动时,仍然是一个挑战。本文提出了一种新方法,将深度强化学习与运动动力学先验相结合,以实现稳定的运动控制(KSLC)。KSLC 促进协调的手臂运动来抵消不稳定的力,从而增强整体稳定性。与基线方法相比,KSLC 能够更准确地跟踪指令速度,并在速度控制方面具有更好的泛化能力。在仿真测试中,启用 KSLC 的人形机器人成功跟踪了 3.5 m/s 的目标速度,且波动减小。在高保真环境中的仿真到仿真验证进一步证实了其稳健的性能,凸显了其在实际应用中的潜力。

英文摘要:

Humanoid robots offer significant versatility for performing a wide range of tasks, yet their basic ability to walk and run, especially at high velocities, remains a challenge. This letter presents a novel method that combines deep reinforcement learning with kinodynamic priors to achieve stable locomotion control (KSLC). KSLC promotes coordinated arm movements to counteract destabilizing forces, enhancing overall stability. Compared to the baseline method, KSLC provides more accurate tracking of commanded velocities and better generalization in velocity control. In simulation tests, the KSLC-enabled humanoid robot successfully tracked a target velocity of 3.5 m/s with reduced fluctuations. Sim-to-sim validation in a high-fidelity environment further confirmed its robust performance, highlighting its potential for real-world applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑