基于强化学习的人形机器人反应式步行：应用于外骨骼Atalante的站立推恢复
Reactive Stepping for Humanoid Robots using Reinforcement Learning: Application to Standing Push Recovery on the Exoskeleton Atalante
摘要：
最先进的强化学习现在能够在模拟中学习双足机器人的多功能运动，平衡和推动恢复能力。然而，现实的差距大多被忽视，模拟结果很难转移到真正的硬件。要么是由于物理学过于简化和忽略了硬件限制而在实践中不成功，要么是规则性得不到保证，可能会发生意外的危险运动。本文提出了一种强化学习框架，能够学习强大的站立推恢复的双足机器人，顺利地转移到现实中，只提供瞬时本体感受的意见。通过结合初始终止条件和策略平滑条件，我们实现了稳定的学习，仿真到现实迁移和安全使用的策略没有记忆，也没有显式的历史。然后，奖励工程被用来提供如何保持平衡的见解。我们展示了它的性能在现实中的下肢医疗外骨骼Atalante。
英文摘要：
State-of-the-art reinforcement learning is now able to learn versatile locomotion, balancing and push-recovery capabilities for bipedal robots in simulation. Yet, the reality gap has mostly been overlooked and the simulated results hardly transfer to real hardware. Either it is unsuccessful in practice because the physics is over-simplified and hardware limitations are ignored, or regularity is not guaranteed, and unexpected hazardous motions can occur. This paper presents a reinforcement learning framework capable of learning robust standing push recovery for bipedal robots that smoothly transfer to reality, providing only instantaneous proprioceptive observations. By combining original termination conditions and policy smoothness conditioning, we achieve stable learning, sim-to-real transfer and safety using a policy without memory nor explicit history. Reward engineering is then used to give insights into how to keep balance. We demonstrate its performance in reality on the lower-limb medical exoskeleton Atalante.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
