asRoBallet:通过摩擦感知强化学习闭合仿真到现实的差距
asRoBallet: Closing the Sim2Real Gap via Friction-Aware Reinforcement Learning for Underactuated Spherical Dynamics
AI总结:
本文提出asRoBallet,首个端到端强化学习策略应用于人形球形动力学硬件平台,通过高保真模拟和摩擦感知强化学习实现零样本仿真到现实迁移。
摘要:
我们介绍了asRoBallet,据我们所知,这是首个端到端强化学习(RL)运动策略部署在人形球形动力学硬件平台上。历史上,球形机器人已成为欠驱动和非完整控制的典型基准,其特征是轮-球-地板相互作用的复杂摩擦模型存在现实差距。尽管当前文献展示了通过LQR和MPC成功处理3D平衡,但将RL应用于人形球形机器人实际硬件时,接触建模、执行器延迟与抖动以及安全硬件探索存在关键差距。本研究提出了一种高保真度的MuJoCo模拟,明确建模ETH型全向轮的离散滚动机制,从而捕捉到之前被忽视的寄生振动和接触不连续性。我们还开发了摩擦感知强化学习框架,通过掌握轮-球和球-地板接口的耦合滚动、横向和扭转摩擦通道,实现零样本仿真到现实迁移。我们通过减法重构,重新利用四足机器人中的关键组件,并将其整合到新设计的结构框架中,以实现低成本的稳健研究平台。我们还开发了通用的iOS生态系统,将消费电子产品转化为低延迟接口,使单个操作员能够通过直观的自然运动指挥表达性的人形动作。
英文摘要:
We introduce asRoBallet, to the best of our knowledge, the first end-to-end reinforcement learning (RL) locomotion policy deployed on a humanoid ballbot hardware platform. Historically, ballbots have served as a canonical benchmark for underactuated and nonholonomic control, which are characterized by a reality gap in complex friction models for wheel-ball-floor interactions. While current literature demonstrates successful handling of 3D balancing with LQR and MPC, transitioning to actual hardware for a humanoid ballbot using RL is currently hindered by critical gaps in contact modeling, actuator latency & jitter, and safe hardware exploration. This study proposes a high-fidelity MuJoCo simulation that explicitly models the discrete roller mechanics of ETH-type omni-wheels, thereby capturing parasitic vibrations and contact discontinuities that have previously been ignored. We also developed a Friction-Aware Reinforcement Learning framework that achieves zero-shot Sim2Real transfer by mastering the coupled rolling, lateral, and torsional friction channels at the wheel-ball and ball-floor interfaces. We designed asRoBallet through subtractive reconfiguration, repurposing key components from an overconstrained quadruped and integrating them into a newly designed structural frame to achieve a robust research platform at low cost. We also developed a generalized iOS ecosystem that transforms consumer electronics into a low-latency interface, enabling a single operator to orchestrate expressive humanoid maneuvers via intuitive natural motion.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。