arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.02205cs.RO
收藏

执行器现实塑造:面向零样本仿真到现实机器人学习

Actuator Reality Shaping for Zero-Shot Sim-to-Real Robot Learning

Graduate School of Informatics, Kyoto University(京都大学信息学研究科);Dept. of Brain Robot Interface, Computational Neuroscience Labs, ATR(脑机器人接口部门,计算神经科学实验室,ATR)

Satoshi Yamamori, Koji Ishihara, Kenjiro Minamikawa, Ryosei Ohmori, Taiyo Yasaki, Norikazu Sugimoto, Jun Morimoto

AI总结:

提出执行器现实塑造范式,通过物理执行器的闭环行为匹配仿真中的理想二阶参考动力学,实现零样本仿真到现实迁移,无需任务级微调或学习执行器模型。

摘要:

机器人学习中的仿真到现实迁移通常受限于策略训练时假设的理想执行器动力学与物理电机的非线性、硬件相关行为之间的差异。传统方法通过系统辨识、域随机化或学习执行器模型来增加仿真保真度以弥合这一差距,而我们引入了一种替代范式:执行器现实塑造。我们的方法不是修改仿真器以匹配现实世界,而是塑造物理执行器的闭环行为以匹配仿真中使用的理想化二阶参考动力学。通过为每个关节配备一个二自由度前馈-反馈控制器,我们将参考响应塑造与鲁棒镇定解耦,从而为强化学习策略提供标准化的执行器接口。因此,仅使用规定的参考模型训练的策略可以在真实硬件上零样本部署,无需任务级微调或学习执行器模型。我们在外部负载下的单关节高减速比伺服系统和7自由度机械臂到达任务上验证了该方法,与标准伺服控制和代表性的真实到仿真到真实基线相比,执行器现实塑造显著减少了仿真到现实跟踪误差并提高了零样本任务性能。我们进一步在轮腿机器人爬坡和双足机器人行走上展示了零样本迁移,表明执行器现实塑造可以作为一种可重用的接口,适用于跨不同硬件平台的机器人学习。

英文摘要:

Sim-to-real transfer in robot learning is often limited by discrepancies between the ideal actuator dynamics assumed during policy training and the nonlinear, hardware-dependent behavior of physical motors. While conventional approaches attempt to bridge this gap by increasing simulator fidelity through system identification, domain randomization, or learned actuator models, we introduce an alternative paradigm: actuator reality shaping. Instead of modifying the simulator to match the real world, our method shapes the closed-loop behavior of physical actuators to match the idealized second-order reference dynamics used in simulation. By equipping each joint with a two-degree-of-freedom feedforward--feedback controller, we decouple reference-response shaping from robust stabilization, thereby providing a standardized actuator interface for reinforcement learning policies. As a result, policies trained only with the prescribed reference model can be deployed zero-shot on real hardware without task-level fine-tuning or learned actuator models. We validate the approach on a single-joint high-gear-ratio servo under external loads and a 7-DOF robotic arm reaching task, where actuator reality shaping substantially reduces sim-to-real tracking error and improves zero-shot task performance compared with standard servo-control and representative real-to-sim-to-real baselines. We further demonstrate zero-shot transfer on a wheeled-legged robot driving over a slope and a humanoid robot walking, suggesting that actuator reality shaping can serve as a reusable interface for robot learning across diverse hardware platforms. Project page: https://syamamori.github.io/ActuatorRealityShaping.github.io/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑