Actuator Reality Shaping for Zero-Shot Sim-to-Real Robot Learning
Graduate School of Informatics, Kyoto University(京都大学信息学研究科);Dept. of Brain Robot Interface, Computational Neuroscience Labs, ATR(脑机器人接口部门,计算神经科学实验室,ATR)
Satoshi Yamamori, Koji Ishihara, Kenjiro Minamikawa, Ryosei Ohmori, Taiyo Yasaki, Norikazu Sugimoto, Jun Morimoto
Sim-to-real transfer in robot learning is often limited by discrepancies between the ideal actuator dynamics assumed during policy training and the nonlinear, hardware-dependent behavior of physical motors. While conventional approaches attempt to bridge this gap by increasing simulator fidelity through system identification, domain randomization, or learned actuator models, we introduce an alternative paradigm: actuator reality shaping. Instead of modifying the simulator to match the real world, our method shapes the closed-loop behavior of physical actuators to match the idealized second-order reference dynamics used in simulation. By equipping each joint with a two-degree-of-freedom feedforward--feedback controller, we decouple reference-response shaping from robust stabilization, thereby providing a standardized actuator interface for reinforcement learning policies. As a result, policies trained only with the prescribed reference model can be deployed zero-shot on real hardware without task-level fine-tuning or learned actuator models. We validate the approach on a single-joint high-gear-ratio servo under external loads and a 7-DOF robotic arm reaching task, where actuator reality shaping substantially reduces sim-to-real tracking error and improves zero-shot task performance compared with standard servo-control and representative real-to-sim-to-real baselines. We further demonstrate zero-shot transfer on a wheeled-legged robot driving over a slope and a humanoid robot walking, suggesting that actuator reality shaping can serve as a reusable interface for robot learning across diverse hardware platforms. Project page: https://syamamori.github.io/ActuatorRealityShaping.github.io/
Sensor-Space Based Robust Kinematic Control of Redundant Soft Manipulator by Learning
Department of Mechanical and Aerospace Engineering, The University of Manchester, Manchester, United Kingdom(机械与航空航天工程系,曼彻斯特大学,英国曼彻斯特);Department of Electrical and Electronic Engineering, The University of Manchester, Manchester, United Kingdom(电气与电子工程系,曼彻斯特大学,英国曼彻斯特)
Cutting Sequence Diffuser: Sim-to-Real Transferable Planning for Object Shaping by Grinding
Graduate School of Information Science, Nara Institute of Science and Technology (NAIST), Nara, Japan(信息科学研究生院,科学技术研究院(NAIST),奈良,日本);Department of Systems Science, Graduate School of Informatics, Kyoto University(信息系统学部,京都大学);Brain Information Communication Research Laboratory Group (BICR), Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan(脑信息通信研究实验室组(BICR),国际电信研究中心(ATR),京都,日本)
Sim-to-real transfer of active suspension control using deep reinforcement learning
Umeå University(于默奥大学);Algoryx Simulation AB(Algoryx仿真公司);Skogforsk (the Forestry Research Institute of Sweden)(瑞典林业研究院(Skogforsk));Karlstad University(卡尔斯塔德大学)