Adaptation to external and internal changes is major for robotic systems in uncertain environments. Here we present a novel multisensory active inference torque controller for industrial arms that shows how prediction can be used to resolve adaptation. Our controller, inspired by the predictive brain hypothesis, improves the capabilities of current active inference approaches by incorporating learning and multimodal integration of low and high-dimensional sensor inputs (e.g., raw images) while simplifying the architecture. We performed a systematic evaluation of our model on a 7DoF Franka Emika Panda robot arm by comparing its behavior with previous active inference baselines and classic controllers, analyzing both qualitatively and quantitatively adaptation capabilities and control accuracy. Results showed improved control accuracy in goal-directed reaching with high noise rejection due to multimodal filtering, and adaptability to dynamical inertial changes, elasticity constraints and human disturbances without the need to relearn the model nor parameter retuning.
CARO: Contact-Agnostic Residual Observation for Zero-Shot Robust Quadruped Locomotion
School of Aeronautic Science and Engineering, Beihang University(北京航空航天大学航空科学与工程学院);School of Automation Science and Electrical Engineering, Beihang University(北京航空航天大学自动化科学与电气工程学院)
Force Myography based Torque Estimation in Human Knee and Ankle Joints
High Performance Humanoid Technologies Lab, Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology (KIT), Germany(高性能人形机器人实验室,人机学与机器人研究所,卡尔斯鲁厄理工学院(KIT));BioMotion Center, Institute of Sports and Sports Sciences, Karlsruhe Institute of Technology (KIT), Germany(生物运动中心,体育与体育科学研究所,卡尔斯鲁厄理工学院(KIT))
Never Too Rigid to Reach: Adaptive Virtual Model Control with LLM- and Lyapunov-Based Reinforcement Learning
Department of Engineering, University of Cambridge(剑桥大学工程系);Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology(麻省理工学院电气工程与计算机科学系);Zhejiang University-University of Illinois Urbana-Champaign Institute, Zhejiang University(浙江大学-伊利诺伊大学厄巴纳-香槟分校联合研究所);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际 Graduate School);Department of Data Science, New Jersey Institute of Technology(新泽西理工学院数据科学系)