Complex robotic systems require whole-body controllers to deal with contact interactions, handle closed kinematic chains, and track task-space control objectives. However, for many applications, safety-critical controllers are important to steer away from undesired robot configurations to prevent unsafe behaviors. A prime example is legged robotics, where we can have tasks such as balance control, regulation of torso orientation, and, most importantly, walking. As the coordination of multi-body systems is non-trivial, following a combination of those tasks might lead to configurations that are deemed dangerous, such as stepping on its support foot during walking, leaning the torso excessively, or producing excessive centroidal momentum, resulting in non-human-like walking. To address these challenges, we propose a formulation of an inverse dynamics control enhanced with exponential control barrier functions for robotic systems with numerous degrees of freedom. Our approach utilizes a quadratic program that respects closed kinematic chains, minimizes the control objectives, and imposes desired constraints on the Zero Moment Point, friction cone, and torque. More importantly, it also ensures the forward invariance of a general user-defined high Relative-Degree safety set. We demonstrate the effectiveness of our method by applying it to the 3D biped robot Digit, both in simulation and with hardware experiments.
Safe Human-to-Humanoid Motion Imitation Using Control Barrier Functions
New York University Abu Dhabi (NYUAD)(纽约大学阿布扎比分校);New York University(纽约大学);NYUAD Center for Artificial Intelligence and Robotics (CAIR)(纽约大学阿布扎比人工智能与机器人中心)
Safety-Critical Whole-Body Control for Humanoid Robots via Input-to-State Safe Control Barrier Functions
Department of Intelligence and Information, Seoul National University(智能信息系,首尔国立大学);Robotics Lab, Hyundai Motor Group(Hyundai Motor Group 机器人实验室);Advanced Institute of Convergence Technology(融合技术高级研究院)
SHIELD: Safety on Humanoids via CBFs In Expectation on Learned Dynamics
Mechanical and Civil Engineering, California Institute of Technology(加州理工学院机械与土木工程系);Aerospace Engineering and Engineering Mechanics, UT Austin(德克萨斯大学奥斯汀分校航空航天工程与工程力学系);Computer Science, Cornell University(康奈尔大学计算机科学系)
ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data
University of Science and Technology of China(中国科学技术大学);Shanghai AI Laboratory(上海人工智能实验室);Northwestern Polytechnical University(西北工业大学);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);TeleAI, China Telecom(TeleAI,中国电信)
A Whole-Body Motion Imitation Framework from Human Data for Full-Size Humanoid Robot
The State Key Laboratory of Industrial Control and Technology of Zhejiang University(浙江大学工业控制技术状态重点实验室);Zhejiang Humanoid Robot Innovation Center(浙江人形机器人创新中心);Department of Engineering Mechanics of Zhejiang University(浙江大学工程力学系)
SMAP: Self-supervised Motion Adaptation for Physically Plausible Humanoid Whole-body Control
School of Computer Science, Wuhan University(武汉大学计算机学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));The Chinese University of Hong Kong(香港中文大学);Fudan University(复旦大学);National University of Singapore(新加坡国立大学)
PhysiFlow: Physics-Aware Humanoid Whole-Body VLA via Multi-Brain Latent Flow Matching and Robust Tracking
department of Automation Engineering, Shanghai Jiao Tong University(自动化工程系,上海交通大学);Department of Automation, Key Laboratory of System Control and Information Processing of Ministry of Education, Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education, Shanghai Engineering Research Center of Intelligent Control and Management, Shanghai Jiao Tong University(自动化系,教育部系统控制与信息处理重点实验室,教育部海洋智能设备与系统重点实验室,智能控制与管理上海工程研究中心,上海交通大学)
Rhythm: Learning Interactive Whole-Body Control for Dual Humanoids
Fudan University(复旦大学);TARS Robotics(TARS机器人);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);Shanghai Innovation Institute(上海创新研究院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
TACT: Humanoid Whole-body Contact Manipulation through Deep Imitation Learning with Tactile Modality
CNRS-AIST JRL (Joint Robotics Laboratory), IRL and National Institute of Advanced Industrial Science and Technology (AIST)(CNRS-AIST联合机器人实验室、IRL和国家先进工业科学与技术研究院);Tokyo University of Science(东京科学大学);University of Tsukuba(茨口大学)
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing University of Technology(北京工业大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Shenzhen MSU-BIT University(深圳北理莫斯科大学);JD Explore Academy(京东探索研究院)
TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model
University of California, Berkeley(加州大学伯克利分校);Peking University(北京大学);Tsinghua University(清华大学);The University of Hong Kong(香港大学);Princeton University(普林斯顿大学)