Many everyday tasks require controlling contact force as well as motion. On a humanoid, this force must often be coordinated across both hands and the whole body, and cannot be specified by kinematic trajectories alone. Therefore, we present FLORE, a framework for learning force-reactive humanoid loco-manipulation. We collect robot-free demonstrations using two force-sensing UMI-style handheld grippers for hand motion and contact wrenches, and wearable trackers for body motion. A force-reactive diffusion policy takes vision, proprioception, and measured wrenches as input, then predicts actions and per-hand force commands. A hybrid compliance whole-body controller with force tracking executes these commands while maintaining balance: an integral of the force error measured by real force/torque (F/T) sensors lets each hand track force accurately along the commanded direction and remain compliant along the others. In simulation, the controller tracks per-hand force commands of varied magnitude and direction, with little loss in whole-body motion accuracy. Across three contact-rich tasks on the robot, the force-reactive policy succeeds in 80% of rollouts, compared with 26.7% for a position-only policy trained on the same demonstrations and executed by the same controller. For more details, please visit our website: https://louis-leee.github.io/FLoRe/.
Humanoid Agent via Embodied Chain-of-Action Reasoning with Multimodal Foundation Models for Zero-Shot Loco-Manipulation
Embodied AI and Robotics (AIR) Lab, New York University, New York, USA and NYUAD Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, UAE(纽约大学Embodied AI和机器人实验室及纽约大学阿布扎赫尔人工智能与机器人中心);Harvard AI and Robotics Lab, Harvard University, Boston, USA(哈佛大学人工智能与机器人实验室);Department of Computer Science, University College London, London, UK(伦敦大学学院计算机科学系);Department of Computer Science, University of Liverpool, UK(利物浦大学计算机科学系);NYUAD Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Abu Dhabi, UAE(纽约大学阿布扎赫尔人工智能与机器人中心)
HWC-Loco: A Hierarchical Whole-Body Control Approach to Robust Humanoid Locomotion
The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Harbin Institute of Technology(哈尔滨工业大学);DexForce Technology(DexForce科技);Southeast University(东南大学)
StyleLoco: Generative Adversarial Distillation for Natural Humanoid Robot Locomotion
National Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI);School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);Huazhong University of Science and Technology(华中科技大学)
Humanoid Loco-manipulation Planning based on Graph Search and Reachability Maps
CNRS-AIST JRL (Joint Robotics Laboratory)(CNRS-AIST联合机器人实验室);IRL(机器人研究所);National Institute of Advanced Industrial Science and Technology (AIST)(国家先进工业科学与技术研究院)
FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));University of Science and Technology Beijing(北京科技大学);Nanyang Technological University(南洋理工大学)
State Estimation for Human Motion and Humanoid Locomotion
Istituto Italiano di Tecnologia(意大利理工学院);IRI CSIC-UPC(西班牙国家研究委员会-加泰罗尼亚理工大学机器人研究所);AIST(日本产业技术综合研究所);LAAS-CNRS(法国国家科学研究中心系统分析与架构实验室);DIBRIS-UNIGE(热那亚大学计算机、生物工程、机器人与系统工程系)
GM-Loco: Terrain-Adaptive Humanoid Locomotion on Granular Media
Institute for Robotics and Intelligent Machines, Georgia Institute of Technology(佐治亚理工学院机器人与智能机器研究所);School of Physics, Georgia Institute of Technology(佐治亚理工学院物理学院);Northeastern University(东北大学)
UniReLo: Learning a Unified Humanoid Policy from Fall Recovery to Locomotion across Diverse Terrains
School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);Key Laboratory of Machine Intelligence and System Control, Ministry of Education(教育部机器智能与系统控制重点实验室)
LocoManiLab: A Unified Testbed for Data, Policies, Controllers, and Deployment in Humanoid Loco-Manipulation
Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));University of Science and Technology of China(中国科学技术大学);The University of Hong Kong(香港大学);Zhejiang University(浙江大学);Shanghai Jiao Tong University(上海交通大学);ShanghaiTech University(上海科技大学);Gamma Robotics(伽马机器人公司)