OmniInteract: Towards Unified Whole-Body Interaction Control for Dual Humanoids
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Shenzhen Loop Area Institute(深圳河套学院);Beijing Institute of Technology(北京理工大学);The Hong Kong University of Science and Technology(香港科技大学)
Physical interaction is a key capability for humanoid collaboration, requiring coordinated whole-body motion and precise contact. However, learning diverse dual-humanoid interactions faces two major challenges: (1) human-robot morphological differences disrupt contact interfaces and spatial relationships during retargeting, and (2) jointly learning motor skills and partner coordination makes it difficult to retain control fidelity as interaction diversity grows. In this paper, we propose OmniInteract to address these challenges through surface-aware modeling and scalable residual policy learning. First, we introduce Surface Contact-Aware Retargeting, which leverages dense human-robot surface correspondences to jointly retarget both humanoids, preserving explicit interaction contact interfaces and their near-field geometric context. Second, we propose a Scalable Flow-based Interaction Policy for partner-conditioned residual generation. It factorizes dual-humanoid control into a reusable motor foundation and interaction-specific adaptations: partner-aware experts learn corrections over a frozen whole-body motion prior, while conditional flow matching unifies them in a shared residual action space. This enables scalable skill consolidation while retaining pretrained motor capabilities. Extensive experiments demonstrate that OmniInteract improves retargeting fidelity and dual-humanoid coordination while better retaining interaction performance as skill diversity grows. Real-world deployment further demonstrates successful contact establishment, stable whole-body coordination, and recovery from external perturbations.
A Whole-Body Motion Imitation Framework from Human Data for Full-Size Humanoid Robot
The State Key Laboratory of Industrial Control and Technology of Zhejiang University(浙江大学工业控制技术状态重点实验室);Zhejiang Humanoid Robot Innovation Center(浙江人形机器人创新中心);Department of Engineering Mechanics of Zhejiang University(浙江大学工程力学系)
SMAP: Self-supervised Motion Adaptation for Physically Plausible Humanoid Whole-body Control
School of Computer Science, Wuhan University(武汉大学计算机学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));The Chinese University of Hong Kong(香港中文大学);Fudan University(复旦大学);National University of Singapore(新加坡国立大学)
PhysiFlow: Physics-Aware Humanoid Whole-Body VLA via Multi-Brain Latent Flow Matching and Robust Tracking
department of Automation Engineering, Shanghai Jiao Tong University(自动化工程系,上海交通大学);Department of Automation, Key Laboratory of System Control and Information Processing of Ministry of Education, Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education, Shanghai Engineering Research Center of Intelligent Control and Management, Shanghai Jiao Tong University(自动化系,教育部系统控制与信息处理重点实验室,教育部海洋智能设备与系统重点实验室,智能控制与管理上海工程研究中心,上海交通大学)
Rhythm: Learning Interactive Whole-Body Control for Dual Humanoids
Fudan University(复旦大学);TARS Robotics(TARS机器人);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);Shanghai Innovation Institute(上海创新研究院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
TACT: Humanoid Whole-body Contact Manipulation through Deep Imitation Learning with Tactile Modality
CNRS-AIST JRL (Joint Robotics Laboratory), IRL and National Institute of Advanced Industrial Science and Technology (AIST)(CNRS-AIST联合机器人实验室、IRL和国家先进工业科学与技术研究院);Tokyo University of Science(东京科学大学);University of Tsukuba(茨口大学)
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing University of Technology(北京工业大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Shenzhen MSU-BIT University(深圳北理莫斯科大学);JD Explore Academy(京东探索研究院)
HUSKY: Humanoid Skateboarding System via Physics-Aware Whole-Body Control
Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信);The University of Hong Kong(香港大学);University of Science and Technology of China(中国科学技术大学);ShanghaiTech University(上海科技大学)
Whole-body Multi-contact Motion Control for Humanoid Robots Based on Distributed Tactile Sensors
CNRS-AIST JRL (Joint Robotics Laboratory), IRL and National Institute of Advanced Industrial Science and Technology (AIST)(CNRS-AIST联合机器人实验室、IRL和国家先进工业科学与技术研究所)
Experimental Comparison of Whole-Body Control Formulations for Humanoid Robots in Task Acceleration and Task Force Spaces
Automation and Control Inst. (ACIN), TU Wien(自动化与控制研究所(ACIN),维也纳技术大学);Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(机器人与机电研究所,德国航空航天中心(DLR))
Hierarchical Learning Framework for Whole-Body Model Predictive Control of a Real Humanoid Robot
ATR Computational Neuroscience Laboratories(ATR计算神经科学实验室);NTT Communication Science Laboratories, Nippon Telegraph and Telephone Co.(日本电报电话公司NTT通信科学实验室);Graduate School of Informatics, Kyoto University(京都大学情报学研究科)
Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining
Alibaba Group(阿里巴巴集团);Sichuan University(四川大学);Shanghai Innovation Institute(上海创新研究院);Beihang University(北京航空航天大学);Hong Kong University of Science and Technology(香港科技大学)
CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Tasks
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);State Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI);School of Psychological and Cognitive Sciences, Peking University(北京大学心理与认知科学学院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);Yuanpei College, Peking University(北京大学元培学院);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京行为与心理健康重点实验室,北京大学);Joint Laboratory of Embodied AI and Humanoid Robots, BIGAI & UniTree Robotics(BIGAI与UniTree Robotics联合实验室);Embodied Intelligence Lab, PKU-Wuhan Institute for Artificial Intelligence(embodied intelligence实验室,PKU-Wuhan人工智能研究院)
ViLoMan: Learning Visual-Proprioceptive Whole-Body Loco-Manipulation Skills for Humanoid Robots
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS(中国科学院计算技术研究所人工智能安全国家重点实验室);University of Chinese Academy of Sciences (CAS)(中国科学院大学);Beijing Academy of Artificial Intelligence (BAAI)(北京智源人工智能研究院)
Stair Climbing Stabilization of the HRP-4 Humanoid Robot using Whole-body Admittance Control
Montpellier Laboratory of Informatics, Robotics and Microelectronics (LIRMM), CNRS–University of Montpellier(蒙彼利埃信息学、机器人学与微电子实验室(LIRMM),法国国家科学研究中心-蒙彼利埃大学);CNRS–AIST Joint Robotics Laboratory (JRL)(法国国家科学研究中心-日本产业技术综合研究所联合机器人实验室(JRL))
HWC-Loco: A Hierarchical Whole-Body Control Approach to Robust Humanoid Locomotion
The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Harbin Institute of Technology(哈尔滨工业大学);DexForce Technology(DexForce科技);Southeast University(东南大学)