Long-horizon whole-body humanoid teleoperation remains challenging due to accumulated global pose drift, particularly on full-sized humanoids. Although recent learning-based tracking methods enable agile and coordinated motions, they typically operate in the robot's local frame and neglect global pose feedback, leading to drift and instability during extended execution. In this work, we present CLOT, a real-time whole-body humanoid teleoperation system that achieves closed-loop global motion tracking via high-frequency localization feedback. CLOT synchronizes operator and robot poses in a closed loop, enabling drift-free human-to-humanoid mimicry over long timehorizons. However, directly imposing global tracking rewards in reinforcement learning, often results in aggressive and brittle corrections. To address this, we propose a data-driven randomization strategy that decouples observation trajectories from reward evaluation, enabling smooth and stable global corrections. We further regularize the policy with an adversarial motion prior to suppress unnatural behaviors. To support CLOT, we collect 20 hours of carefully curated human motion data for training the humanoid teleoperation policy. We design a transformer-based policy and train it for over 1300 GPU hours. The policy is deployed on a full-sized humanoid with 31 DoF (excluding hands). Both simulation and real-world experiments verify high-dynamic motion, high-precision tracking, and strong robustness in sim-to-real humanoid teleoperation. Motion data, demos and code can be found in our website.
Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation
Cooperative Medianet Innovation Center(协作中位网创新中心);School of Information Science and Electronic Engineering(信息科学与电子工程学院);Shanghai Jiao Tong University(上海交通大学)
CoHuB: A Simulation Benchmark for Multi-Humanoid Collaboration
Yonsei University(延世大学);Gwangju Institute of Science and Technology(光州科学技术院);University of California, Berkeley(加州大学伯克利分校);Seoul National University(首尔大学)
Istituto Italiano di Tecnologia(意大利理工学院);Florida Institute for Human and Machine Cognition(佛罗里达人机认知研究所);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);National Institute of Advanced Industrial Science and Technology (AIST)(日本产业技术综合研究所);Inria(法国国家信息与自动化研究所);Université de Lorraine(洛林大学);CNRS(法国国家科学研究中心);Tokyo University of Science(东京理科大学)
Unsupervised Neural Motion Retargeting for Humanoid Teleoperation
Graduate School of Informatics, Kyoto University(京都大学 informatics 研究生院);Artificial Intelligence Research Center, National Institute of Advanced Industrial Science and Technology (AIST)(独立行政法人 产业技术综合研究所 人工智能研究中心);Advanced Telecommunications Research Institute International (ATR)(国际电气通信基础技术研究所);Graduate School of Science Technology, Nara Institute of Science and Technology(奈良科学技术研究所 研究生院)
Collision-Free Humanoid Traversal in Cluttered Indoor Scenes
Tsinghua University(清华大学);Tongji University(同济大学);Galbot;Shanghai Qi Zhi Institute(上海启智研究院);South China University of Technology(华南理工大学);Peking University(北京大学);Zhejiang University(浙江大学)
基于云的先进机器人实验室(CARL)集成了全身控制器和基于Web的远程操作,使任何具有Web浏览器的设备都可以访问和控制人形机器人。通过将人形机器人与云集成,可以从任何连接互联网的设备访问它们。增加可访问性很重要,因为很少有人能够访问最先进的人形机器人,限制了它们的发展速度。CARL的实现基于现代软件库、框架和中间件,包括Node.js、Socket.IO、ZMQ、ROS、Robot Web Tools和ControlIt!可行性证明,有经验的人类操作员使用智能手机的网络浏览器来控制梦想家,一个扭矩控制的人形机器人的基础上系列弹性执行器,并使其执行双臂操作任务。该实现可作为许多先进的人形机器人技术的研究和开发的概念验证和基础。
CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Tasks
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);State Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI);School of Psychological and Cognitive Sciences, Peking University(北京大学心理与认知科学学院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);Yuanpei College, Peking University(北京大学元培学院);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京行为与心理健康重点实验室,北京大学);Joint Laboratory of Embodied AI and Humanoid Robots, BIGAI & UniTree Robotics(BIGAI与UniTree Robotics联合实验室);Embodied Intelligence Lab, PKU-Wuhan Institute for Artificial Intelligence(embodied intelligence实验室,PKU-Wuhan人工智能研究院)
ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data
University of Science and Technology of China(中国科学技术大学);Shanghai AI Laboratory(上海人工智能实验室);Northwestern Polytechnical University(西北工业大学);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);TeleAI, China Telecom(TeleAI,中国电信)
TeleGate: Whole-Body Humanoid Teleoperation via Gated Expert Selection with Motion Prior
School of Computer Science and Technology, University of Science and Technology of China(中国科学技术大学计算机科学与技术学院);AnyWit Robotics Co., Ltd., Shushan District, Hefei, Anhui, China(安徽合肥蜀山 district AnyWit 机器人有限公司)
Effective Virtual Reality Teleoperation of an Upper-body Humanoid with Modified Task Jacobians and Relaxed Barrier Functions for Self-Collision Avoidance
Event-Based Upper-Body Humanoid Teleoperation Under Challenging Illumination
School of Mechatronic Engineering and Automation, Shanghai University(上海大学机电工程与自动化学院);SHU General Intelligent Robotics Research Institute(上海大学通用智能机器人研究院);School of Physics, Changchun University of Science and Technology(长春理工大学物理学院)
Enhanced Visual Feedback with Decoupled Viewpoint Control in Immersive Humanoid Robot Teleoperation using SLAM
University of Tsukuba(筑波大学);Universite de Picardie Jules Verne(皮卡第儒勒·凡尔纳大学);National Institute of Advanced Industrial Science and Technology (AIST)(日本产业技术综合研究所)