Validating Augmented Reality (AR) tracking and interaction models requires precise, repeatable ground-truth motion. However, human users cannot reliably perform consistent motion due to biomechanical variability. Robotic manipulators are promising to act as human motion proxies if they can mimic human movements. In this work, we design and implement ARBot, a real-time teleoperation platform that can effectively capture natural human motion and accurately replay the movements via robotic manipulators. ARBot includes two capture models: stable wrist motion capture via a custom CV and IMU pipeline, and natural 6-DOF control via a mobile application. We design a proactively-safe QP controller to ensure smooth, jitter-free execution of the robotic manipulator, enabling it to function as a high-fidelity record and replay physical proxy. We open-source ARBot and release a benchmark dataset of 132 human and synthetic trajectories captured using ARBot to support controllable and scalable AR evaluation.
A study on a Real-Time VR-Based Teleoperation Framework for Manipulator in Dynamic Environment
Department of Robotics, Hanyang University(韩世大学机器人系);Department of Smart Construction Engineering, Hanyang University(韩世大学智能建造工程系);Department of Interdisciplinary Robot Engineering Systems, Hanyang University(韩世大学跨学科机器人工程系统系);School of Smart Convergence Engineering, Hanyang University, Ansan(韩世大学智能融合工程学院,安山)
Empowering Robot Teleoperation: Exploring the Synergies Between Devices and Manipulator Controllers in a Comparative Study
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, Guangdong, China(香港中文大学(深圳)科学与工程学院);Department of Mechanical and Aerospace Engineering, Hong Kong University of Science and Technology(香港科学与技术大学机械与航空航天工程系);Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS), Shenzhen, Guangdong, China(深圳人工智能与机器人社会研究院(AIRS))
Predictive Relative-Velocity Steering for Safe Robotic Manipulator Teleoperation in Dynamic Environments
Zhejiang University(浙江大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Tsinghua University(清华大学);Institute for Embodied Intelligence and Robotics, Tsinghua University(清华大学具身智能与机器人研究所);TetraBOT
Design and Experimental Validation of Sensorless 4-Channel Bilateral Teleoperation for Low-Cost Manipulators
Degree Programs in Intelligent and Mechanical Interaction Systems, University of Tsukuba(智能与机械交互系统专业,东京大学);Faculty of Engineering, Information and Systems, University of Tsukuba(工程、信息与系统学部,东京大学);Department of Electrical Engineering, Electronics, and Applied Physics, Saitama University(电子工程、电子学与应用物理系,埼玉大学)
Passivity-based control for haptic teleoperation of a legged manipulator in presence of time-delays
Robotics System Lab (RSL), ETH Zurich(苏黎世联邦理工学院机器人系统实验室);Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia (IIT)(意大利理工学院动态腿足系统实验室);Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente(特文特大学电气工程、数学与计算机科学学院)
Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation
Cooperative Medianet Innovation Center(协作中位网创新中心);School of Information Science and Electronic Engineering(信息科学与电子工程学院);Shanghai Jiao Tong University(上海交通大学)
IMMERTWIN: A Mixed Reality Framework for Enhanced Robotic Arm Teleoperation
School of Computing Science, University of Glasgow(格拉斯哥大学计算科学学院);ICPS Research Center, National Institute of Advanced Industrial Science and Technology (AIST)(日本国立先进工业科学技术研究院ICPS研究中心)
Shared-Control Teleoperation Paradigms on a Soft Growing Robot Manipulator
Kadir Has University(卡迪尔哈斯大学);University of Naples Federico II(那不勒斯费德里科二世大学);Stanford University(斯坦福大学);Washington State University(华盛顿州立大学);Purdue University(普渡大学);UC Santa Barbara(加州大学圣巴巴拉分校)
Reality Fusion: Robust Real-time Immersive Mobile Robot Teleoperation with Volumetric Visual Data Fusion
accelerator division at the Deutsche Elektronen Synchrotron DESY(德意志电子同步辐射研究中心加速器部门);Human-Computer Interaction group at Hamburg University(汉堡大学人机交互小组)
Virtual Reality Based Robot Teleoperation via Human-Scene Interaction
Southern University of Science and Technology(南方科技大学);PLA General Hospital(中国人民解放军总医院);National Clinical Research Center for Orthopedics, Sports Medicine and Rehabilitation(国家骨科、运动医学与康复医学临床研究中心)
Effective Virtual Reality Teleoperation of an Upper-body Humanoid with Modified Task Jacobians and Relaxed Barrier Functions for Self-Collision Avoidance
Mixed-Reality-Guided Teleoperation of a Collaborative Robot for Surgical Procedures
Technical University of Cluj-Napoca(克卢日-纳波卡技术大学);Technical Sciences Academy of Romania(罗马尼亚技术科学院);”Iuliu Hatieganu” University of Medicine and Pharmacy(“尤利乌·哈蒂埃加努”医药大学);École Centrale Nantes(南特中央理工学校);Nantes Université(南特大学);CNRS(法国国家科学研究中心)
本文提出一种结合 Kuka IIWA LBR 协作机器人与 Hololens 2 的混合现实遥操作系统,允许外科医生通过手势直观控制机器人定位,有效提升手术工作流程并缩短学习曲线。