arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.06273cs.ROcs.HC
收藏

一种高保真机器人机械臂远程操作框架用于以人为中心的增强现实评估

A High-Fidelity Robotic Manipulator Teleoperation Framework for Human-Centered Augmented Reality Evaluation

Worcester Polytechnic Institute(沃斯特理工学院)

Harsh Chhajed, Tian Guo

AI总结:

ARBot是一种用于增强现实评估的高保真机器人机械臂远程操作框架,通过定制算法和安全控制器实现自然运动捕捉与回放,提供可控的AR评估数据集。

摘要:

验证增强现实(AR)跟踪和交互模型需要精确且可重复的地面真实运动。然而,由于生物力学的可变性,人类用户无法可靠地执行一致的运动。机器人机械臂有希望作为人类运动的代理,如果它们能够模仿人类动作。在本工作中,我们设计并实现了ARBot,一个实时远程操作平台,能够有效捕捉自然人类运动,并通过机器人机械臂准确回放运动。ARBot包括两个捕捉模型:通过定制的CV和IMU流水线实现的稳定手腕运动捕捉,以及通过移动应用程序实现的自然6自由度控制。我们设计了一个主动安全QP控制器,以确保机器人机械臂的平滑、无抖动执行,使其能够作为高保真的记录和回放物理代理。我们开源了ARBot,并发布了一个包含132个人类和合成轨迹的基准数据集,使用ARBot捕捉,以支持可控且可扩展的AR评估。

英文摘要:

Validating Augmented Reality (AR) tracking and interaction models requires precise, repeatable ground-truth motion. However, human users cannot reliably perform consistent motion due to biomechanical variability. Robotic manipulators are promising to act as human motion proxies if they can mimic human movements. In this work, we design and implement ARBot, a real-time teleoperation platform that can effectively capture natural human motion and accurately replay the movements via robotic manipulators. ARBot includes two capture models: stable wrist motion capture via a custom CV and IMU pipeline, and natural 6-DOF control via a mobile application. We design a proactively-safe QP controller to ensure smooth, jitter-free execution of the robotic manipulator, enabling it to function as a high-fidelity record and replay physical proxy. We open-source ARBot and release a benchmark dataset of 132 human and synthetic trajectories captured using ARBot to support controllable and scalable AR evaluation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑