arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.04577cs.ROcs.CVcs.LG
收藏

AnyTeleop:一种通用的基于视觉的灵巧机器人臂手遥操作系统

AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System

UC San Diego(加州大学圣迭戈分校);NVIDIA(英伟达公司)

Yuzhe Qin, Wei Yang, Binghao Huang, Karl Van Wyk, Hao Su, Xiaolong Wang, Yu-Wei Chao, Dieter Fox

AI总结:

针对现有视觉遥操作系统适配性差的问题,提出通用系统AnyTeleop,支持多类硬件、虚实场景和相机配置,在真实与模拟实验中性能均优于专用系统。

摘要:

基于视觉的遥操作为赋予机器人人类级别的环境物理交互能力提供了可能,且仅需低成本的相机传感器。然而,当前的基于视觉的遥操作系统都是针对特定机器人模型和部署环境设计构建的,随着机器人模型数量增多、操作环境多样性提升,这类系统的扩展性很差。本文提出AnyTeleop,这是一个统一的通用遥操作系统,可在单个系统内支持多种不同的机械臂、机械手、虚实场景及相机配置。尽管该系统在模拟器和真实硬件的选择上具备高度灵活性,仍能实现优异性能。在真实世界实验中,使用同一台机器人时,AnyTeleop的成功率高于一款为特定机器人硬件设计的现有系统。在模拟环境遥操作任务中,与一款专为该模拟器设计的现有系统相比,AnyTeleop带来了更优的模仿学习性能。项目页面:https://yzqin.github.io/anyteleop/。

英文摘要:

Vision-based teleoperation offers the possibility to endow robots with human-level intelligence to physically interact with the environment, while only requiring low-cost camera sensors. However, current vision-based teleoperation systems are designed and engineered towards a particular robot model and deploy environment, which scales poorly as the pool of the robot models expands and the variety of the operating environment increases. In this paper, we propose AnyTeleop, a unified and general teleoperation system to support multiple different arms, hands, realities, and camera configurations within a single system. Although being designed to provide great flexibility to the choice of simulators and real hardware, our system can still achieve great performance. For real-world experiments, AnyTeleop can outperform a previous system that was designed for a specific robot hardware with a higher success rate, using the same robot. For teleoperation in simulation, AnyTeleop leads to better imitation learning performance, compared with a previous system that is particularly designed for that simulator. Project page: https://yzqin.github.io/anyteleop/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑