arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.04450cs.ROcs.AIcs.CVcs.HCcs.LG
收藏

基于遥操作的场景编辑--以6自由度组件装配为例

Scene Editing as Teleoperation: A Case Study in 6DoF Kit Assembly

Samsung AI Center NY(三星纽约人工智能中心);Columbia University(哥伦比亚大学)

Yulong Li, Shubham Agrawal, Jen-Shuo Liu, Steven K. Feiner, Shuran Song

摘要:

机器人遥操作的研究一直围绕着动作规范-从连续的关节控制到离散的末端执行器位姿控制。然而,这些以机器人为中心的界面通常需要具有广泛机器人专业知识的熟练操作员。为了使遥操作访问非专家用户,我们提出了框架“场景编辑遥操作”(SEaT),其中的关键思想是将传统的“以机器人为中心”的界面转换为“以场景为中心”的界面-而不是控制机器人,用户专注于指定任务的目标,通过操纵现实世界的对象的数字孪生。因此,用户可以在没有机器人硬件的任何专业知识的情况下执行遥操作。为了实现这一目标,我们利用一个类别不可知的场景完成算法,将现实世界的工作空间(未知对象)转化为可操作的虚拟场景表示和动作捕捉算法,在生成机器人的行动计划之前细化用户输入。为了训练算法,我们程序化地生成了一个大规模的、多样化的套件组装数据集,该数据集包含模仿真实世界的对象套件任务的对象套件对。我们在模拟和真实世界的系统上的实验表明,我们的框架提高了6DoF套件装配任务的效率和成功率。一项用户研究表明,SEaT框架参与者实现了更高的任务成功率,并报告了较低的主观工作量相比,替代机器人为中心的界面。视频可以在https://www.youtube.com/watch?上找到v=-NdR3mkPbQQ。

英文摘要:

Studies in robot teleoperation have been centered around action specifications -- from continuous joint control to discrete end-effector pose control. However, these robot-centric interfaces often require skilled operators with extensive robotics expertise. To make teleoperation accessible to non-expert users, we propose the framework "Scene Editing as Teleoperation" (SEaT), where the key idea is to transform the traditional "robot-centric" interface into a "scene-centric" interface -- instead of controlling the robot, users focus on specifying the task's goal by manipulating digital twins of the real-world objects. As a result, a user can perform teleoperation without any expert knowledge of the robot hardware. To achieve this goal, we utilize a category-agnostic scene-completion algorithm that translates the real-world workspace (with unknown objects) into a manipulable virtual scene representation and an action-snapping algorithm that refines the user input before generating the robot's action plan. To train the algorithms, we procedurally generated a large-scale, diverse kit-assembly dataset that contains object-kit pairs that mimic real-world object-kitting tasks. Our experiments in simulation and on a real-world system demonstrate that our framework improves both the efficiency and success rate for 6DoF kit-assembly tasks. A user study demonstrates that SEaT framework participants achieve a higher task success rate and report a lower subjective workload compared to an alternative robot-centric interface. Video can be found at https://www.youtube.com/watch?v=-NdR3mkPbQQ .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑